Data Engineer
Hometap
This job is no longer accepting applications
See open jobs at Hometap.See open jobs similar to "Data Engineer" General Catalyst.Software Engineering, Data Science
Boston, MA, USA
What You'll Do:
- Data Infrastructure Development: Design, build, and maintain scalable and reliable data pipelines and infrastructure, ensuring data integrity, quality, and availability.
- Data Modeling and Architecture: Collaborate with data architects and stakeholders to develop efficient data models and data integration strategies that align with the organization's financial goals and objectives.
- ETL Processes: Develop, optimize, and monitor Extract, Transform, Load (ETL) processes to enable seamless data integration and transformation from various sources into our data warehouse.
- Data Validation and Cleansing: Implement data validation and cleansing techniques to identify and resolve data quality issues, ensuring the accuracy and consistency of financial data.
- Performance Optimization: Continuously improve the performance and efficiency of data processing workflows, including query optimization, indexing strategies, and data partitioning techniques.
- Data Governance and Security: Ensure compliance with data governance policies, industry regulations, and best practices for data privacy and security within the finance industry.
- Collaboration and Documentation: Work closely with cross-functional teams, including data analysts, data scientists, and business stakeholders, to understand data requirements, provide technical support, and document data processes and standards.
- Monitoring and Troubleshooting: Monitor data pipelines, proactively identify and resolve data-related issues, and troubleshoot any system failures or performance bottlenecks.
- Stay Up-to-Date: Stay current with industry trends, emerging technologies, and best practices related to data engineering, finance, and regulatory compliance.
What You'll Bring:
- Bachelor's degree in Computer Science, Information Systems, or a related field. A Master's degree in a relevant discipline is a plus.
- 3+ years of proven experience as a Data Engineer, ideally in the finance industry or a related domain.
- Strong proficiency in SQL, with expertise in writing complex queries, stored procedures, and optimizing query performance.
- Extensive experience with Snowflake or other cloud-based data warehousing platforms, including designing and managing large-scale data structures and optimizing data processing workflows.
- Proficiency in programming languages such as Python and Java, with experience in building and maintaining data pipelines and ETL processes.
- Familiarity with data modeling and database design principles, including star and snowflake schemas, normalization, and denormalization techniques.
This job is no longer accepting applications
See open jobs at Hometap.See open jobs similar to "Data Engineer" General Catalyst.