Data Engineer
SonarSource
This job is no longer accepting applications
See open jobs at SonarSource.See open jobs similar to "Data Engineer" General Catalyst.Software Engineering, Data Science
Geneva, Switzerland
This means:
- Take technical ownership of the data platform and produce high-quality self-served components that the domain teams can use autonomously.
- Get involved in the definition of new features and technologies that will impact all SonarSource teams and hundreds of thousands of developers worldwide.
- Help improve the team's effectiveness by challenging and continuously improving existing processes, designs, and engineering practices.
On a daily basis you will
- Design and develop the data platform to support the functional domains in handling their data by using the state-of-the-art while helping them in their journey to data ownership
- Design and implement data retrieval, storage, transformation, and load capabilities following Data Mesh principles.
- Continuously enhance the data platform and propose, implement, and manage data handling services according to stakeholders' needs (Product Managers, Marketing, Sales, engineering teams, etc.).
- Establish top-class end-to-end pipelines including data cleaning and modelling.
- Develop and deploy connectors to data sources of interest.
- Assemble large, complex data sets that meet functional / non-functional business requirements.
- Maintain evergreen data flow documentation across systems.
- Collaborate on Data Governance with other stakeholders/domains.
- Implement appropriate entitlement controls around data access.
- Work with the security function to ensure we adhere to expected security standards.
- Collaborate with the incident manager to bring your expertise when asked and own implementation of recommendations from post-mortems.
The skills you will demonstrate
- You have solid software engineering experience, focusing on developing analytics components in the cloud. You have been exposed to big data architecture essentials, streaming, data manipulation using SQL, ETL batches, data store administration, etc.
- You see yourself as a developer working on data. You are motivated by both technical and functional aspects of services.
- You are a friendly, enthusiastic, and organized team player. You actively share your knowledge and give and receive feedback to improve the team and yourself.
- Strong experience building end-to-end ETLT, ETL, or ELT pipelines with batch or streaming technologies in Python.
- Strong experience with the AWS platform including, but not limited to, services such as Glue, RedShift, CloudFormation, S3, CloudWatch, Lambdas, etc.… or equivalents
- Good knowledge of data engineering concepts (Data Lake, Data Warehouse, etc.)
- Experience querying, manipulating, and modeling data with SQL. Knowledge of dbt is a plus.
- Experience with Infrastructure as code tools (CDK, CloudFormation, Terraform)
- Knowledge of how to use visualization tools such as, but not limited to, Tableau, AWS Insights, or Looker
- You are fluent in English, both written and spoken.
This job is no longer accepting applications
See open jobs at SonarSource.See open jobs similar to "Data Engineer" General Catalyst.