Staff Software Engineer
Verta
Business Area:
EngineeringSeniority Level:
Mid-Senior levelJob Description:
At Cloudera, we empower people to transform complex data into clear and actionable insights. With as much data under management as the hyperscalers, we're the preferred data partner for the top companies in almost every industry. Powered by the relentless innovation of the open source community, Cloudera advances digital transformation for the world’s largest enterprises.
The Replication Manager team is looking for passionate developers. The team is responsible for building out the data, metadata, permissions and lineage replication support for the Cloudera Data Platform. The team's mission is to provide a seamless experience for our customers for moving the data and all entities associated with that to achieve migration, replication as well as disaster recovery use cases.
Replication Manager enables the customers to replicate data across data centers or to/from the cloud. Replication scenarios can include data stored in HDFS, Ozone, or public cloud buckets; data stored in Hive tables, Hive metastore, HBase or Iceberg table data; Ranger permissions and Atlas lineage. The datasets can range from terabytes to petabytes of data with some additional challenges like millions of directories/Ozone keys, individual file sizes ranging in gigabytes, near real time HBase WAL replication.
How we work
We are a distributed team that values deep technical work and a sustainable, long-term focus. Our culture is built on psychological safety, trust, and respect for an engineer's time.
We practice a blameless culture, focusing on solving problems, not assigning blame
We value deep work. We have no-meeting days and balance our time carefully between async communication and real-time collaboration like pair programming
We trust you to manage your time. We offer flexible hours to support a healthy work-life balance
We grow through collaboration. We make key architectural decisions through written design docs and believe in direct, actionable feedback
As a Staff Software Engineer, you will
Build and maintain large-scale replication systems on top of the Cloudera Data Platform stack
Be responsible for our products running in production
Work with a distributed team of engineers to design cloud-based, low RPO, RTO replication architectures
Support replication across multiple Cloudera components like HDFS, Ozone, Hive, HBase, Iceberg, Atlas, and Ranger
Give and take actionable feedback
Mentor junior engineers
Work with product management and occasionally, with field engineers on the product roadmap and early access feature introductions
We’re excited about you if you have:
Masters in Computer Science or related field and 4-6 years of experience - or Bachelors and more than 6 years of relevant industry experience
Strong backend engineering skill set with expertise in Java or Scala
Ability to read large codebases and write succinct, clean code
Experience with system software design and development with an understanding of computer architecture, storage, network, and IO subsystems
You may also have
Experience with large-scale, distributed systems design and development with an understanding of scaling, replication, consistency, and high availability
Current expertise with Java/Scala developer ecosystems
Experience with AWS, Azure or GCP
Test automation experience along with Python basics
Systems/DevOps experience
Background in performance tuning, identifying performance bottlenecks, and implementing performance optimizations
What you can expect from us:
Generous PTO Policy
Support work life balance with Unplugged Days
Flexible WFH Policy
Mental & Physical Wellness programs
Phone and Internet Reimbursement program
Access to Continued Career Development
Comprehensive Benefits and Competitive Packages
Employee Resource Groups
EEO/VEVRAA
#LI-ZC1
#LI-HYBRID