Join our companies in their quest to drive powerful, positive, change that endures.

Senior DevOps Engineer

Hippocractic AI

Hippocractic AI

Software Engineering
Palo Alto, CA, USA
Posted on Wednesday, June 12, 2024

We are seeking a highly skilled DevOps Engineer to join our team. In this role responsibilities will include designing and implementing infrastructure automation, continuous integration and delivery pipelines, and monitoring and scaling the infrastructure that powers our healthcare AI platform. You will work closely with software engineers, research scientists, and other cross-functional teams to develop and maintain reliable and scalable infrastructure that enables rapid iteration and deployment of our products.

Key Responsibilities:

  • Design and implement infrastructure automation and deployment pipelines using tools such as Terraform, Ansible, and Jenkins

  • Implement and maintain monitoring and logging systems to ensure the reliability and performance of our healthcare AI platform

  • Work closely with software engineers to design and deploy scalable, fault-tolerant, and secure production systems on cloud platforms such as AWS, GCP, or Azure

  • Develop and maintain security and compliance policies and procedures for our healthcare AI platform

  • Collaborate with cross-functional teams to troubleshoot and resolve complex issues related to infrastructure, deployment, and operations

  • Implement and maintain disaster recovery and business continuity plans

  • Develop and maintain documentation related to infrastructure, deployment, and operations

  • Mentor and provide technical guidance to junior engineers


  • Bachelor's or Master's degree in Computer Science, Computer Engineering, or a related field

  • At least 5 years of professional experience in DevOps engineering or a related field

  • Expertise in infrastructure automation and deployment tools such as Terraform, Ansible, Jenkins, or GitLab CI/CD

  • Experience with cloud platforms such as AWS, GCP, or Azure

  • Strong knowledge of containerization technologies such as Docker and Kubernetes

  • Experience with monitoring and logging tools such as ELK, Grafana, or Datadog

  • Familiarity with security and compliance best practices and tools such as HashiCorp Vault, AWS KMS, or Azure Key Vault

  • Strong problem-solving skills and ability to work independently and collaboratively in a team environment

  • Excellent communication and interpersonal skills

  • Experience implementing HIPAA and SOC2 compliance in a plus

  • Experience working in an HPC Environment is a plus

Company Overview:

Hippocratic AI’s mission is to develop the first safest focused Large Language Model (LLM) for healthcare. The company believes that a safe LLM can dramatically improve healthcare accessibility and health outcomes in the world by bringing deep healthcare expertise to every human. No other technology has the potential to have this level of global impact on health.

The company was co-founded by CEO Munjal Shah, alongside a group of physicians, hospital administrators, healthcare professionals, and artificial intelligence researchers from El Camino Health, Johns Hopkins, Washington University in St. Louis, Stanford, Google, and Nvidia. Hippocratic AI has received a total of $120M in funding and is backed by leading investors, including General Catalyst, Andreessen Horowitz, Premji Invest, and SV Angel.