Senior Data Pipeline Engineer II
Job Description
We are seeking a Senior Data Pipeline Engineer to develop software, data systems and pipelines to combat cancer. You'll be responsible for building a business intelligence platform to shed light on all internally-generated data to help improve and refine our processes, including handling heterogenous data through data warehousing and ETL pipelines. Our systems are built using the latest web software development technologies and methodologies, including those you will decide to use. The ideal candidate is excited to take the lead on major projects and collaborate actively with our world-class team of engineers, scientists, designers, and product managers. You are passionate about building reliable, maintainable, scalable, and fault-tolerant data pipelines, and you will have a significant impact on the continued growth of a high profile technology organization that is changing the landscape on early cancer detection.
The role reports to our engineering management team.
Responsibilities
- Design, develop, and deploy reliable, maintainable, scalable, and fault-tolerant data pipelines and services that power our internal experiments and analyses
- Work with scientists, product managers, and other engineers to solve complex problems in the face of lots of dynamism and uncertainty
- Collaborate with team members for code and design review
- Mentor junior engineers and grow our team’s technical expertise
- Lead and champion data engineering best practices and team culture as a core part of the engineering backbone
Job Requirements
- 5+ years of experience as a part of a software engineering team successfully shipping one or more data pipelines used by multiple people or groups
- Expertise with a scripting language: Python, Javascript, Ruby, Scala, Go, etc
- Extensive knowledge of Redshift, BigQuery, or similar technologies
- Expertise with a variety of data stores: SQL, noSQL, columnar, timeseries, etc
- Demonstrated experience with handling and transforming large multivariate datasets via ETL pipelines
- Experience designing and implementing scalable data systems for multiple applications
- Prior experience with mentoring more junior coworkers
- Excellent written and verbal communication skills
- The ability to thrive in an environment where collaboration, communication, and compromise are an expected part of your day-to-day work
- A mindful, transparent, and humane approach to your work and your interactions with others
