Principal Data Engineer
Job Description
The Vectra Engineering team is a small and constantly growing team of individuals. We look for people that are smart, very capable technically, and have fun solving the challenges that our customers face together as a team. We believe strongly that everyone can and should have significant impacts on the growth of the product as well as the company and our culture. We believe in using the right technology for each problem and building knowledge through mentorship and other things like peer code reviews. We're excited to find others to join the team that want to work on an interesting product that solves real problems.
Responsibilities
As a Principal Data Engineer here at Vectra you'll will work on a core part of Vectra's technology offering. The Data Platform teams are responsible for processing the petabyte scale data which we ingest into a format which can be queried efficiently to power our detection algorithms and to allow our customers to quickly investigate potential security breaches in their systems.
The Detections Team is building out Vectra's next generation Stream Processing framework, Jetstream. Our customers data sizes and patterns vary widely and we need to be able to scale up and down to respond to each of their needs while providing a best in class developer experience for our Data Scientist teams. This is a role for someone who wants to build the best platform tooling to enable data teams to ship in time to respond to a constantly changing Threat-scape.
Each of these teams will generally require you to:
- Design modern data pipeline architectures and build tooling for other engineering teams to efficiently tackle their Big Data projects
- Be able to develop modern Docker and Kubernetes services in languages like Python, Golang or Rust
- Apply knowledge of relational and non-relational databases to model customers’ networks and active security threats.
- Work with sales, sales engineers, support, product management, and customers to solve problems that matter.
- Interface with other engineering and product groups including UX, Security Research, and Data Science to help customers simplify security.
Job Requirements
- BS or MS in Computer Science/Engineering (or equivalent experience)
- 8+ years professional experience in software design and delivery
- Experience with a modern data processing tools at scale (Deltalake, Spark, Hive, etc)
- Experience with a modern programming language (Python, Golang, Rust, etc)
- Experience with Cloud Providers ie AWS, Azure, etc
- Experience with REST APIs
- Database hands-on experience (MySQL, couchdb, ElasticSearch, etc.)
- Unix/Linux proficiency
- Experience with a source control system, preferably Git
Desirable
- Devops or operational cloud infrastructure experience especially with AWS
- Experience with infrastructure as code (Terraform, CloudFormation)
- Production observability tools (Prometheus, Grafana)
