Anyscale

Engineering Leader / Manager (Ray Core)

Job Description

Posted on: 
February 27, 2023

Anyscale is looking for a strong Engineering Leader to manage the Ray Core (Core Runtime) team, which includes both the open source Ray distributed computing framework, and proprietary features. We are looking for candidates with experience to manage through managers or tech leads.

As an open source project, Ray is about making general purpose distributed computing easy, and Ray Core is the fundamental architecture behind this “infinite laptop” mission. The Ray Core team is responsible for developing this core distributed computing framework (with basic abstractions of Tasks, Actors, Objects) to support Ray developers, and other Ray libraries (e.g. Datasets, ML libraries). The work also includes adding proprietary features to make the Anyscale SaaS offering more competitive. The work will be essential in our path towards Ray 2.0, and also in the next phase of the Anyscale product.

You can learn more about Ray Core with these materials:

- Eric Liang (Ray Core Tech Lead) talking about Ray 1.0

- Our research papers on NSDI ‘21 and HotOS ‘21 describing the architectural vision of a Distributed Futures system

- How Ray Core’s flexible scheduling and shared data plane enable high performance in third generation ML platforms

In this position, you will guide the vision, recruit, and enable a high-performing team. This team is critical to everything that Anyscale and Ray achieve and will play a pivotal role in the success of the company.

Responsibilities

  • Drive the strategy of the Anyscale Ray Core (or Core Runtime) group
  • Drive the execution of Ray Core team’s key projects towards Ray 2.0 and beyond
  • Hiring, team Building: Build a world-class team of distributed systems engineers
  • Focus on building and maintaining a culture of collaboration within the team
  • Communicate your work to a broader audience through talks, tutorials, and blog posts
  • Help us to build and shape a world-class company

Job Requirements

  • Experience building core distributed systems
  • Experience leading an open-ended project (Computer Science Systems research background is a plus)
  • Experience with operating data / ML infra in production is a plus
  • Solid engineering management experience leading productive, high-performing teams
  • Managing through other managers is a requirement
  • Record of helping teams scale quickly while maintaining a good culture
  • A great track record of execution
  • Mindset towards achieving results, and excellent prioritization skills
  • Effective communication
Apply now

More job openings