Together AI is seeking a Senior Software Engineer for a new small autonomous DX engineering team that will focus on shipping impactful APIs and services to improve the core developer experience of our platform – primarily for customers doing inference on our platform.
This role is for someone who thrives on shipping new features & APIs, and has expertise in building backend API services, integrating with complex backend systems, and has ideally worked with LLM APIs. You will work as a part of a small team to ship APIs and services that developers and enterprises are excited about.
Some of what you’ll work on:

Design and build new APIs to improve the developer experience of our platform like web search, code interpreter, and MCP support
Build an agent workflow API to enable our customers to stitch together our AI models and tools in an easy to use way with retries and fallbacks
Prototype new APIs for common custom problems like solving OCR – including trying out different solutions, benchmarking them, and shipping the best one

Required Qualifications

3+ years experience writing high-performance, well-tested, & production quality code
Bachelor’s degree in computer science or equivalent industry experience
Experienced programmer in TypeScript, Python, or both
Experience designing, shipping, scaling, and maintaining APIs
Experience building with LLMs & using their capabilities like function calling a plus
Experience with Kubernetes or containers a plus

Key Responsibilities

Design, ship, scale, and maintain APIs and services from 0 -> 1
Analyze and improve existing distributed systems and APIs
Write clear, well-tested, and maintainable software for both new and existing systems

About Together AI
Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers and engineers in our journey in building the next generation AI infrastructure.
Compensation
We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $160,000 - $260,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.
Equal Opportunity
Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.
Please see our privacy policy at https://www.together.ai/privacy  


Location

San Francisco or New York

Job Overview
Job Posted:
2 weeks ago
Job Expires:
Job Type
Full Time

Share This Job: