Widely considered to be one of the technology world’s most desirable employers, NVIDIA is an industry leader with groundbreaking developments in High-Performance Computing, Artificial Intelligence and Visualization. The GPU, our invention, serves as the visual cortex of modern computers and is at the heart of our products and services. GPU deep learning ignited modern AI — the next era of computing — with the GPU acting as the brain of computers, robots, autonomous cars and conversational AI that can perceive and understand the world. Today, we are increasingly known as “the AI computing company.” We're looking to grow our company, and build our teams with the hardest working people in the world. Join us at the forefront of technological advancement.

NVIDIA is looking for Senior Deep Learning Scientist, LLM and Tools to develop high-impact, high-visibility Large language modeI products and improve the experience of millions of customers using our NeMo LLM MLOps platform. If you're creative & passionate about solving real world conversational AI problems, come join our Digital Human LLM team. For more details on NeMo Frameworks for LLMs check https://www.nvidia.com/en-us/ai-data-science/generative-ai/nemo-framework/

What you’ll be doing:

• Develop, Train, Fine-tune, and Deploy multimodal large language models for retrieval augmented generation and tools usage

• Build LLM agent framework for reasoning and action prediction in multimodal environment

• Apply instruction tuning, reinforcement learning from human feedback (RLHF), and parameter efficient fine-tuning such as p-tuning, adaptors, LoRA, and so on to improve LLMs for reasoning and action prediction

• Measure and benchmark model and application performance

• Analyze model accuracy and bias and recommend the next course of action & Improvements.

• Maintain model evaluation systems

• Drive the gathering, building, and annotation of domain specific datasets to train LLMs for different tasks, tools, and applications.

• Characterize performance and quality metrics across platforms for various AI and system components.

• Participate in developing and reviewing code, design documents, use case reviews, and test plan reviews.

• Help innovate, identify problems, recommend solutions and perform triage in a collaborative team environment and collaborate with various teams on new product features and improvements of existing products.

What we need to see:

• Master’s degree (or equivalent experience) or PhD in Computer Science, Electrical Engineering, Artificial Intelligence, or Applied Math with 5+ years of experience

• Understanding of LLM Agent development approaches for multi-step planning, reasoning, and tools interaction

• Hands-on experience with LLM agent frameworks including OpenAI functions, AutoGPT, BabyAGI, and Plan-and-execute agents.

• Experience developing production LLM powered applications and tools with natural language interface

• Excellent programming skills in Python with strong fundamentals in programming, optimizations and software design

• Solid understanding of ML/DL techniques, algorithms and tools with exposure to CNN, RNN (LSTM), Transformers (BERT, BART, GPT/T5, Megatron, LLMs)

• Experience with training BERT, GPT and Megatron Models for different NLP and dialog system application using “PyTorch” Deep Learning Frameworks and performing NLP data wrangling and tokenization

• Understanding of MLOps life cycle and experience with MLOps workflows & traceability and versioning of datasets including knowhow of database management and queries (in SQL, MongoDB etc)

• Experience using end-to-end MLOps platform such as KubeFlow, MLFlow, AirFlow

• Strong collaborative and interpersonal skills, specifically a proven ability to effectively guide and influence within a dynamic matrix environment

Ways to stand out from the crowd:

• Fluency in a non-English language - Spanish / Mandarin / German / Japanese / Russian / French / UK English / Arabic/ Korean / Italian / Portuguese

• Familiarity with GPU based technologies like CUDA, CuDNN and TensorRT

• Background with Dockers and Kubernetes and Strong C++ programming skills

• Background with deploying machine learning models on data center, cloud, and embedded systems

• Experience developing document extraction for different documents types and sources, and indexing at scale as well as experience adapting LLMs to different domains such as automotive, health care, finance and so on

With competitive salaries and a generous benefits package (www.nvidiabenefits.com ), we are widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us and, due to outstanding growth, our best-in-class engineering teams are rapidly growing. If you're a creative and autonomous engineer with a real passion for technology, we want to hear from you!

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.