Join our team as a QA Engineer for AI Platforms! In this role, you’ll dive into NLP concepts, LLM testing, and automation frameworks to ensure cutting-edge AI systems meet the highest standards.

Responsibilities:

• NLP and LLM Expertise: Deep understanding of NLP concepts, LLM architectures and evaluation metrics
• Strong programming skills in Python and test automation tools. Proven ability to write efficient test scripts, automation frameworks, and perform data analysis
• LLM Testing Strategies: Extensive experience in designing and executing comprehensive LLM testing strategies. Ability to design and implement automation frameworks tailored for Large Language Models
• Integrate LLM automation tests into CI/CD pipelines.
• Deep understanding of software testing methodologies and hands-on experience with defect management tools. Familiarity with version control systems and CI/CD pipelines
• Hands-on experience with LLM-specific testing tools, text comparison tools, and data visualization libraries such as Weights and Biases, DeepEval etc. Knowledge of data privacy regulations and experience designing tests to detect and mitigate biases in LLMs

Qualifications:

• o   A BS in computer science or related field
• o   A minimum of 3-5 years of experience in testing LLMs and LLM based systems.
• o   Strong knowledge of LLMs, VLMs, or MLLMs
• o   Proficiency in Python
• o   Experience with Git, CI/CD
• o   Familiarity with cloud deployment (GCP or AWS), and Docker
• o   Strong communication skills

Emergence is an equal opportunity employer that is committed to diversity and inclusion in the workplace. We prohibit discrimination and harassment of any kind based on race, color, sex, religion, sexual orientation, national origin, disability, genetic information, pregnancy, or any other protected characteristic as outlined by federal, state, or local laws. This applies to all employment practices within our organization, including hiring, recruiting, promotion, termination, layoff, recall, leave of absence, compensation, benefits, and training. We make hiring decisions based solely on qualifications, merit, and business needs at the time.
Benefits:Every last Friday of the month Paid Time off for everyone.401(k) matchingDental insuranceFlexible scheduleFlexible spending accountHealth insuranceHealth savings accountLife insuranceUnlimited Paid time offParental leaveVision insurance