About Log10 IncLog10 is addressing the challenges around reliability and consistency of LLM-powered applications via a platform that provides AI-powered evaluations, fine-tuning and debugging tools. We are currently a team of 8 having previously worked in AI and infra roles at companies such as Intel, MosaicML, Adobe, Docker, PostEra, Starburst and Second Measure.ResponsibilitiesDevelop and implement novel AI algorithms to automate improvements of LLM applicationsTrain fine-tuned and reward models based on large datasets to reflect human preferences of domain expertsInvent synthetic data generation algorithms to train custom evaluation models and augment human reviewCollaborate with cross-functional teams to integrate AI solutions into our LLMOps product offeringsStay updated with the latest trends and developments in LLMs, especially evaluations, prompt engineering, fine-tuning and open source models (DBRX, Mistral, Mixtral, Llama-3 etc.)Document and present research findings and methodologies to both internal and external stakeholdersRequirementsMaster’s or PhD in Computer Science, Machine Learning, Artificial Intelligence, or a related fieldProven experience with machine learning algorithms and statistical models. Solid understanding of NLP and experience working with LLMs.Strong programming skills in Python and experience with AI/ML frameworks like TensorFlow, PyTorch, etc.Excellent problem-solving and analytical skillsAbility to work independently in an organized manner. Strong communication and collaboration skillsComfortable working with version control (git)Significant post-academic experienceNice to haveExperience in a startup environmentExperience with evaluating LLMs, familiarity with research in LLM evaluation, e.g. PrometheusExperience in logging, debugging and fine-tuning large language modelsExperience developing end-to-end machine learning systemsPublications in relevant AI/ML conferences and journalsExperience with cloud computing platforms like AWS, GCP, or AzureKnowledge of containerization and orchestration technologies (e.g., Docker, Kubernetes)We provide a competitive salary, equity, and the chance to develop foundational systems that will redefine how companies build AI. This is a high-impact, high-autonomy role for someone eager to take on technical ownership and leadership. If this matches your background and ambitions, we'd love to hear from you!