Job Description:
Department Overview
Rakuten is a global technology company dedicated to leveraging its membership ecosystem and data to positively impact society. Our AI for Business Department (AI4B) leads this initiative, focusing on developing and deploying innovative solutions that combine the latest Generative AI technologies with established data science and machine learning techniques. These solutions enhance our products and services across our Commerce & Marketing, FinTech, and Mobile business units. We seek talented data scientists, engineers, project managers and product managers passionate about applying their skills to pioneering projects that can make a significant difference and potentially change the world.
Position Details
We are seeking talented AI Engineers to join our team in developing LLM applications. This role focuses on designing and implementing robust cognitive architectures rather than improving language models themselves. We prioritize metrics such as latency, cost, and accuracy, with scalability being a critical consideration. Ideal candidates will be passionate about creating innovative solutions to enhance the functionality and performance of AI systems.
Rakuten, with over 1.8 billion members worldwide and a vast ecosystem of services, leverages AI to drive transformation across e-commerce, fintech, digital content, and telecommunications. Join us to develop and deploy robust AI systems that will be integrated into society.
Responsibilities:
- Develop stateful LLM applications using open-source software like LangGraph.
- Establish evaluation frameworks for LLM applications, researching and applying appropriate metrics for various tasks, including but not limited to summarization, retrieval-augmented generation (RAG), translation, and classification.
- Build automated systems to evaluate LLM application performance, ensuring they meet high standards of accuracy, efficiency, and reliability.
- Explore and implement approaches to enhance model performance, such as advanced RAG techniques, supervised fine-tuning, model merging.
Mandatory Qualifications:
- Strong proficiency in Python.
- Ability to work effectively in diverse team environments, demonstrating a collaborative attitude essential for the team's success
- Experience in software development practices, including version control, code reviews, and continuous integration/continuous deployment (CI/CD) pipelines.
- Experience working with public cloud environments.
- Experience with open-source LLM orchestration software like Langchain, Llamaindex
Desired Qualifications:
- Experience with PyTorch or other machine learning libraries.
- Strong expertise in building production-grade backend systems and APIs.
- Creative problem-solving skills and the ability to work on complex projects that require interdisciplinary knowledge.
#aiengineer