Line of Service

Industry/Sector

Specialism

Management Level

Job Description & Summary

*Why PWC

At PwC, you will be part of a vibrant community of solvers that leads with trust and creates distinctive outcomes for our clients and communities. This purpose-led and values-driven work, powered by technology in an environment that drives innovation, will enable you to make a tangible impact in the real world. We reward your contributions, support your wellbeing, and offer inclusive benefits, flexibility programmes and mentorship that will help you thrive in work and life. Together, we grow, learn, care, collaborate, and create a future of infinite experiences for each other. Learn more about us.

At PwC, we believe in providing equal employment opportunities, without any discrimination on the grounds of gender, ethnic background, age, disability, marital status, sexual orientation, pregnancy, gender identity or expression, religion or other beliefs, perceived differences and status protected by law. We strive to create an environment where each one of our people can bring their true selves and contribute to their personal growth and the firm’s growth. To enable this, we have zero tolerance for any discrimination and harassment based on the above considerations. "

Job Description & Summary: A career in our New Technologies practice, within Application and Emerging Technology services, will provide you with a unique opportunity to help our clients identify and prioritize emerging technologies that can help solve their business problems. We help clients design approaches to integrate new technologies, skills, and processes so they can drive business results and innovation. Our team helps organizations to embrace emerging technologies to remain competitive and improve their business by solving complex questions. Our team focuses on identifying and prioritizing emerging technologies, breaking into new markets, and preparing clients to get the most out of their emerging technology investments.

Responsibilities:

• Design, develop, and maintain automated test frameworks and scripts for chat interface applications
• utilizing LLMs, ensuring comprehensive coverage of all functionalities and user scenarios.
• Understand Retrieval Augmented Generation(RAG) strategy to improve testing for knowledge-
• intensive tasks by retrieving relevant documents or data that can be used as references or benchmarks
• for evaluating the LLM's responses
• Evaluate chat interactions for adherence to conversational design principles, ensuring responses are
• accurate, relevant, and delivered within acceptable time frames.
• Perform thorough regression testing when bugs are resolved and when there are updates to LLMs or
• application features.
• Collaborate with development teams to understand application features and integration points for
• Large Language Models, identifying potential areas for automation.
• Execute automated and manual test cases, analyze test results, identify and document defects, and
• work closely with developers to ensure they are addressed promptly.
• Monitor the performance of LLMs in the chat interface, identifying any issues with latency, accuracy,
• or relevance of responses.
• Stay up-to-date with the latest developments in AI, machine learning, and chatbot technologies to
• continually improve testing strategies and tools.
• Collaborate with product managers and UX designers to ensure the chat application meets the highest
• standards of user satisfaction and engagement.
• Ensure compliance with data privacy and security policies during the testing process, especially when
• handling sensitive user data.
• Provide detailed reports and documentation on test activities, results, insights, and recommendations
• for improving the application's quality and performance.
• Tools Exposure Expected:.

Mandatory skill sets:

Python, Machine Learning, Prompt Engineering, Java-Selenium, Python Robot Framework  
 

Preferred skill sets:

LLM, Data Processing, SQL, Azure, CI/CD, Jira

Years of experience required:

4 to 7 years  

Education qualification:

B.E/B.Tech

Education (if blank, degree and/or field of study not specified)

Certifications (if blank, certifications not specified)

Required Skills

Optional Skills

Desired Languages (If blank, desired languages not specified)

Travel Requirements

Available for Work Visa Sponsorship?

Government Clearance Required?

Job Posting End Date