Line of Service

Advisory

Industry/Sector

Not Applicable

Specialism

Emerging Technologies

Management Level

Senior Associate

Job Description & Summary

A career in our Technology Consulting practice, within General Consulting services, will provide you with the opportunity to help clients seize essential advantages by working alongside business leaders to solve their toughest problems and capture their greatest opportunities. We work with some of the world’s largest and most complex companies to understand their unique business issues and opportunities in an ever changing environment. We help create sustainable change by stimulating innovation, unlocking data possibilities, navigating risk and regulatory complexity, optimising deals, and aligning costs with business strategy to create a competitive advantage.

As a member of the team, you’ll work with clients to define their vision and plan how to get there. We deliver the technological solutions organisations need to compete and grow and build a lasting legacy of improvement and performance, partnering with best in class technologies and solution sets. In joining, you’ll help our clients understand and evolve the way they align Information Technology with their business strategy, create integrated end to end solutions, and use enterprise applications to solve complex business problems.

*Why PWC

At PwC, you will be part of a vibrant community of solvers that leads with trust and creates distinctive outcomes for our clients and communities. This purpose-led and values-driven work, powered by technology in an environment that drives innovation, will enable you to make a tangible impact in the real world. We reward your contributions, support your wellbeing, and offer inclusive benefits, flexibility programmes and mentorship that will help you thrive in work and life. Together, we grow, learn, care, collaborate, and create a future of infinite experiences for each other. Learn more about us.

At PwC, we believe in providing equal employment opportunities, without any discrimination on the grounds of gender, ethnic background, age, disability, marital status, sexual orientation, pregnancy, gender identity or expression, religion or other beliefs, perceived differences and status protected by law. We strive to create an environment where each one of our people can bring their true selves and contribute to their personal growth and the firm’s growth. To enable this, we have zero tolerance for any discrimination and harassment based on the above considerations. "

Responsibilities:  Design, develop, and maintain automated test
frameworks and scripts for chat interface applications
 utilizing LLMs, ensuring comprehensive coverage of
all functionalities and user scenarios.
 Understand Retrieval Augmented Generation(RAG)
strategy to improve testing for knowledge-
 intensive tasks by retrieving relevant documents or
data that can be used as references or benchmarks
 for evaluating the LLM's responses
 Evaluate chat interactions for adherence to
conversational design principles, ensuring responses
are
 accurate, relevant, and delivered within acceptable
time frames.
 Perform thorough regression testing when bugs are
resolved and when there are updates to LLMs or
 application features.
 Collaborate with development teams to understand
application features and integration points for
 Large Language Models, identifying potential areas
for automation.
 Execute automated and manual test cases, analyze
test results, identify and document defects, and
 work closely with developers to ensure they are
addressed promptly.
 Monitor the performance of LLMs in the chat
interface, identifying any issues with latency,
accuracy,
 or relevance of responses.
 Stay up-to-date with the latest developments in AI,
machine learning, and chatbot technologies to
 continually improve testing strategies and tools.
 Collaborate with product managers and UX designers
to ensure the chat application meets the highest
 standards of user satisfaction and engagement.
 Ensure compliance with data privacy and security
policies during the testing process, especially when
 handling sensitive user data.
 Provide detailed reports and documentation on test
activities, results, insights, and recommendations
 for improving the application& quality and

performance.
 Tools Exposure Expected:.

Mandatory skill sets: Python, Machine Learning, Prompt Engineering, Java-

Selenium, Python Robot Framework  

Preferred skill sets: LLM, Data Processing, SQL, Azure, CI/CD, Jira

Years of experience required: 4 to 7 years  

Education qualification: B.E/B.Tech

Education (if blank, degree and/or field of study not specified)

Degrees/Field of Study required: Bachelor of EngineeringDegrees/Field of Study preferred:

Certifications (if blank, certifications not specified)

Required Skills

Python (Programming Language)

Optional Skills

Desired Languages (If blank, desired languages not specified)

Travel Requirements

Available for Work Visa Sponsorship?

Government Clearance Required?

Job Posting End Date