Who we are looking for

We are looking for a Data engineer for Cloud Data Lake activities. The candidate should have industry experience (preferably in Financial Services) in supporting enterprise applications, and exposure to Cloud based Data engineering platforms. This hands-on role will partner with senior-level development managers, architects and business leadership to develop and execute the technology product roadmap in driving Data Governance policy implementation.

The candidate should have industry experience (preferably in Financial Services) in supporting enterprise applications and exposure to Cloud based engineering platforms.

What you will be responsible for

• Collaborate with cross-functional teams to understand project requirements, user stories and translate them into functional, technical requirements.
• Document requirements for manual and automated testing of AWS-based applications, Databricks, and ETL backend systems using Java, Selenium.
• Design, develop, and maintain automated test scripts to ensure efficient regression testing and maximum test coverage.
• Execute performance testing to evaluate system scalability, reliability, and efficiency.
• Hands on experience analyzing, documenting Business Requirements document, Functional requirement document, Data flows , Business rules, data mapping, use cases and Traceability Matrix.
• Ability to translate business to functional/technical requirements, with experience in Data Analysis, Data mapping, Requirements gathering, Data Visualization
• Responsible for building out intuitive data visualization dashboard/reports. Discover and analyze data insights using visualization tools.
• Seek opportunities to improve efficiency and scalability for the current system in use in terms of data structure and process improvement.

What we value

These skills will help you succeed in this role

• Strong skill-set, experience in Python, Scala/PySpark, PL/SQL, PERL/scripting .

• Skilled Data Engineer for Cloud Data Lake activities. The candidate should have industry experience (preferably in Financial Services) in navigating enterprise Cloud applications using distributed computing frameworks as Apache Spark, Hadoop, Hive.

• Working knowledgeoptimizing database performance, scalability, ensuring data security and compliance.

Education & Preferred Qualifications

• Bachelor’s/Master's Degree in a Computer Science, Engineering or Math or equivalent experience

• 8+ years' experience in professional software design and development.

• Strong analytical skills, with ability to collect, absorb, and analyze information quickly and independently

• Proven ability to develop and work with cross functional processes and project timelines

• Excellent follow-through, attention to detail and time management skills                                               

• Adapt and excel at managing multiple simultaneous tasks in a high pressure, deadline environment.

State Street's Speak Up Line