Responsible for designing and building data pipelines.
Designing and implementing solutions and developing applications utilizing airflow, dataflow, Apache beam, snowflake or GCP components.
Reading, extracting, transforming, staging, and loading data to multiple targets, using Hadoop, Hive, Snowflake, BigQuery, and Cloud Storage.
Migrating existing data processing from standalone or legacy technology scripts to distributed framework processing.
Working with gigabytes/terabytes of data and dealing with the challenges of transforming and enriching such large datasets.
Utilizing Google Cloud Platform and strong big data technology foundation
Designing and Architecting data model to modernize legacy data warehouses.
Writing ELT jobs using DBT to maintain data lineage and data auditability.
Designing architecture of CI/CD pipelines to perform continuous build and isolate multiple environments.
Experience/Qualifications
Master’s or foreign academic equivalent in Business Analytics, Computer Science, Statistics, Data Science or any related field plus one (1) year of experience. Location: Northridge, CA, telecommuting permitted, HQ in Naperville, IL. Approx. 25% domestic travel required. Travel Expenses to be paid by employer. One year of experience with Hadoop, Spark, Pig, Hive, Snowflake, BigQuery, Kubernetes, and Dataflow required.
SALARY: $116,334 per yearBENEFITS: Medical Insurance, Dental, Life Insurance, Paid Time Off, 401(k)WHERE TO APPLY: SpringML, Inc. dba Egen Solutions, 40 Shuman Blvd, Suite 204, Naperville, IL;Email: hr@egen.ai EEO and Accommodations: Egen is an equal opportunity employer and is committed to inclusion, diversity, and equity in the workplace. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability status, protected veterans’ status, or any other characteristic protected by federal, state, or local laws. Egen will also consider qualified applications with criminal histories, consistent with legal requirements. Egen welcomes and encourages applications from individuals with disabilities. Reasonable accommodations are available for candidates during all aspects of the selection process. Please advise the talent acquisition team if you require accommodations during the interview process.
