Data Engineer

Location: Remote (California)

ABOUT THIS FEATURED OPPORTUNITY

We are seeking a Junior Data Engineer to support a confidential project within the Health sector. This role will focus on modernizing data pipelines, optimizing metric computation, and enabling scalable analytics through cloud-based solutions.

THE OPPORTUNITY FOR YOU

Airflow pipeline overhaul

• Build out of Athena Operator support for Airflow jobs
• Custom SQL hidden in QuickSight moved under source control
• Compute moved to AWS Athena where possible
• Correct operators used for Python jobs
• Rebuild of Airflow testing process to remove need for separate Airflow testing for query-only updates

Metric job optimization

• AI-driven scan of code to look for improvement opportunities
• Investigation of whether and when to use Spark

Automated metrics extraction

• AI-based sweep of code to build text-based metrics descriptors
• Generation of v1 metrics catalog pulling from metric descriptors

KEY SUCCESS FACTORS (Top 3 Must-Have Skills)

1. 3+ years experience as a Data Engineer supporting complex enviroments
2. Hands on experience with AWS services, specifically Athena and managed Airlfow for using Python, plus familiarity with Github, and Apache Spark
3. Strong programming skills in SQL, Python and Pandas for writing code

NICE TO HAVES

1. Experience with CI/CD tools such as Concourse CI or similar pipelines
2. Familiarity with AWS Glue
3. Experience with medical care delivery data

About INSPYR Solutions

Technology is our focus and quality is our commitment. As a national expert in delivering flexible technology and talent solutions, we strategically align industry and technical expertise with our clients’ business objectives and cultural needs. Our solutions are tailored to each client and include a wide variety of professional services, project, and talent solutions. By always striving for excellence and focusing on the human aspect of our business, we work seamlessly with our talent and clients to match the right solutions to the right opportunities. Learn more about us at inspyrsolutions.com.

INSPYR Solutions provides Equal Employment Opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, or genetics. In addition to federal law requirements, INSPYR Solutions complies with applicable state and local laws governing nondiscrimination in employment in every location in which the company has facilities.

Information collected and processed through your application with INSPYR Solutions (including any job applications you choose to submit) is subject to INSPYR Solutions’ Privacy Policy and INSPYR Solutions’ AI and Automated Employment Decision Tool Policy: https://www.inspyrsolutions.com/policies/. By submitting an application, you are consenting to being contacted by INSPYR Solutions through phone, email, or text.

26-156647