Lead Data Engineer (Onsite)

Job Description:

What we are looking for: 

Need local candidates to Minnesota for this position

Linked profile should be old with solid connections and match with resume

Dev Engineer capabilities (this is the core of the role)
App dev experience (scripting, especially in python)
Expert in AI or Automation (this would be a huge plus)
Skills

·         10+ years of experience with lead experience

·         Proficient in data manipulation and pipeline development

·         Experience processing large datasets in a distributed environment

·         Hands-on experience with Databricks notebooks, workflows, and cluster management

·         Moderate hands-on experience with S3, Lambda, Glue, and EC2

·         Experience scheduling and automating pipelines

·         Strong SQL skills for complex data extraction and transformation queries

·         Comfortable with version control in a collaborative, shared-repo environment

·         Comfortable creating and managing issues and epics

Summary

·         Modernize data pipeline from SAS to Python/PySpark on Databricks.

·         This Data Engineer will own and evolve our critical HEDIS data pipeline.

·         HEDIS data is delivered to our analytics vendor and used to measure BCBS’s performance across key dimensions of care.

·         This role will initially partner with SMEs during a knowledge transfer period.   

·         They will eventually take on pipeline ownership.

Thanks & Regards,

Sean Martin | IT Technical Recruiter

SOVEREIGN TECHNOLOGIES LLC
Desk Number: (636)-410-0680 Ext 3                                                                      

Direct Number: (636)-352-2277

Email: sean@sovereigntec.com

LinkedIn: www.linkedin.com/in/sean-martin-b4a136249