Hello
Greeting from E-IT
Role: Data Engineer – Azure Databricks Specialist
Location: Durham NC 27713 (100% Onsite Role)
Contract
Job Summary:
We are seeking a highly skilled Data Engineer with deep expertise in Databricks to join our Data & Technology Services team. This role will focus on building scalable data solutions to support clinical research operations, leveraging the Azure ecosystem and Databricks platform. The ideal candidate will have strong experience in ETL development, cloud infrastructure, and data governance within a regulated environment.
Key Responsibilities:
- Design and develop scalable data pipelines using Databricks and Apache Spark.
- Integrate and orchestrate data workflows using Azure Data Factory (ADF) and Azure Functions.
- Build and maintain data solutions using Microsoft SQL Server, Cosmos DB, and Azure Data Lake.
- Lead a team of data engineers, providing technical guidance and mentoring.
- Deploy and manage cloud infrastructure in Azure, ensuring performance and security.
- Implement data governance and master data management practices to ensure data quality and compliance.
- Collaborate with cross-functional teams including clinical operations, biostatistics, and IT.
Required Qualifications:
- 5+ years of experience in ETL Data Engineering.
- 3+ years of hands-on experience with Databricks and Apache Spark.
- 2+ years of experience with Azure Data Factory, Azure Functions, and Azure App Services.
- 4+ years of experience with Microsoft SQL Server, Oracle, and Azure Data Lake.
- 2+ years of experience deploying infrastructure to cloud environments (preferably Azure).
- 4+ years of experience leading engineering teams.
- 2+ years of experience in data governance and master data management.
- Experience with GitHub Actions, Jenkins, and CI/CD pipelines.
Nice to Have:
- Proficiency in Python for scripting and automation.
- Familiarity with Agile methodologies and DevOps practices.
- Strong understanding of clinical data standards and regulatory requirements in the CRO/pharmaceutical industry.
Best Regards,
Abdul Mazeed – Senior Executive
E-IT Professionals Canada Inc. – 380 Wellington St, Tower B, Ste 603, London ON N6A 5B5, Canada
E-IT Professionals USA Inc – 17199 N Laurel Park Dr. Ste 402, Livonia, MI 48152
Direct: (734) 619-7601 | Abdul@eitprofessionals.com
www.eitprofessionals.com