Azure Databricks Engineer in Raleigh, NC -Locals Only

Roles and Responsibilities:

• Research and engineer repeatable and resilient ETL workflows using Databricks notebooks and Delta Live Tables for both batch and stream processing
• Collaborate with business users to develop data products that align with business domain expectations
• Work with DBAs to ingest data from cloud and on-prem transactional databases
• Contribute to the development of the Data Architecture for NC DIT – Transportation:
• By following practices for keeping sensitive data secure
• By streamlining the development of data products for use by data analysts and data scientists
• By developing and maintaining documentation for data engineering processes
• By ensuring data quality through testing and validation
• By sharing insights and experiences with stakeholders and engineers throughout DIT – Transportation