Data Engineer Level 3
Remote candidates will be considered
Job Description
Must Top 3 Skills: Data Manipulation(DBX, Spark, Sql)
Current team is small, project is large and there is lots of data acquisition, understand and modeling needed to help get data from source systems into the Supply Chain Data Estate(lake). Team is leveraging all Cloud based tools in Azure today.
Key Responsibilities
Create and leverage Databricks notebooks to source, shape and store data using SQL, Python, PySpark
Utilize enterprise standards for data domains and data solutions, focusing on simplified integration and streamlined operational and analytical uses
Ensure there is clarity between ongoing projects, escalating when necessary, including direct collaboration with 84.51
Define high-level migration plans to address the gaps between the current and future state
Analyze technology environments to detect critical deficiencies and recommend solutions for improvement
Promote the reuse of data assets, including the management of the data catalog for reference
