Urgent hiring- Azure Data Engineer II Cincinnati, OH- Locals (Hybrid)

Hi,

Hope you are doing great.

Please find the requirement below, if you are comfortable send me your updated resume along with

Position: Data Engineer
Location: Cincinnati, OH– Locals

GC/USC

We are seeking a skilled Data Engineer to join our team and play a critical role in designing, building, and maintaining robust data pipelines and infrastructure. This role requires hands-on expertise in Databricks, Python, PySpark, Azure, and ETL processes. The successful candidate will work closely with cross-functional teams to gather requirements, implement scalable data solutions, and support our data-driven initiatives.

Key Responsibilities:

·  Develop and optimize ETL processes to extract, transform, and load data from various sources into data lakes and data warehouses.

·  Data Pipeline Development: Design, develop, and maintain robust data pipelines using Databricks to process and transform large volumes of data.

·  ETL Process Management: Implement ETL (Extract, Transform, Load) processes to integrate data from various sources into Databricks, ensuring data quality and integrity.

·  Data Integration: Integrate Databricks with other data storage solutions and data lakes, ensuring seamless data flow and accessibility.

·  Utilize Databricks, Python, and PySpark to design and build scalable data pipelines for processing and analyzing large datasets.

·  Ensure data accuracy, consistency, and integrity through effective data validation, quality checks, and error handling.

·  Optimize performance and scalability of ETL jobs, data flows, and data storage environments.

·  Monitor data pipelines and workflows, troubleshoot issues, and implement improvements to enhance reliability and efficiency.

·  Document data engineering processes, architecture, and data lineage.

·   

Key Skills & Qualifications:

·  Proven experience as a Data Engineer with strong knowledge of ETL processes and data warehousing concepts.

·  Strong hands-on experience with Databricks for big data processing and analytics.

·  Proficiency in Python and PySpark for data transformation and processing.

·  Strong expertise in Azure data services

·  Strong problem-solving skills and the ability to work in a fast-paced environment.

Nice to Have:

·  Experience with Jupyter Notebook