Need :: Azure Data Bricks || Senior/Lead/Architect (3 different positions) @ Warren, NJ – Onsite

Hello Team,

Job Description: 

Job Title: Azure Data Bricks Senior/Lead/Architect (3 different positions)

Location: Warren, NJ – Onsite

Type: Contract

Requirements and Skills:

• 10+ years’ experience as a Data Engineer with experience in building ETL/Data pipelines with cloud technologies
• 4+ years extensive experience in designing, developing, and implementing scalable data pipelines using Databricks to ingest, transform, and store structured and unstructured data
• 5+ years’ experience with programming languages such as Python/PySpark and query languages like SQL
• 5+ years’ experience in building metadata-driven data ingestion pipelines using ADF (Azure Data Factory)
• 5+ years’ experience in analyzing, optimizing, and tuning existing data pipelines for performance, reliability, and efficiency
• 2+ years’ experience in implementing MLOps practices to streamline the deployment and management of machine learning models
• 2+ years’ experience using Apache Airflow for job orchestration and workflow management
• Familiarity with CI/CD tools and practices for automating the deployment of data engineering solutions
• Experience in collaborating with data scientists, analysts, and other stakeholders to understand business requirements and translate them into technical solutions
• Knowledge/Experience in implementing security measures and standard processes to ensure data privacy and compliance with regulatory standards
• In-depth knowledge of data engineering concepts, ETL processes, and data architecture principles

Best regards,

Daud Khan (David)

Aroha Technologies
+1 (510)-400-4162

Let’s connect – LinkedIn

5000 Hopyard RD, Suite 415
Pleasanton, CA 94568