Hiring || AWS Databricks Engineer || Boston MA (Onsite)

Hey Partners

Hope you are doing well!!

This is Rajat and I represent LanceSoft ,a leading IT staffing organization. I am part of a team responsible for servicing the major clients of ours that are the world leaders in providing their specific services/solutions.

Position: AWS Databricks Engineer

Location: Boston MA (Onsite)

Job description:

We are seeking an experienced AWS Databricks Engineer to join our data engineering team. The ideal candidate will be responsible for designing, developing, and optimizing big data solutions using Databricks on AWS. You will work closely with data scientists, analysts, and stakeholders to build scalable and efficient data pipelines.

Responsibilities:

• Develop and maintain ETL/ELT pipelines using PySpark on Databricks.
• Integrate Databricks with AWS services (S3, Glue, Lambda, etc.).
• Optimize data workflows for performance and cost-efficiency.
• Collaborate with cross-functional teams to understand data needs.
• Ensure data quality, security, and governance best practices.

Required Skills:

• 3+ years of experience with Databricks and PySpark.
• Strong experience with AWS services (S3, IAM, Glue, Lambda, etc.).
• Proficient in SQL and data modeling.
• Familiarity with CI/CD pipelines and version control (Git).
• Experience with Delta Lake and performance tuning in Databricks.

Preferred:

• Experience in real-time data streaming (Kafka, Kinesis).
• Databricks certification is a plus.