Please share resume only at swati.b@kksoftwareassociates.com
Job Title:AZURE Data Engineer With ETL/ELT
Location: Boston, MA ONSITE
Experience (Years):8-10
Job Description:
Must have at least 8+ years of extensive Data Engineering Experience in Databricks, ETL/ELT using Data pipelines, SQL/Procedure experience.? Must have 8+ Years of hands-on development proficiency in implementing Databricks solutions using Scala and Spark with Data frames and Notebooks/SQL? Must have 8+ Years of hands-on development and performance tuning/enhancement experience in Scala/PySpark and SQL.? Must have 8+ Years of hands-on development experience in working on Azure Cloud.? Must have strong experience with Databricks, including developing and optimizing Spark jobs, data transformations, and data processing workflows. ? Must have experience and a good understanding on the below topics ? Databricks Delta Lake storage? Unity Catalog? Autoloader ? Lakehouse Architecture? Medallion Architecture? Databricks Serverless Options.? Dataset and Data frame? Databricks Clusters Configuration and Sizing? Databricks Job Orchestration? Spark Structured Streaming ? Must have experience with complex and large volume data streaming and data transformations using Azure Databricks.? Must have extensive experience in Datawarehouse/Data Lakehouse implementations.? Must have experience with monitoring, debugging, and resolving issues in live Databricks jobs.? Must have strong hands-on expertise in troubleshooting DevOps pipelines, Azure, and AKS services? The candidate should be able to provide Data Ingestion, Streaming and Transformations solutions and do development work.? Experience in Apache Big Data implementations with programming proficiency like PySpark, R or Java prior to Databricks is advantageous.? Good to have experience with containerization technologies such as Docker and Kubernetes.? Strong critical thinking, communication, and problem-solving skills is essential.
Competencies: Snowflake, Digital : Databricks
Essential Skills: Data Engineer, Databricks, Pyspark, Scala, SQL Azure
Thanks & Regards,
Swati bhardwaj
KK Associates LLC.
8751 Collin McKinney Pkwy, # 1302, McKinney, TX 75070
555 Metro Place North, Suite # 100, Dublin, OH 43017
Direct: (469) 545-1508
—
You received this message because you are subscribed to the Google Groups “C2C requirementsagar” group.
To unsubscribe from this group and stop receiving emails from it, send an email to c2c-requirementsagar+unsubscribe@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/c2c-requirementsagar/CAEo1WJxffST327Y0Rnv4_VOu2XZiDNGs8%2Bht1tUG0G6uF7SMUQ%40mail.gmail.com.