Get C2C/W2 Jobs & hotlist update

Data Engineer || Austin, TX- Onsite

Hello,

 

Hope you are doing good…!

This is Divya from Siri Info Solutions. I have some urgent requirements with one of my clients. Please go through the Job Description and let me know your interest. In case you are not interested, it will be nice to let your friends/colleagues know of this position who may be a potential.

 

h1b & TN with PP no. 

COMPLETE JOB DESCRIPTION IS BELOW FOR YOUR REVIEW:

Job Title: Data Engineer

Location: Austin, TX- Onsite

Hire Type: Contract

 

Job Description

Create and maintain scalable data pipelines and workflows to ingest, transform, and load data into Apache Iceberg tables using Apache Spark, Python, PySpark

Write SQL queries using Spark and Trino, optimize and remove performance bottlenecks for query response and resource utilization

Develop and execute migration strategies and scripts to move data from Snowflake to Iceberg tables, ensuring data integrity and consistency

Write reliable and maintainable code, debug complex issues in large-scale distributed systems, document, participate in code reviews, and mentor other engineers

 

Minimum Qualifications

3+ years of experience in Data Lake Architectures, data warehousing technologies and data engineering.

Strong understanding of Apache Iceberg, including schema evolution, partition management, and data versioning

Proficient in Apache Spark, PySpark and other big data processing frameworks like Presto or Trino, Flink

Proficient in Snowflake Database and Architecture, SQL development and data modeling

Experience with cloud platforms and technologies like EMR, AWS IAM, AWS S3, including object storage services and compute services

Hands-on experience of working with Git, Jupyter notebooks, Splunk and Sandbox environments

Exceptional communication and collaboration skills, with the ability to work effectively across multiple teams and functions.

 

 

Regards

Divya Pandey

LinkedIn: linkedin.com/in/divya-pandey-5345ba218

Mail Id: Divya.Pandey@siriinfo.com


You received this message because you are subscribed to the Google Groups “Divya Pandey” group.
To unsubscribe from this group and stop receiving emails from it, send an email to divya-pandey+unsubscribe@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/divya-pandey/7aad0880-2f8c-4900-8ba1-3972c20f8c22n%40googlegroups.com.

Leave a Reply

Your email address will not be published. Required fields are marked *