LEAD Data Engineer Location: Plano, TX
Hi,
Currently, I am recruiting candidates for one of my requirements as mentioned below. If you have a matching profile, please send me the updated resume along with contact details at the earliest.
Job Title: LEAD Data Engineer
Project Location: Plano, TX – Hybrid 2-3 days onsite per week
Duration: 6+ Months
Only USC
LinkedIn Required
Must have Lead Experience
Job Details
REQUIRED SKILLS
| · Python · SQL · Cloud experience |
Job description
Responsibilities:
· Design, develop and operationalize data pipelines for batch, streaming and event-based processing
· Create and review conceptual, logical, and physical data models for transactional and analytical use cases
· Design and implement data processes to support DW, ODS, Data Lake, Lakehouse architectural patterns
· Use open-source and proprietary technologies on the cloud to solve for common data engineering problems
· Perform data analysis to solve for complex and unique business problems
· Evaluate data quality for existing use cases and implement improvements
· Conduct quality assurance (QA) to ensure reliability and accuracy of solutions before production releases
· Troubleshoot and resolve production issues related to the data platform in a timely manner
· Adapt and stay agile in high-paced value-add driven environment
· Provide technical support to junior engineers collaborating on your project
Business Knowledge / Technical Skills:
· Data Structures & Algorithms
· Experience with database solutions (OLAP and OLTP)
· Knowledge of web application deployment processes and application architecture
· Ability to establish and follow SDLC
· Proficiency in cloud technologies (Azure, AWS, or GCP) and their data-related services
· Understanding of Horizontal and Vertical scaling
· Some experience with IAC (Infrastructure as Code), ARM templates, Bicep, Terraform or AWS CloudFormation is a plus
· Excellent interpersonal and communication skills with the ability to work effectively across all levels of the organization
· Working knowledge of project management fundamentals, including agile and continuous improvement methodologies
· Experience with cloud cost optimization
· Knowledge of modern technology platforms, tools, and techniques (i.e., Cloud, Machine Learning, IoT/IIoT, etc.)
· Understanding and experience with data security best practices (encryption, tokenization, masking)
· Basic knowledge of regulatory and compliance policies for data management (CCPA, GDPR, PCI, PII, HIPPA etc.)
· Error catching and handling in batch and streaming
· Proficient in one of the following languages: Python, C#, Java, JavaScript
· Proficient in SQL
· Experience with warehousing solutions like: Snowflake, BigQuery, Redshift, Synapse
· Proficiency in effective code management, collaboration, and version control: GIT
· Adequate level of knowledge and experience with some of the following: API, YAML, Kafka, Airflow, JSON, AVRO, Parquet
Professional Experience & Education:
· STEM, Finance, or Economics degree preferred
· Relevant certification from Azure, AWS, GCP, IBM
· Cross industry exposure and experience preferred
Other Requirements:
· 4+ years of professional experience
· Willingness to work in ET time zones if required
· Comfortable working from various locations including office or at home (may be remote to start, then hybrid)
Kulwinder Singh // Sr. Technical Recruiter
Office: 4132402192
Email: Kulwindersingh@inspireclient.com