Hadoop Administrator – Alpharetta, GA (Locals Only)- NO RELOCATION

Description and Requirements:

• Expert in setting up Hadoop cluster from scratch and server maintenance.
• Commissioning and decommissioning of the nodes to/from Hadoop cluster.
• Implementing, managing, and administering the overall Hadoop infrastructure.
• Capacity planning and estimating the requirements for lowering or increasing the capacity of the Hadoop cluster.
• Monitoring the Hadoop cluster connectivity and performance of the cluster for application teams.
• Replicating huge amount data from one Hadoop cluster to another.
• Applying encryption to secure the data in the Hadoop cluster.
• Applying the configuration changes and testing the cluster in collaboration with the application teams and business users.
• Sound knowledge of Hadoop services – HDFS, Hive, HBase, Impala, Hue, Ranger etc.
• Experience with Cloudera CDP Hadoop upgrade.
• Experience with access management and setting up user roles in Hadoop.
• Able to create and debug complex Unix shell scripts.

Nice to have:

• Analyzing and troubleshooting the issues with the clusters.
• Set up and maintain appropriate infrastructure to maintain performance and data integrity.
• Experience with ELK Stack: Elasticsearch, Logstash, Kibana, Apache Hadoop
• Ensuring appropriate monitoring & alerting of the Elasticsearch cluster.
• Expert in networking and security settings to support network-related pipelines.
• Good to have Ruby and/or Python, Unix and GIT Knowledge.