Data Platform/Hadoop Administrator

As a Hadoop Administrator, your responsibilities will include: - Installing, configuring, upgrading, backing up and recovering Hadoop systems - Commissioning and decommissioning data nodes - Setting up and monitoring cluster performance - Ensuring the health of the cluster is maintained You should have strong experience in: - Configuring Hadoop ecosystem tools such as Pig, Hive, Hbase, Sqoop, Flume, Kafka, Oozie, Zookeeper, Atlas, Nifi - Understanding HDF and designing/implementing enterprise platforms like Hadoop Data lake and Huge Data warehouses - Using data governance tools like Atlas - Understanding Hadoop architecture and MapReduce framework - Optimizing configurations for Map Reduce, Pig, and Hive jobs - Transferring data between HDFS and Relational Database with Sqoop - Configuring monitoring tools like Kibana and Grafana - Managing cluster maintenance, bug fixing, and troubleshooting - Commissioning, decommissioning, balancing, and managing nodes for optimal cluster performance - Setting up automatic failover control and manual failover control using Zookeeper and quorum journal nodes - Implementing and managing Secure Authentication and Authorization using Kerberos and Rangers - Setting up Linux environments, Password less SSH, creating file systems, disabling firewalls, and configuring swappiness and SELinux - Scheduling jobs using Oozie - Monitoring and troubleshooting Linux memory, CPU, OS, storage, and network issues - Setting up, configuring, and managing security for Hadoop clusters using Kerberos and integrating with LDAP/AD at an Enterprise level - Bench marking Hadoop/HBase cluster file systems for various batch jobs and workloads - Understanding databases like Mysql, Oracle, and PostgreSQL - Having customer service experience and a strong customer focus Additionally, cloud skills and CDP Certification would be beneficial for this role. As a Hadoop Administrator, your responsibilities will include: - Installing, configuring, upgrading, backing up and recovering Hadoop systems - Commissioning and decommissioning data nodes - Setting up and monitoring cluster performance - Ensuring the health of the cluster is maintained You should have strong experience in: - Configuring Hadoop ecosystem tools such as Pig, Hive, Hbase, Sqoop, Flume, Kafka, Oozie, Zookeeper, Atlas, Nifi - Understanding HDF and designing/implementing enterprise platforms like Hadoop Data lake and Huge Data warehouses - Using data governance tools like Atlas - Understanding Hadoop architecture and MapReduce framework - Optimizing configurations for Map Reduce, Pig, and Hive jobs - Transferring data between HDFS and Relational Database with Sqoop - Configuring monitoring tools like Kibana and Grafana - Managing cluster maintenance, bug fixing, and troubleshooting - Commissioning, decommissioning, balancing, and managing nodes for optimal cluster performance - Setting up automatic failover control and manual failover control using Zookeeper and quorum journal nodes - Implementing and managing Secure Authentication and Authorization using Kerberos and Rangers - Setting up Linux environments, Password less SSH, creating file systems, disabling firewalls, and configuring swappiness and SELinux - Scheduling jobs using Oozie - Monitoring and troubleshooting Linux memory, CPU, OS, storage, and network issues - Setting up, configuring, and managing security for Hadoop clusters using Kerberos and integrating with LDAP/AD at an Enterprise level - Bench marking Hadoop/HBase cluster file systems for various batch jobs and workloads - Understanding databases like Mysql, Oracle, and PostgreSQL - Having customer service experience and a strong customer focus Additionally, cloud skills and CDP Certification would be beneficial for this role.