Hadoop Administrator

Number of Openings* 1 Approved ECMS RQ# * 530226 Duration of contract* 2 years Total Yrs. of Experience* 6+years Relevant Yrs. of experience* 5+years Detailed JD (Roles and Responsibilities) Proficiency in Hadoop core components, including HDFS , MapReduce, and YARN Set up, configure, and manage Hadoop clusters using tools like Ambari, Cloudera Manager, or manual configurations Knowledge of distributed computing principles and the ability to design and implement distributed algorithms and data processing workflows. Proficiency in programming languages commonly used in the Hadoop ecosystem, such as Java, Scala, Python and scripting Optimizing Hadoop cluster for performance and scalability. Troubleshooting and resolving performance bottlenecks Experience with monitoring tools like Grafana or Ambari Metrics Familiarity with log analysis tools to identify and address issues Understanding of cluster security, including authentication and authorization mechanisms Proficiency in scripting languages (e.g., Shell, Python) for automation of cluster management tasks Knowledge of deploying Hadoop clusters and Big Data Ecosystem components Knowledge of data compression techniques for efficient storage and retrieval Participate in on-call rotations to respond to incidents and outages promptly Conduct post-incident reviews (PIRs) to identify root causes and prevent future incidents Experience with setting up CI/CD pipelines and maintaing dev-ops set up for Big Data Platform Design, build, and maintain a robust and scalable big data platform that can handle large volumes of data from various sources skills Hadoop,Hive, Spark,Ambari, Grafana, SQL, Nifi, Iceberg,Druid, Oozie, Airflow, Hbase, Linux/OS Services and server administration and shell scripting Cloudera/Hortonworks/Hadoop Admistror cerifcation preferred Domain* Manufacturing vendor billing rate* (INR/day) 8700 INR/day Work Location* Any location (Bangalore is preferable) Background check process to be followed: * Before onboarding / After onboarding: * BGV Agency: * Before Mode of Interview: Telephonic/Face to Face/Skype Interview* Skype