Source description
About the role
-Part of database engineering team – devops engineer w/ Hadoop background -Manage and support cloudera Hadoop environment -Currently have 2 datacenter deployments of Hadoop clusters -Building 3rd cluster in 3rd datacenter -Supporting critical business application – data warehousing application that is not client facing but very important to backend processes -The application itself has a huge amount of data, need to make sure data is properly migrated to new cluster – not a straight migration, some in place upgrades will take place -Also Hadoop environment is to be upgraded soon from CDH to CDP platform, this will be a major effort along with the data migration. -team size: work with team of engineers, 5 ppl on team, this will be the additional resource and solely focus on this project Skillset looking for: hands on exp with Hadoop (ideally cloudera flavor) and the associated services: hdfs, support of impala service, hive, and Apache Kudu SQL DB In addition to that knowledge, looking for someone with devops skillset since they are doing a lot of automation. So familiarity with devops tooling and release process will be ideal IV process: 2 round interview process: - Initial round to get general knowledge of candidates background, profiles, and personality - Second round will be more technically focused
More at Thoughtwave Software and Solutions