Source description
About the role
Role:Hadoop Architect
Location:Remote Duration:12 Months
Qualifications
Hadoop Environment is current Looking to build out Hadoop- (clusters, installing services, tools, making sure secure for onboarding) 5-7 years t be able to do the job System integration more python than Java build out services to sit on Hadoop site, capture automation, data management, leveraging capabilities, Python/Java Atlas, ranger, Elk, rest API Need Cloud Exp - google Cloud (preferred) and Azure, Cloudera Data Services Strong Python and Hadoop programming exp .7+ years of Big Data Platform (data lake) and data warehouse engineering .Very strong Python and other functional programming skills .5+ years of experience with Hadoop stack: HDFS, Hive, SQL, Spark, Spark Streaming, Spark SQL, HBase, Kafka, Sqoop, Atlas, Flink, Kafka, Cloudera Manager, Airflow, Impala, Hive, HBase, Tez, Hue, and a variety of source data connectors. .Hands-on experience designing and building microservices, APIs and, MySQL .Hands-on experience with building modern, resilient, and secure data pipelines, including movement, collection, integration, transformation of structured/unstructured data with built-in automated data controls, .Hands-on experience creating/managing Time-Series data from full data snapshots or incremental data changes
Bhargavi Ankam IT Recruiter Staffing | Thoughtwave Software and Solutions Limited 6306891366 bhargavi@thoughtwavesoft.com www.thoughtwavesoft.com 314 N. Lake St, Suite 6, Aurora IL 60506
More at Thoughtwave Software and Solutions