Big Data Engineer

Bangalore Opening: 21-Feb-2023 Skills Required: Big Data, SQL, Java, ETL, NiFi, PySpark, Unix shell, Hive, Spark, Ansible, shell scripts, Pig, Go Experience Required: Must have 3 Years + Experience in relevant field Educational Qualification: BSc in Computer Science, Engineering or Relevant field ,MCA or BCA Employment Type: Full Time Workplace Options: Onsite Opening Summary We are seeking a talented and experienced Big Data Engineer with a passion for data management and analytics to join our team. The ideal candidate will have 4+ years of relevant experience with SQL, Hive, Spark and basic Unix shell scripting skills. The candidate must be familiar with ETL (Extract, Transform, Load) processes and be able to work with large data sets. Requirements 4+ years of relevant experience in big data engineering Strong proficiency in SQL, Hive, Spark and basic Unix shell scripting Solid understanding of ETL processes Experience working with large data sets Familiarity with data modeling and data warehousing concepts Excellent problem-solving skills and attention to detail Strong communication skills and ability to work in a team environment Responsibilities Develop and maintain scalable and high-performance big data solutions Design, develop and implement ETL processes Perform data analysis and data profiling to ensure data quality and integrity Collaborate with cross-functional teams including data scientists, business analysts, and product Managers to identify and solve complex business problems Develop and maintain documentation, including technical specifications and user guides Conduct code reviews and mentor junior team members Preferred Qualification Experience with Pig, Java, Go, NiFi and PySpark Worked on AMEX projects or experience in FSS domain Knowledge of distributed computing, Hadoop ecosystem, and NoSQL databases Notes If you are passionate about big data and are looking for a challenging and rewarding opportunity, we encourage you to apply for this position.