Source description
About the role
Job Title: Data Engineer (PL/SQL, Python, Spark, Hadoop & ETL) Experience: 6 and above Location: Chennai Job Summary :-We are looking for a skilled Data Engineer with strong expertise in PL/SQL, Python, Apache Spark, Hadoop, and ETL tools to join our data engineering team. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines, optimizing large-scale data processing, and ensuring high-quality data integration across enterprise systems. The role requires hands-on experience with big data technologies, ETL development, and database programming. Key Responsibilities - Design, develop, and maintain scalable ETL/ELT pipelines for processing large volumes of structured and unstructured data. - Develop and optimize complex PL/SQL procedures, functions, packages, and SQL queries. - Build data processing applications using Python and Apache Spark (PySpark). - Develop and maintain big data solutions using the Hadoop ecosystem. - Design, implement, and optimize ETL workflows using enterprise ETL tools. - Perform data extraction, transformation, validation, and loading from multiple source systems. - Analyze and resolve data quality issues, performance bottlenecks, and data gaps. - Optimize batch processing jobs and improve overall system performance. - Collaborate with data architects, business analysts, and application teams to understand business requirements. - Ensure data accuracy, consistency, security, and compliance with organizational standards. - Prepare technical documentation and support production deployments. Required Technical Skills - Solid expertise in PL/SQL and SQL performance tuning. - Hands-on experience with Python for data engineering and automation. - Strong knowledge of Apache Spark (PySpark). - Experience working with the Hadoop ecosystem (HDFS, Hive, MapReduce, or YARN). - Experience with ETL tools such as Informatica, Talend, DataStage, SSIS, Apache NiFi, AWS Glue, or Matillion. - Good understanding of data warehousing concepts and dimensional modeling. - Experience working with relational databases such as Oracle, PostgreSQL, SQL Server, or MySQL. - Strong analytical and problem-solving skills. .
More at Cognizant