Source description
About the role
Job Summary We are seeking a skilled and motivated Data Engineer with 3 6 years of experience in designing, developing, and maintaining large-scale data processing solutions. The ideal candidate should have strong expertise in Oracle, Python, Hive, and Linux environments, with hands-on experience in ETL development, data warehousing, and data pipeline optimization. Exposure to AWS services such as Lambda, OpenSearch, and S3 will be an added advantage. Key Responsibilities Design, develop, and maintain robust and scalable data pipelines for batch and near real time data processing. Develop and optimize ETL/ELT processes using Python and SQL/Hive/Elastic. Develop and maintain Hive-based data solutions in Hadoop ecosystems. Analyze, troubleshoot, and resolve data quality and performance issues. Write efficient shell scripts and work in Linux environments for process automation and support activities. Collaborate with business stakeholders, data analysts, and application teams to understand data requirements and deliver solutions. Participate in code reviews, testing, and deployment activities. Ensure adherence to data governance, security, and compliance standards. Required Skills Technical Skills Strong experience in Oracle Database, including: o Advanced SQL and PL/SQL o Query optimization and performance tuning Proficiency in Python: o Data processing and ETL development o Automation scripting Hands-on experience with: o Hive o Hadoop ecosystem concepts o Data warehousing and large-scale data processing Strong Linux/Unix knowledge: o Shell scripting o Process monitoring and troubleshooting o File system management Good to Have Skills Experience with AWS cloud services: o AWS Lambda o Amazon S3 o Amazon OpenSearch Exposure to: o Spark/PySpark o Airflow o Kafka o Data lake architectures o CI/CD pipelines Qualifications Bachelors or Masters degree in Computer Science, Information Technology, Engineering, or a related field. 4 6 years of experience in Data Engineering, Data Warehousing, or ETL development. Strong analytical, problem-solving, and debugging skills. Excellent communication and stakeholder management capabilities. Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
More at I-qode Digital Solutions