Source description
About the role
Total Experience - 4 Years and above Notice Period - Immediate -15 days Location- Bangalore Data Engineering Skills Strong hands-on experience with the Hadoop ecosystem, including HDFS, YARN, Hadoop cluster operations, monitoring, and troubleshooting. Extensive experience with Hive, including writing and optimizing HiveQL queries, creating managed and external tables, implementing partitioning and bucketing strategies, and tuning Hive job performance. Proficient in working with file formats such as Avro and JSON for large-scale data processing. Hands-on experience with Apache Spark, including Spark SQL, PySpark, batch data processing, Spark job optimization, debugging failed jobs, and processing large-scale datasets. Experience with Apache Airflow for designing, scheduling, monitoring, and maintaining DAGs, building dependency-based workflows, managing retries, alerts, and failure handling, and integrating Airflow with Spark, Hive, Hadoop, and cloud services. Strong SQL expertise with complex joins, window functions, aggregations, query optimization, data validation, and data reconciliation. Proficient in Python for developing scalable data engineering solutions and automation. Experience building end-to-end ETL/ELT pipelines, including data ingestion, transformation, data quality validation, and movement of data across source systems, data lakes, and data warehouses. About Us Grid Dynamics (Nasdaq:GDYN) is a digital-native technology services provider that accelerates growth and bolsters competitive advantage for Fortune 1000 companies. Grid Dynamics provides digital transformation consulting and implementation services in omnichannel customer experience, big data analytics, search, artificial intelligence, cloud migration, and application modernization. Grid Dynamics achieves high speed-to-market, quality, and efficiency by using technology accelerators, an agile delivery culture, and its pool of global engineering talent. Founded in 2006, Grid Dynamics is headquartered in Silicon Valley with offices across the US, UK, Netherlands, Mexico, India, Central and Eastern Europe. To learn more about Grid Dynamics, please visit www.griddynamics.com . Follow us on Facebook , Twitter , and LinkedIn . --
More at Grid Dynamics