Source description
About the role
Design, develop & maintain data platform services for varied use cases such as Data Extraction, Data Processing, Data Ingestion, Data Observability and Data Discovery. Own and operate the analytical data warehouse / data lake. Manage the deployment of services onto multiple data centres across the globe. Enable performance monitoring and auto-scaling of the platform services. Contribute to establishing and enforcing coding & operational best practices for the team. Who should apply 3-5 years of experience in data engineering, BI engineering, and data warehouse development. Excellent command of one or more programming languages, preferably Python or Java. Excellent SQL skills. Knowledge of Flink, Airflow. Knowledge of DBT. Experience working with Kubernetes. Strong knowledge of architecture & internals of Apache Spark with multiple years of hand-on experience. Experience working with distributed SQL engines like Athena / Presto. Experience in building ETL Data Pipelines. Ability to cut through the buzzwords and pick the right tools for building systems centred on core principles of reliability, scalability and maintainability. Role: Data Engineer Industry Type: IT Services & Consulting Department: Data Science & Analytics Employment Type: Full Time, Permanent Role Category: Data Science & Machine Learning Education UG: Any Graduate PG: Any Postgraduate
More at Zeta