Padmi

Data Engineer - PySpark & Snowflake

HyderabadPosted 2 months ago
Infrastructure And DatabasesSeniorFull Time; Regular
Apply at Artmac

Opens the source posting on shine.com

Source description

About the role

View original

Who We Are Artmac Soft is a technology consulting and service-oriented IT company dedicated to providing innovative technology solutions and services to customers. Job Description Job Title : Data Engineer - PySpark & Snowflake Job Type : Full-time / Contract Experience : 7-10 Years Location : Hyderabad, Telangana Responsibilities Experience with PySpark and Apache Spark.Expertise in Snowflake architecture, development, optimization, and administration concepts.Strong knowledge of SQL and relational database management systems (RDBMS).Experience designing and developing ETL/ELT pipelines.Hands-on experience with Data Warehousing concepts, dimensional modeling, and data integration.Experience with Spark Streaming and real-time data processing.Experience with workflow orchestration tools such as Apache Airflow.Experience working with cloud platforms such as AWS, Microsoft Azure, and Google Cloud Platform (GCP)Experience with Databricks and distributed data processing environments.Strong understanding of DBMS concepts and database performance tuning.Proficiency with Apache Kafka for event-driven architectures.Strong understanding of Data Pipelines, Data Quality frameworks, and data governance practices.Design, develop, and maintain scalable ETL/ELT data pipelines using PySpark, Spark, and cloud-native technologies.Develop and manage enterprise data warehouse solutions using Snowflake.Implement batch and real-time data processing solutions using Spark Streaming and Kafka.Create high-performance data models and support business intelligence and analytics requirements.Develop and maintain data workflows using orchestration tools such as Apache Airflow.Optimize SQL queries, Spark jobs, and Snowflake workloads for performance and scalability.Support production deployments, incident resolution, and continuous improvement initiatives.Participate in architecture discussions and contribute to enterprise data platform modernization efforts. Qualification Bachelor's degree or equivalent combination of education and experience. Who We Are Artmac Soft is a technology consulting and service-oriented IT company dedicated to providing innovative technology solutions and services to customers. Job Description Job Title : Data Engineer - PySpark & Snowflake Job Type : Full-time / Contract Experience : 7-10 Years Location : Hyderabad, Telangana Responsibilities Experience with PySpark and Apache Spark.Expertise in Snowflake architecture, development, optimization, and administration concepts.Strong knowledge of SQL and relational database management systems (RDBMS).Experience designing and developing ETL/ELT pipelines.Hands-on experience with Data Warehousing concepts, dimensional modeling, and data integration.Experience with Spark Streaming and real-time data processing.Experience with workflow orchestration tools such as Apache Airflow.Experience working with cloud platforms such as AWS, Microsoft Azure, and Google Cloud Platform (GCP)Experience with Databricks and distributed data processing environments.Strong understanding of DBMS concepts and database performance tuning.Proficiency with Apache Kafka for event-driven architectures.Strong understanding of Data Pipelines, Data Quality frameworks, and data governance practices.Design, develop, and maintain scalable ETL/ELT data pipelines using PySpark, Spark, and cloud-native technologies.Develop and manage enterprise data warehouse solutions using Snowflake.Implement batch and real-time data processing solutions using Spark Streaming and Kafka.Create high-performance data models and support business intelligence and analytics requirements.Develop and maintain data workflows using orchestration tools such as Apache Airflow.Optimize SQL queries, Spark jobs, and Snowflake workloads for performance and scalability.Support production deployments, incident resolution, and continuous improvement initiatives.Participate in architecture discussions and contribute to enterprise data platform modernization efforts. Qualification Bachelor's degree or equivalent combination of education and experience.

One address, no account. We’ll tell you when matching roles go live.

More at Artmac

Related open roles

View all roles