Source description
About the role
Who We Are Artmac Soft is a technology consulting and service-oriented IT company dedicated to providing creative technology solutions and services to customers. Job Title : Data Engineer - PySpark & Snowflake Job Type : Full-time / Contract Experience : 7-10 Years Location : Hyderabad, Telangana Responsibilities - Experience with PySpark and Apache Spark. - Expertise in Snowflake architecture, development, optimization, and administration concepts. - Strong knowledge of SQL and relational database management systems (RDBMS). - Experience designing and developing ETL/ELT pipelines. - Hands-on experience with Data Warehousing concepts, dimensional modeling, and data integration. - Experience with Spark Streaming and real-time data processing. - Experience with workflow orchestration tools such as Apache Airflow. - Experience working with cloud platforms such as AWS, Microsoft Azure, and Google Cloud Platform (GCP) - Experience with Databricks and distributed data processing environments. - Strong understanding of DBMS concepts and database performance tuning. - Proficiency with Apache Kafka for event-driven architectures. - Strong understanding of Data Pipelines, Data Quality frameworks, and data governance practices. - Design, develop, and maintain scalable ETL/ELT data pipelines using PySpark, Spark, and cloud-native technologies. - Develop and manage enterprise data warehouse solutions using Snowflake. - Implement batch and real-time data processing solutions using Spark Streaming and Kafka. - Create high-performance data models and support business intelligence and analytics requirements. - Develop and maintain data workflows using orchestration tools such as Apache Airflow. - Optimize SQL queries, Spark jobs, and Snowflake workloads for performance and scalability. - Support production deployments, incident resolution, and continuous improvement initiatives. - Participate in architecture discussions and contribute to enterprise data platform modernization efforts. Qualification - Bachelor's degree or equivalent combination of education and experience. Who We Are Artmac Soft is a technology consulting and service-oriented IT company dedicated to providing creative technology solutions and services to customers. Job Title : Data Engineer - PySpark & Snowflake Job Type : Full-time / Contract Experience : 7-10 Years Location : Hyderabad, Telangana Responsibilities - Experience with PySpark and Apache Spark. - Expertise in Snowflake architecture, development, optimization, and administration concepts. - Strong knowledge of SQL and relational database management systems (RDBMS). - Experience designing and developing ETL/ELT pipelines. - Hands-on experience with Data Warehousing concepts, dimensional modeling, and data integration. - Experience with Spark Streaming and real-time data processing. - Experience with workflow orchestration tools such as Apache Airflow. - Experience working with cloud platforms such as AWS, Microsoft Azure, and Google Cloud Platform (GCP) - Experience with Databricks and distributed data processing environments. - Strong understanding of DBMS concepts and database performance tuning. - Proficiency with Apache Kafka for event-driven architectures. - Strong understanding of Data Pipelines, Data Quality frameworks, and data governance practices. - Design, develop, and maintain scalable ETL/ELT data pipelines using PySpark, Spark, and cloud-native technologies. - Develop and manage enterprise data warehouse solutions using Snowflake. - Implement batch and real-time data processing solutions using Spark Streaming and Kafka. - Create high-performance data models and support business intelligence and analytics requirements. - Develop and maintain data workflows using orchestration tools such as Apache Airflow. - Optimize SQL queries, Spark jobs, and Snowflake workloads for performance and scalability. - Support production deployments, incident resolution, and continuous improvement initiatives. - Participate in architecture discussions and contribute to enterprise data platform modernization efforts. Qualification - Bachelor's degree or equivalent combination of education and experience.
More at Artmachine