Source description
About the role
As a Data Engineer with 6+ years of experience, your role will involve working with various tools and platforms such as any cloud service, Kafka, and experience in streaming data processing. Your expertise in SQL and PySpark will be crucial for writing complex SQL queries for data analysis. Your responsibilities will include: - Utilizing SQL for aggregation, window functions, joins, and optimizing performance - Demonstrating expertise in Spark architecture and processing to write performance-optimized code - Applying data modeling skills in ER model and Dimensional modeling (Fact/Dimension) - Understanding standard ETL processes like SCD, Delta load, etc. - Designing and developing end-to-end data pipelines Additionally, it would be beneficial to have knowledge of data visualization tools such as PowerBI or Tableau. Please note that the job description did not include any additional details about the company. As a Data Engineer with 6+ years of experience, your role will involve working with various tools and platforms such as any cloud service, Kafka, and experience in streaming data processing. Your expertise in SQL and PySpark will be crucial for writing complex SQL queries for data analysis. Your responsibilities will include: - Utilizing SQL for aggregation, window functions, joins, and optimizing performance - Demonstrating expertise in Spark architecture and processing to write performance-optimized code - Applying data modeling skills in ER model and Dimensional modeling (Fact/Dimension) - Understanding standard ETL processes like SCD, Delta load, etc. - Designing and developing end-to-end data pipelines Additionally, it would be beneficial to have knowledge of data visualization tools such as PowerBI or Tableau. Please note that the job description did not include any additional details about the company.
More at WillWare Technologies
Related open roles
Database Administrator Cassandra / Redis / Mariadb / Mongodb Chennai
Chennai
GCP DevOps Engineer
Delhi NCR
Database Administrator (Cassandra / Redis / MariaDB / MongoDB)
Chennai
Freelance Databricks & Snowflake Architect
India
Willware Technologies - Database Administrator - Cassandra/MongoDB
Chennai
ServiceNow Administrator
Mumbai