Source description
About the role
As a Data Engineer, your role involves leading the design, development, and optimization of scalable data pipelines and analytics platforms. You will work with large and complex datasets to help the organization make informed, data-driven decisions. Collaborating closely with cross-functional business and technology teams is essential for this role. Key Responsibilities: - Data Preparation & Management - Clean, prepare, and validate data for analysis - Acquire data from primary and secondary sources; build and maintain data systems and databases - Identify, analyze, and interpret patterns or trends in complex datasets - Data Analysis & Insights - Perform exploratory and statistical data analysis to support business decisions - Provide insights that drive performance improvements, revenue optimization, and customer experience enhancements - Support business case creation with data-driven analysis - Conduct ad-hoc analysis for leadership and product teams - Data Transformations - Build large-scale data processing solutions using Databricks (Scala, Spark SQL, PySpark, Python) - Design, optimize, and manage Snowflake data warehouse structures and workloads - Ensure data quality, performance, governance, and automation across pipelines - Build and optimize SSAS Tabular Models and support enterprise BI solutions - Lead end-to-end design and delivery of ETL/ELT pipelines using SQL, SSIS, databricks jobs - Reporting & Visualization - Develop high-quality dashboards, reports, and visualization assets for stakeholders using Power BI and data bricks dashboards - Translate complex datasets into clear, concise business insights using tools such as Power BI - Collaboration - Work with technology, product, and management teams to define business needs and analytical requirements - Communicate results clearly to cross-functional stakeholders - Continuous Improvement - Recommend methods to improve the performance of data loads, data collection, governance, and reporting systems Required Skills & Experience: - Expertise in SQL and experience with large datasets and optimization - Good experience with BI tools (Power BI) - Good experience in Databricks Scala/SparkSQL/PySpark/Python and Databricks dashboard - Good experience in Snowflake - Experience in SSAS (Tabular model) and SSIS (advanced ETL workflows, performance tuning) - Strong statistical knowledge and analytical mindset Soft Skills: - Strong problem-solving and system-thinking mindset - Excellent communication and stakeholder management - Ability to handle multiple complex initiatives independently As a Data Engineer, your role involves leading the design, development, and optimization of scalable data pipelines and analytics platforms. You will work with large and complex datasets to help the organization make informed, data-driven decisions. Collaborating closely with cross-functional business and technology teams is essential for this role. Key Responsibilities: - Data Preparation & Management - Clean, prepare, and validate data for analysis - Acquire data from primary and secondary sources; build and maintain data systems and databases - Identify, analyze, and interpret patterns or trends in complex datasets - Data Analysis & Insights - Perform exploratory and statistical data analysis to support business decisions - Provide insights that drive performance improvements, revenue optimization, and customer experience enhancements - Support business case creation with data-driven analysis - Conduct ad-hoc analysis for leadership and product teams - Data Transformations - Build large-scale data processing solutions using Databricks (Scala, Spark SQL, PySpark, Python) - Design, optimize, and manage Snowflake data warehouse structures and workloads - Ensure data quality, performance, governance, and automation across pipelines - Build and optimize SSAS Tabular Models and support enterprise BI solutions - Lead end-to-end design and delivery of ETL/ELT pipelines using SQL, SSIS, databricks jobs - Reporting & Visualization - Develop high-quality dashboards, reports, and visualization assets for stakeholders using Power BI and data bricks dashboards - Translate complex datasets into clear, concise business insights using tools such as Power BI - Collaboration - Work with technology, product, and management teams to define business needs and analytical requirements - Communicate results clearly to cross-functional stakeholders - Continuous Improvement - Recommend methods to improve the performance of data loads, data collection, governance, and reporting systems Required Skills & Experience: - Expertise in SQL and experience with large datasets and optimization - Good experience with BI tools (Power BI) - Good experience in Databricks Scala/SparkSQL/PySpark/Python and Databricks dashboard - Good experience in Snowflake - Experience in SSAS (Tabular model) and SSIS (advanced ETL workflows, per
More at Birlasoft