Source description
About the role
Company Description ITCRAFT TECHNOLOGIES PRIVATE LIMITED helps enterprises turn large volumes of information into meaningful insight for better decision-making. The company delivers website design, software development, and internet solutions with a strong focus on modern graphics, intuitive layouts, and interactive functionality. On the back end, ITCRAFT leverages up-to-date database technologies to ensure performance, reliability, and scalability. The organization is committed to creating smooth, memorable digital experiences that clients value and recommend. Role Description * 3-5 + years of experience in Data Engineering / Data Platform Engineering. * Strong hands-on experience with *Microsoft Fabric, *Azure Databricks, and modern Lakehouse architectures. * Expertise in designing scalable ELT/ETL pipelines for large-scale data platforms. * Strong proficiency in *Python, **PySpark, **SQL, and *dbt. * Experience with *Azure Data Lake Storage (ADLS), *Delta Lake, and cloud data warehouses. * Strong understanding of Medallion Architecture (Bronze, Silver, Gold). * Experience with *Microsoft Fabric Data Factory, *Azure Data Factory, or similar orchestration tools. * Strong knowledge of data modeling (Star Schema, Dimensional Modeling, SCDs). * Experience with API integration and exposing curated datasets for downstream applications. * Experience implementing data quality checks, logging, monitoring, and pipeline observability. * Proficiency with Git, CI/CD, and modern software engineering best practices. * Experience working with large-scale telemetry, IoT, SCADA, manufacturing, or industrial data is preferred. * Excellent architecture, problem-solving, and mentoring skills. Qualifications * Design and own the architecture of a scalable cloud-based data platform for multi-plant Solar SCADA analytics. * Build scalable ingestion frameworks for telemetry and operational data from multiple plants. * Design and implement Lakehouse and Data Warehouse solutions using Microsoft Fabric and/or Azure Databricks. * Develop robust ELT pipelines using PySpark, dbt, and SQL. * Design reusable, metadata-driven data pipelines and transformation frameworks. * Optimize data processing, storage, and query performance for large datasets. * Establish engineering standards, coding practices, documentation, and deployment processes. * Implement data quality, monitoring, logging, and alerting across the platform. * Collaborate with application teams to provide secure, analytics-ready datasets and APIs. * Evaluate and implement modern data platform capabilities, including AI-ready architectures where applicable. * Mentor junior engineers through architecture guidance, code reviews, and technical leadership. .
More at ITCRAFT TECHNOLOGIES PRIVATE LIMITED