Databricks Engineer

You will be joining Durapid Technologies, a fast-growing technology company that specializes in Data Engineering, AI Solutions, Cloud Technologies, and Enterprise Software Development. Your role as a Databricks Engineer will involve designing and delivering scalable data solutions using Databricks, Streaming Technologies, and SQL. It is essential to have hands-on experience in building modern data pipelines, processing large-scale datasets, and optimizing data platforms for performance and reliability. Databricks Certification is a mandatory requirement for this position. Key Responsibilities: - Design, develop, and maintain scalable data pipelines using Databricks. - Build and optimize batch and real-time data processing solutions. - Develop streaming data applications and data ingestion frameworks. - Write and optimize complex SQL queries, transformations, and data models. - Work with large-scale structured and unstructured datasets. - Ensure high data quality, reliability, governance, and performance. - Collaborate with Data Engineers, Architects, Business Analysts, and stakeholders. - Troubleshoot performance bottlenecks and optimize workloads. - Implement best practices for data engineering, monitoring, and scalability. - Participate in architecture discussions and technical solution design. Qualifications Required: - 6+ years of overall IT experience. - Hands-on experience with Databricks in production environments. - Databricks Certification (Mandatory). - Strong expertise in Streaming Technologies. - Advanced SQL programming and query optimization skills. - Experience building ETL/ELT pipelines and data transformation workflows. - Strong understanding of Data Warehousing and Data Lake concepts. - Experience handling large-scale datasets and performance tuning. - Excellent communication and stakeholder management skills. - Willingness to work from the Jaipur office. Preferred Skills: - Experience with Apache Spark and PySpark. - Exposure to Azure Data Engineering ecosystem. - Knowledge of Delta Lake and Lakehouse architecture. - Experience with CI/CD and DevOps practices for data platforms. - Understanding of cloud platforms such as Azure, AWS, or GCP. You will be joining Durapid Technologies, a fast-growing technology company that specializes in Data Engineering, AI Solutions, Cloud Technologies, and Enterprise Software Development. Your role as a Databricks Engineer will involve designing and delivering scalable data solutions using Databricks, Streaming Technologies, and SQL. It is essential to have hands-on experience in building modern data pipelines, processing large-scale datasets, and optimizing data platforms for performance and reliability. Databricks Certification is a mandatory requirement for this position. Key Responsibilities: - Design, develop, and maintain scalable data pipelines using Databricks. - Build and optimize batch and real-time data processing solutions. - Develop streaming data applications and data ingestion frameworks. - Write and optimize complex SQL queries, transformations, and data models. - Work with large-scale structured and unstructured datasets. - Ensure high data quality, reliability, governance, and performance. - Collaborate with Data Engineers, Architects, Business Analysts, and stakeholders. - Troubleshoot performance bottlenecks and optimize workloads. - Implement best practices for data engineering, monitoring, and scalability. - Participate in architecture discussions and technical solution design. Qualifications Required: - 6+ years of overall IT experience. - Hands-on experience with Databricks in production environments. - Databricks Certification (Mandatory). - Strong expertise in Streaming Technologies. - Advanced SQL programming and query optimization skills. - Experience building ETL/ELT pipelines and data transformation workflows. - Strong understanding of Data Warehousing and Data Lake concepts. - Experience handling large-scale datasets and performance tuning. - Excellent communication and stakeholder management skills. - Willingness to work from the Jaipur office. Preferred Skills: - Experience with Apache Spark and PySpark. - Exposure to Azure Data Engineering ecosystem. - Knowledge of Delta Lake and Lakehouse architecture. - Experience with CI/CD and DevOps practices for data platforms. - Understanding of cloud platforms such as Azure, AWS, or GCP.