Source description
About the role
Job Responsibilities: In-depth knowledge of Data Lake, Lakehouse, and Data Mesh architecturesExperience building any data platforms using Databricks / Delta Lake (on-prem) / Snowflake.Proficient in ingesting structured, semi-structured, and unstructured data.Strong hands-on experience with Python, PySpark, SQL and APIs for data ingestion and transformation.Experience with ETL / ELT pipelines, streaming (Kafka, Kinesis), and batch processing (Spark, Glue, DBT).Strong experience working with Parquet, JSON, CSV files, sensor data, and optimizing large-scale analytical dataset.Collaborate with team members to design and operationalize data lake solutions.Excellent problem-solving, communication, and team collaboration skills. Job Requirements: B Tech in Computer Science or Master of Computer Application6-8 years of relevant experienceExpertise in data modeling techniques including star/snowflake schemas and 3NFProficiency in Python programmingHands-on experience with Kafka, Databricks, and SnowflakesStrong understanding of data governance, lineage, data cataloging, and compliance (GDPR, HIPAA)Willingness to learn and adapt to new data engineering technologies6-8 years of relevant experience . .
More at Bebo Technologies