Source description
About the role
Role Overview: As a Senior Data Engineer at our Bangalore office, you will be responsible for developing data pipeline solutions to address business data needs. Your role will involve designing structured and semi-structured data models, utilizing Python and SQL for data collection and transformation, creating data APIs, leveraging AI for analytics, building data visualizations, and optimizing solutions for cost and performance. Additionally, you will collaborate with peers, mentor junior members, and stay updated on the latest technical advancements in data engineering and AI. Key Responsibilities: - Design, implement, and maintain structured data models in Cloud Databases and semi-structured data models on storage buckets - Use Python & SQL for collecting, enriching, cleansing, and transforming data - Develop data APIs in Python Flask containers and leverage AI for analytics - Create data visualizations and dashboards using Tableau - Optimize solutions for costs and performance using infrastructure as code (Terraform) - Execute automated deployment processes on Jenkins or GitHub Actions - Assist business analysts with collecting stakeholders' requirements and translate them into detailed technical specifications - Stay updated on the latest technical advancements, especially within GenAI, and recommend changes based on advancements in Data Engineering and AI - Embrace change and collaborate with team members by sharing and learning knowledge Qualifications Required: - 5+ years of experience in data engineering with a focus on Python programming, data pipeline development, and API design - Hands-on experience with container technologies such as Docker and leveraging AI - Proficiency in SQL and experience working with various relational and NoSQL databases - Strong knowledge of data warehousing concepts, ETL processes, and data modeling techniques - Excellent problem-solving skills, attention to detail, and the ability to work independently and as part of a team - Experience with cloud-based (AWS, GCP, Azure) data storage and processing platforms - Bachelor's degree in computer science, IT, engineering, or a related field - Relevant certifications in BI, AI, data engineering, or data visualization tools are highly desirable Company Details: Omit this section as there are no additional details of the company mentioned in the job description. Role Overview: As a Senior Data Engineer at our Bangalore office, you will be responsible for developing data pipeline solutions to address business data needs. Your role will involve designing structured and semi-structured data models, utilizing Python and SQL for data collection and transformation, creating data APIs, leveraging AI for analytics, building data visualizations, and optimizing solutions for cost and performance. Additionally, you will collaborate with peers, mentor junior members, and stay updated on the latest technical advancements in data engineering and AI. Key Responsibilities: - Design, implement, and maintain structured data models in Cloud Databases and semi-structured data models on storage buckets - Use Python & SQL for collecting, enriching, cleansing, and transforming data - Develop data APIs in Python Flask containers and leverage AI for analytics - Create data visualizations and dashboards using Tableau - Optimize solutions for costs and performance using infrastructure as code (Terraform) - Execute automated deployment processes on Jenkins or GitHub Actions - Assist business analysts with collecting stakeholders' requirements and translate them into detailed technical specifications - Stay updated on the latest technical advancements, especially within GenAI, and recommend changes based on advancements in Data Engineering and AI - Embrace change and collaborate with team members by sharing and learning knowledge Qualifications Required: - 5+ years of experience in data engineering with a focus on Python programming, data pipeline development, and API design - Hands-on experience with container technologies such as Docker and leveraging AI - Proficiency in SQL and experience working with various relational and NoSQL databases - Strong knowledge of data warehousing concepts, ETL processes, and data modeling techniques - Excellent problem-solving skills, attention to detail, and the ability to work independently and as part of a team - Experience with cloud-based (AWS, GCP, Azure) data storage and processing platforms - Bachelor's degree in computer science, IT, engineering, or a related field - Relevant certifications in BI, AI, data engineering, or data visualization tools are highly desirable Company Details: Omit this section as there are no additional details of the company mentioned in the job description.
More at Notified