Padmi

Data Engineer

BangalorePosted 21 months ago
Infrastructure And DatabasesMid-level
Apply at Coffeebeans Consulting

Opens the source posting on naukri.com

Source description

About the role

View original

Location : Bengaluru / Pune / Hyderabad. Shift : Rotational Shift. Founded in the year 2017, CoffeeBeans specializes in offering high end consulting services in technology, product, and processes. We help our clients attain significant improvement in quality of delivery through impactful product launches, process simplification, and help build competencies that drive business outcomes across industries. The company uses new-age technologies to help its clients build superior products and realize better customer value. We also offer data-driven solutions and AI-based products for businesses operating in a wide range of product categories and service domains. As a Data Engineer , you will play a crucial role in designing, building, and maintaining scalable data pipelines and infrastructure. You will work closely with cross-functional teams to ensure data integrity, availability, and accessibility for various business applications. This role is ideal for a detail-oriented professional with a strong background in data engineering, Python programming, and cloud technologies. Key Responsibilities. Design, develop, and maintain scalable data pipelines to support data processing and analytic. Implement data extraction, transformation, and loading (ETL) processes from various data sources to data warehouses or data lake. Utilize Python and relevant libraries such as Pandas, and optionally PySpark, to handle and process large datasets efficientl. Write, optimize, and manage SQL queries to retrieve and manipulate data from relational databases and data warehouse. Collaborate with data scientists, analysts, and other stakeholders to understand data needs and provide actionable insight. Use Jupyter Notebook for data exploration, analysis, and visualization to communicate findings effectivel. Manage and monitor cloud-based data infrastructure using AWS or GCP service. Ensure data quality and integrity through thorough testing and validation procedure. Document data engineering processes and maintain accurate records of data architecture and workflow. Required Skills and Qualification. Bachelors degree in Computer Science, Information Technology, or a related fiel. 1-3 years of experience as a Data Engineer or in a similar rol. Proficient in Python programming, with experience using libraries such as Pandas; experience with PySpark is a plu. Strong SQL skills, with the ability to write complex queries for data extraction and manipulatio. Experience working with relational databases (e g , MySQL, PostgreSQL) or RD. Hands-on experience with Jupyter Notebook for data analysis and visualizatio. Experience with cloud platforms such as AWS or GCP, including services like Amazon Redshift, Google BigQuery, or equivalen. Strong problem-solving skills and attention to detai. Excellent communication and teamwork skill. Preferred Skill. Experience with additional data processing tools such as Apache Airflow, Kafka, or Hadoo. Knowledge of data warehousing concepts and best practice. Familiarity with data governance, security, and complianc. Understanding of machine learning concepts and tool. Show more Show less

One address, no account. We’ll tell you when matching roles go live.

More at Coffeebeans Consulting

Related open roles

View all roles