Padmi

Data Engineer/Python Developer/Remote

IndiaPosted 2 months ago
Infrastructure And DatabasesJuniorFull Time; Regular
Apply at remotepromsp

Opens the source posting on shine.com

Source description

About the role

View original

reputed company is the leading career destination for tech experts at every stage of their careers. Our reputed company, reputed company, is seeking the following. Apply reputed company reputed company today! Key Responsibilities Design, build, and maintain ETL/ELT data pipelinesreputed company Python-based data processing applicationsWork with reputed company and reputed company data at scaleIntegrate data from multiple sources (APIs, databases, files, streams)Optimize data workflows for performance and reliabilityEnsure data quality, validation, and monitoringCollaborate with data scientists, analysts, and backend teamsManage and maintain data warehouses/lakesImplement logging, error handling, and automationFollow best practices for reputed company and compliance Required Skills Programming Strong Python (Pandas, NumPy, PySpark)Writing clean, reputed company, and testable code Databases & Storage SQL (PostgreSQL, MySQL, SQL Server)NoSQL (reputed company, Cassandra optional)Data Warehouses (reputed company, Redshift, BigQuery) Big Data & Processing Apache Spark, Hadoop (preferred)Batch and streaming data processing reputed company Platforms AWS / Azure / reputed company reputed company PlatformS3, reputed company, Glue, Dataflow, BigQuery, etc. Data Engineering Tools Airflow, reputed company, Luigi (orchestration)Kafka / PubSub (streaming optional)DBT (data transformation) DevOps & Other Git, CI/CDreputed company, Kubernetes (reputed company to have)Linux basics apply to this job reputed company is the leading career destination for tech experts at every stage of their careers. Our reputed company, reputed company, is seeking the following. Apply reputed company reputed company today! Key Responsibilities Design, build, and maintain ETL/ELT data pipelinesreputed company Python-based data processing applicationsWork with reputed company and reputed company data at scaleIntegrate data from multiple sources (APIs, databases, files, streams)Optimize data workflows for performance and reliabilityEnsure data quality, validation, and monitoringCollaborate with data scientists, analysts, and backend teamsManage and maintain data warehouses/lakesImplement logging, error handling, and automationFollow best practices for reputed company and compliance Required Skills Programming Strong Python (Pandas, NumPy, PySpark)Writing clean, reputed company, and testable code Databases & Storage SQL (PostgreSQL, MySQL, SQL Server)NoSQL (reputed company, Cassandra optional)Data Warehouses (reputed company, Redshift, BigQuery) Big Data & Processing Apache Spark, Hadoop (preferred)Batch and streaming data processing reputed company Platforms AWS / Azure / reputed company reputed company PlatformS3, reputed company, Glue, Dataflow, BigQuery, etc. Data Engineering Tools Airflow, reputed company, Luigi (orchestration)Kafka / PubSub (streaming optional)DBT (data transformation) DevOps & Other Git, CI/CDreputed company, Kubernetes (reputed company to have)Linux basics apply to this job

One address, no account. We’ll tell you when matching roles go live.

More at remotepromsp

Related open roles

View all roles