Source description
About the role
Key Responsibilities: Data Ingestion: Develop and maintain data pipelines to ingest product feeds from multiple sources in various formats, including CSV, XML, and JSON. Data Processing and Transformation: Clean, validate, and transform incoming data feeds to ensure they conform to our internal data standards. This includes handling malformed data and transforming all data into JSON format. Automation and Optimization: Automate feed processing tasks, ensuring efficiency, reliability, and scalability of the data ingestion pipeline. API Integration: Implement and manage API integrations to upload processed data to our feed server and ensure smooth data flow across systems. Collaboration: Work closely with data engineers, product managers, and other stakeholders to understand data requirements and ensure the feed processing pipeline meets business needs. Monitoring and Troubleshooting: Monitor feed processing workflows, identify bottlenecks, troubleshoot issues, and optimize performance. Key Requirements: Strong proficiency in Python programming. Experience with data parsing and processing in formats such as CSV, XML, and JSON. Knowledge of data cleaning, validation, and transformation techniques. Hands-on experience with API integration and handling RESTful services. Familiarity with data pipelines, ETL processes, and automation tools. Solid understanding of error handling and data quality assurance best practices. Experience with e-commerce data feeds is a plus. Strong problem-solving skills and attention to detail.
More at Netcore Cloud