Big Data Engineer

Big Data Engineer Description: Develop and maintain existing Hive and Vertica ingestion & processing pipelines that processes raw data into shareable data layers for wider analyst consumption.Document the development for the project design, update the technical specifications and conduct peer review & architecture reviews along with the business stake holders.Responsible for using various error handling techniques in data services and profiling tools like Talend Open Studio for data validation & building rules.Create debugging sessions to check, detect and validate the transformations and also verify the existing mappings in debug mode extensively for error identification by creating break points.Analyze data-related systems integration opportunities and challenges, validating data models from a data integration perspective for current projects as well as other impacted projects and drive quality improvements. Requirements : Bachelor’s degree in Computer Science.