Source description
About the role
Proven Skills with: Writing Complex SQL Queries Unix Shell Scripting Data Warehousing Fundamentals Experience with ETL/ELT pipelines Relational Database SQL, NoSQL Data Mapping, Data Modeling, Data Mining, and Data Warehousing/Mart Relational databases and SQL Query performance tuning Hands-on experience with at least one programming language Python / Java Good understanding of Big Data Fundamentals (Hadoop/Spark) and Data Processing Pipelines Hands-on experience with at least one cloud platform (GCP, AWS, Azure)
Responsibilities
Design, Develop and Deploy scalable data pipelines and data services, Design, develop, and test data processes per business requirements, following the development standards and best practices as well as participating in code peer reviews to ensure our applications comply with best practices. Work with business analysts to gather business requirements from end users and translate them into technical specifications. Gather requirements to define data definitions, transformation logic, and data model logical and physical designs, data flow, and process. Provide estimates for development. Perform data analysis and data profiling against source systems and data warehouse. Test solutions to validate whether requirements have been met; develop test plans, test scripts, and test conditions based on the business and system requirements. Provide end-user support in post-deployment phases; assess and evaluate all feedback to ensure that the requirements necessary to correct issues are addressed. Integrate new data management technologies and software engineering tools into existing infrastructure, Research opportunities for data acquisition and new uses for existing data Collaborate with data scientists and researchers to develop algorithms including prototypes, predictive models, and proof of concepts, Work with clients across geographies in an agile team environment, Constantly learn new technologies, frameworks, and tools. Exp. with Agile development. Excellent verbal and written communication skills are a must.
More at atgeir