Source description
About the role
Role- Data Developer Duration- 6 Months Location- Hybrid (50% remote) Denver Required Skills Very Strong SQL --- AWS (Glue, EMR, Lambdas) --- Hive / Hadoop / HQL experience will set candidates apart. Need experience with Data Validation + Integrity. Python, PySpark nice to have. Basic Qualifications Additional Skills• Experience with data validation or data integrity (this will be ~40% focus of the role to start) as there’s currently no one on the team doing this • Knowing the purpose of data and being experts in the data sets • Ability to develop scripts to improve data integrity Job Description The Data Developer works within the ETL and Operations team to build high quality data pipelines driving analytic solutions from diverse, disparate sources of data. This role requires a working understanding of data architecture, data engineering, and data analysis. The ideal candidate is a skilled data engineer with experience creating data products supporting analytic solutions. They are able to identify and implement solutions in a highly technical environment and work as part of a technical, cross-functional team. Strong problem-solving and troubleshooting skills are a must. This role focuses on designing, developing, and maintaining datasets within AWS with oversight and support from Lead Developers. Day-to-day responsibilities include: Coordinating, building, and managing new data ingests Implementing updates, fixes, and optimizations across suite of production jobs Providing feedback on and enacting changes for improvements across the team including both technical and process updates Learning about and becoming familiar with data assets, processing jobs and pipelines, and tools Partnering with data analysts and data scientists to design, build, and deploy aggregation processes Top Skills: Hadoop/Hive experience Strong SQL AWS experience (EMR, Lambda, Glue, Step Functions) Experience working with large data sets (billions of records per day) Write and review code Python scripting (PySpark, control scripts) Building and managing data pipelines Query and data pipeline optimization Strong communication and collaboration skills Ability to learn new technologies and skills to incorporate into existing work Nice to have Spark Scala Git Shell scripting Linux -- ---- Thanks & Regards, Tejash - Technical Recruiter Thought wave Software and Solutions 314 N. Lake St, Suite 6, Aurora IL 60506 Desk: 6304918494 EXTN: 157 Email :tejash@thoughtwavesoft.com Website:www.thoughtwavesoft.com https://www.linkedin.com/in/tejash-chettipalli-342aa2246
More at Thoughtwave Software and Solutions