Source description
About the role
Role:Data Engineer
Location:Hybrid (3 days on/2 days remote in McLean, Va) Duration:12 Months
Required Skills : Python, Pyspark, SQL
5+ years of experience in processing large volumes and variety of data (Structured and semi-structured data, writing code for parallel processing, shredding XMLS, JSONs and reading PDFs) - Mandatory 3+ years of development experience in Python for data processing and analysis – Mandatory Strong SQL experience is a must - Mandatory Detail oriented. Excellent communication skills (verbal and written) Must be able to manage multiple priorities and meet deadlines
Responsibilities
Cleanse, manipulate and analyze large datasets (Semi-Structured and Unstructured data – XMLs, JSONs, CSVs, PDFs) using python and Snowflake database. Develop Python scripts to filter/cleanse/map/aggregate data. Manage and implement data processes (Data Quality reports) Develop data profiling, deduping logic, matching logic for analysis Programming Languages experience in Python, PySpark and SQL for data ingestion Present ideas and recommendations on data handling and data parsing technologies to management
Required Experience: 5+ years of experience in processing large volumes and variety of data (Structured and semi-structured data, writing code for parallel processing, shredding XMLS, JSONs and reading PDFs) - Mandatory 3+ years of development experience in Python for data processing and analysis – Mandatory Strong SQL experience is a must - Mandatory Detail oriented. Excellent communication skills (verbal and written) Must be able to manage multiple priorities and meet deadlines
Bhargavi Ankam IT Recruiter Staffing | Thoughtwave Software and Solutions Limited 6306891366 bhargavi@thoughtwavesoft.com www.thoughtwavesoft.com 314 N. Lake St, Suite 6, Aurora IL 60506
More at Thoughtwave Software and Solutions