GCP Data Engineer

Role:GCP Data Engineer

Location:REMOTE(Must sit in EST/CST) Duration:12+ months

Must Haves:

1. GCP (Data Flow, Big Query, Pub Sub)
2. Complex SQL queries (need to integrate data from the Data Lake)
3. CI/CD

D2D: • Get data to GCP, and analyze this • Setting up data pipelines • Analysis of existing system – Understand how data flows through (will work E2E) • Talk with customers, understand what the data product is that they are building • Work with Architect, will be involved in the design • Train team members in GCP tools

Nice to have: • Data Science experience • Big Data • Understanding Machine Learning (just need to know concepts)

Experience Required:

• In-depth understanding of Googles product technology (or other cloud platform) and underlying architectures
• 5+ years of application development experience required
• 5+ years of SQL development experience
• 3+ years of GCP experience
• Experience working in GCP based Big Data deployments (Batch/Real-Time) leveraging Big Query, Big Table, Google Cloud Storage, PubSub, Data Fusion, Dataflow, Dataproc, Airflow etc. - 2 + years professional development experience in Java or Python.
• Work with data team to analyze data, build models and integrate massive datasets from multiple data sources for data modelling Implement methods for automation of all parts of the predictive pipeline to minimize labor in development and production. Formulate business problems as technical data problems while ensuring key business drivers are captured in collaboration with product management
• Extracting, Loading, Transforming, cleaning, and validating data - Designing pipelines and architectures for data processing
• 1+ year of designing and building production data pipelines from ingestion to consumption within a hybrid big data architecture, using Java/ Python etc.
• 1+ year of hands-on GCP experience with a minimum solution designed and implemented at production scale

Experience Preferred:

• Architecting and implementing next generation data and analytics platforms on GCP
• Experience in building solution architecture, provision infrastructure, secure and reliable data-centric services and application in GCP
• Experience with Informatica EDC is preferred - Experience with development eco-system such as Git, Jenkins and CICD. Exceptional problem solving and communication skills - Experience in working with Agile and Lean methodologies - Team player and attention to detail
• Performance tuning experience

Education Required: * Bachelors degree in computer science or related scientific field

• IT or related Associated topics: data architect, data center, data integrity, data manager, data management, data scientist, data warehousing, sql, sybase, Teradata

Education Preferred: * Masters degree in computer science or related field

• GCP Professional Data Engineer Certified * 2+ years mentoring engineers * In-depth software engineering knowledg

Bhargavi Ankam IT Recruiter Staffing | Thoughtwave Software and Solutions Limited 6306891366 bhargavi@thoughtwavesoft.com www.thoughtwavesoft.com 314 N. Lake St, Suite 6, Aurora IL 60506