Source description
About the role
Role: Data Engineer Skill : Data Engineering, Bigquery,ETL Pipelines Experience: 7 to 12 years Job Description: Key Responsibilities Design, develop, and optimize data pipelines using Google BigQuery Execute and support Teradata to BigQuery migration projects Develop and manage data ingestion using BigQuery Data Transfer Service (BQ DTS) Build and maintain ETL/ELT pipelines using Python Automate workflows using Cloud Composer (Apache Airflow) Deploy scalable data processing services using Cloud Run Manage data storage in Google Cloud Storage (GCS) Ensure data quality, governance, and performance tuning Collaborate with cross-functional teams Monitor and troubleshoot data workflows Required Skills Strong experience with Google BigQuery Hands-on with BigQuery Data Transfer Service (BQ DTS) Experience in Teradata to BigQuery migration Proficiency in Python Experience with Cloud Composer (Airflow) Knowledge of Cloud Run Experience with Google Cloud Storage (GCS) Strong SQL skills Experience in automation Good to Have CI/CD pipelines in GCP Knowledge of Dataflow / Pub-Sub Terraform or Infrastructure as Code Data modeling and warehousing concepts Educational Qualification Bachelors/Masters degree in Computer Science, IT, or related field Key Competencies Problem-solving skills Ability to work in fast-paced environments Good communication skills
More at Tata Consultancy Services