Padmi

cloud/data infrastructure engineer

New YorkPosted 1 month ago
Infrastructure And DatabasesUnspecified
Apply at Thoughtwave Software and Solutions

Opens the source posting on atsapp.swarmhr.com

Source description

About the role

View original

Data Infrastructure Engineer

6 Month Contract to Hire

San Antonio, TX (Hybrid 4 days onsite)

THIS IS A DATA ENGINEER WITH CLOUD/PIPELINE AUTOMATION EXPERIENCE

Need:

Fivetran/Informatica IDMC/ Azure Data Factory (or similar automation experience)

ETL/ELT

REQUIRED:

Data Engineering

Cloud Engineering

Infrastructure Engineering

Event Platforms/Data Streaming

IaC

Project Overview

Building and managing cloud-based data pipelines

Working with streaming platforms like Kafka, Kinesis, or Event Hubs

Using modern ETL/ELT tools like Fivetran and Informatica’s IDMC

Supporting event-driven architectures and real-time analytics

Leveraging Infrastructure as Code, CI/CD, and Kubernete

Evaluation Notes

Senior candidates should show depth across multiple tools and architectural understanding, and ideally have led delivery or designed resilient, scalable systems.

Preferred Qualifications

  • Extensive Experience with Cloud and Data Platform Infrastructure Engineering.

  • Extensive experience with event platforms on-prem or Cloud (Kafka, Redpanda, AWS Kinesis, Azure Event Hubs, GCP Pub/Sub), stream processing frameworks (Flink, Spark Streaming, Amazon Kinesis Data Streams, Google Cloud Dataflow ).

  • Experience with ETL/ELT tools like Fivetran, and/or Informatica's cloud product, IDMC; demonstrated ability to design, implement, and optimize data pipelines. This includes experience with and automating connector configuration, data transformation, and schema management.

  • Understanding of event-driven architectures, CQRS, and event sourcing.

  • Proficiency in monitoring and observability tools (Datadog, Prometheus, Grafana, or similar).

  • Strong experience with Infrastructure as Code (IaC) tools (e.g., Terraform, CloudFormation).

  • Proven ability to automate tasks and implement CI/CD pipelines.

  • Strong problem-solving and communication skills.

  • Experience with Kubernetes and container orchestration.

  • Experience with various database technologies (SQL and NoSQL).

  • Experience in supporting Real-time analytical need.

One address, no account. We’ll tell you when matching roles go live.

More at Thoughtwave Software and Solutions

Related open roles

View all roles