Source description
About the role
Role Overview: You are seeking a Data Integration Engineer to design, build, and evolve the data integration capabilities powering the Next-Gen Data Platform within the State Street Alpha ecosystem. In this role, you will develop cloud-native, scalable, and resilient data integration services using microservices and serverless architectures, including Azure Functions. This is a hands-on engineering role for an experienced developer with a minimum of 12 years of experience who enjoys solving complex data and distributed systems problems. The role combines greenfield framework development with ownership of mission-critical enterprise integrations, including the opportunity to ramp up on and support existing internal Java-based import/export frameworks (built on Java and Pentaho Kettle) and enterprise integration frameworks built using Talend-based solutions that remain essential to the platform. Key Responsibilities: - Analyze, design, develop, test, and maintain large-scale, cloud-native data integration services using microservices and serverless patterns (e.g., Azure Functions). - Contribute to the design and implementation of core data integration platforms and services, with a focus on scalability, resiliency, operability, and performance. - Build and enhance APIs and services supporting batch, near-real-time, and event-driven data ingestion and transformation workflows. - Collaborate closely with architects, business analysts, product managers, and partner engineering teams across CRIMS and the broader Alpha Platform to deliver simple, sustainable solutions to complex problems. - Develop, test, debug, and deploy software primarily using Java, SQL, and related cloud-native technologies. - Perform code reviews and provide informed guidance on design and implementation decisions. - Write unit, integration, and automation tests to ensure a high-quality, reliable platform. - Troubleshoot and resolve issues in distributed, cloud-based production systems, including root-cause analysis for mission-critical client implementations. - Support and enhance existing internal Java-based import/export frameworks (built on Java and Pentaho Kettle) and enterprise integration frameworks built using Talend integrations as part of overall data platform ownership. - Participate actively in the agile development process, including daily standups, sprint planning, backlog grooming, and retrospectives. - Mentor and guide junior engineers, demonstrating increasing independence in design and development. - Produce and maintain technical documentation, design artifacts, and operational runbooks. Qualifications: - Education: - B.S. degree (or foreign education equivalent) in Computer Science, Engineering, Mathematics, Physics, or a related technical field required. - M.S. degree preferred. - Experience & Technical Skills: - 12 years of professional software engineering experience. - Experience designing and developing cloud-native services, preferably on Microsoft Azure. - Hands-on experience with microservices architectures, serverless technologies, and event-driven systems. - Strong proficiency in Java; experience with Spring-based frameworks is a plus. - Solid experience with SQL and data-intensive applications. - Understanding of modern data integration architectures, data transformation, and data quality concepts. - Knowledge of cloud infrastructure and deployment concepts, including networking, security, identity, configuration, and secrets management. - Experience with CI/CD pipelines, Git-based source control, and automated testing frameworks. - Ability and willingness to ramp up quickly on internal Java-based import/export frameworks (built on Java and Pentaho Kettle) and enterprise integration frameworks built using Talend for ongoing development and production support. - Demonstrated problem-solving ability in multi-tiered, high-performance, mission-critical systems. - Nice to Have: - Hands-on experience with Azure services such as Azure Functions, Storage, Key Vault, Service Bus, and monitoring/observability tools. - Experience with containerization and orchestration technologies (Docker, Kubernetes). - Familiarity with modern cloud data platforms such as Snowflake or similar technologies. - Experience working in financial services or with large-scale enterprise data platforms. - Prior experience supporting client-facing, production-critical systems. - Soft Skills: - Strong analytical and problem-solving skills. - Excellent written and verbal communication skills. - Ability to work effectively with peers in a collaborative, globally distributed team environment. - Comfortable balancing new framework development with ownership and support of existing enterprise platforms. (Note: The additional details about the company were omitted as they were not explicitly mentioned in the provided job description.) Role Overview: You are seeking a Data Integration Engineer to design, build
More at State Street