Padmi
Morningstar logo
Morningstar

investment data and analytics · public markets research

Director- Engineering, Data Collection Technology

MumbaiPosted 3 months ago
Engineering ManagementStaff+Full Time; Regular
Apply at Morningstar

Opens the source posting on shine.com

Source description

About the role

View original

The Data Collections Technology team at PitchBook is responsible for architecting, building, and operating the unified Acquisition, Processing, and Management Platforms. As a Director of Data Collections Technology, your role will involve defining and executing the comprehensive technology strategy for acquiring, processing, and integrating PitchBooks proprietary public and private market data. You will lead a diverse, global organization of Engineers driving both architectural innovation and operational excellence for mission-critical systems. Your leadership will guide the design, deployment, and optimization of the entire technology ecosystem, ensuring production-grade reliability and directly powering PitchBooks data ingestion and platform accuracy. Primary Job Responsibilities: - Define and execute the unified platform technology strategy for data acquisition, processing, and management across the organization with an AI first mindset. - Partner with senior leadership to define the multi-year engineering roadmap that drives scalability, reliability, and cost-efficiency in data collection. - Establish and own operational KPIs for platform throughput, latency, and system availability cross all production environments. - Lead, hire, and develop a high-performing team of platform and software engineers; define clear roles and technical career progression. - Foster a culture of engineering excellence, ownership, and accountability for critical production systems across distributed offices. - Champion hiring, technical mentorship, and professional development initiatives to grow internal platform engineering talent. - Act as a multiplier by shaping and enforcing best practices for distributed systems design, CI/CD, and data pipeline governance. - Collaborate closely with Engineering, Product, and Data Operations to ensure seamless delivery and integration of core platform services into collection workflows. - Partner with data quality and governance teams to define and embed platform-level data quality frameworks and compliance standards. - Serve as the trusted technical and strategic advisor on data collection platform capabilities to stakeholders across the business. - Oversee the end-to-end lifecycle of the unified data collection platform, from architectural planning to deployment, monitoring, and optimization. - Ensure high availability, nine-nines reliability, and performance of all mission-critical production platform services. - Implement and maintain strong standards of data integrity, security, and governance across all platform components and data pipelines. Skills and Qualifications: - Bachelors or Masters degree in Computer Science, Software Engineering, or a related technical discipline (Masters degree preferred). - 12+ years of experience in large-scale software engineering or platform architecture, including 7+ years leading technical teams; experience managing managers and geographically distributed teams is strongly preferred. - Proven success designing and delivering high-throughput, low-latency data ingestion and processing platforms at scale within a commercial environment. - Deep, practical expertise in distributed systems architecture, data modeling, and designing for system reliability and fault tolerance. - Expert-level knowledge of cloud-native architecture, containerization, and modern infrastructure-as-code principles. - Proficiency in managing and optimizing large-scale ETL/ELT pipelines and ensuring data governance and integrity within a complex, regulated data environment. - Strong understanding of DataOps and MLOps principles as they apply to platform tooling. - Demonstrated ability to define, communicate, and execute multi-year platform engineering roadmaps with measurable business impact. - Excellent communication, collaboration, and influencing skills. - A track record of fostering technical excellence, quality assurance, and a security-first mindset across global teams. - Experience in fintech, core data platforms, or large-scale information extraction systems is preferred. - Contributions to the platform engineering community are a strong plus. Morningstar is an equal opportunity employer. The Data Collections Technology team at PitchBook is responsible for architecting, building, and operating the unified Acquisition, Processing, and Management Platforms. As a Director of Data Collections Technology, your role will involve defining and executing the comprehensive technology strategy for acquiring, processing, and integrating PitchBooks proprietary public and private market data. You will lead a diverse, global organization of Engineers driving both architectural innovation and operational excellence for mission-critical systems. Your leadership will guide the design, deployment, and optimization of the entire technology ecosystem, ensuring production-grade reliability and directly powering PitchBooks data ingestion and platform accuracy. **Primary Job

One address, no account. We’ll tell you when matching roles go live.

More at Morningstar

Related open roles

View all roles