Source description
About the role
At EY, we’re all in to shape your future with confidence.
We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go.
Join EY and help to build a better working world.
Data Engineer with experience in Azure ADF, Databricks, PySpark, SQL and Power Bi
Key Responsibilities
Responsible for implementing secure, scalable, and highly available cloud-based solutions on Azure Cloud Analytics
Collaborate with internal and external stakeholders to understand their business requirements and translate them into technical solutions
Identify and implement automation opportunities to increase operational efficiency
Conduct knowledge sharing and training sessions to educate clients and internal teams on cloud technologies
Interact and collaborate with various teams (web Development/ MS Apps / API Development etc.) to deliver the products
Work very closely with Data Architects/Technical Managers in agile environment to identify and understand the problem statements and develop/prototype the solutions accordingly.
Should be able to work as Individual contributor
Experience in leading 2-4 member team
Technical Skills
4-8 years of experience in architecting big data solutions with proven track record in driving business success
Strong SQL Expertise and Hands-on experience
Strong PySpark Expertise and Hands-on experience
Expertise experience with integration of different Sources System (ERPs, Applications DBs, Cloud Systems and Sharepoint) using Azure Data Factory, Azure Synapse pipelines and ADLS. Strongs Hands on experience on ADF, ADLS and Synapse.
Good Hands on Experience on DataBricks and should be able to demonstrate the usecases for DataBricks usage
Good Understanding on Unity Catalog and Delta Lake concepts
Understanding of data modelling concepts and should be able to demonstrate various Data Modelling mechanisms
Exposure on Azure AI Fundamentals
Experience with BI, and data analytics databases
Exposure in working with NoSQL using MongoDB or similar
Experience in converting business problems/challenges to technical solutions considering security, performance, scalability etc.
Experience in real-time data ingestion from LIVE sources using Apache Kafka, Spark Streaming, EventHub and related technologies
Exposure on PowerBi or similar reporting tools and should be able to work with PowerBi team to achieve end goal.
Soft Skills
Flexible and proactive/self-motivated working style with strong personal ownership of problem resolution.
Strong verbal and written communication skills (written and verbal formal and informal).
Ability to multi-task under pressure and work independently with minimal supervision.
Must be a team player and enjoy working in a cooperative and collaborative team environment.
Adaptable to new technologies and standards.
Participate in all aspects of Big Data solution delivery life cycle including analysis, design, development, testing, production deployment, and support.
Minimum 3 years hand-on experience in one or more of the above areas.
Minimum 4 years industry experience
EY | Building a better working world
EY is building a better working world by creating new value for clients, people, society and the planet, while building trust in capital markets.
Enabled by data, AI and advanced technology, EY teams help clients shape the future with confidence and develop answers for the most pressing issues of today and tomorrow.
EY teams work across a full spectrum of services in assurance, consulting, tax, strategy and transactions. Fueled by sector insights, a globally connected, multi-disciplinary network and diverse ecosystem partners, EY teams can provide services in more than 150 countries and territories.
More at EY