Padmi

Lead Data Engineer - Data Archival - Bangalore

BangalorePosted 2 months ago
Software engineeringSeniorFull Time; Regular
Apply at Photon

Opens the source posting on shine.com

Source description

About the role

View original

Missions Job description: Our team Data-as-a-service is expanding, and we need 3 big data experts to join us! Today we manage SG Data platform service offers and data tools: Data ingestion: to ingest the data from a data source Data processing: to process, transform and distribute the data to the target location Data exposition : to distribute and expose the data hosted in the data platform Data cleaning: to purge the data on the Lake in a secure way Data tools: data formatter, data anonymizer As a big data engineer, youll develop, maintain and create new cloud-oriented features hand-by-hand with DDS/Data Foundation teams to bring forward the data approach across all SG entities and subsidiaries. Profile Experience: 3-5 Years Skills: - Computer programming: Spark, Scala, Java, Python - Operating system knowledge for Unix, Linux - Databases and SQL - ETL and data warehousing - Hadoop - Apach Spark Tasks: Maintain an excellent service level of the platform and avoid issues. Researching new methods of obtaining valuable data and improving its quality Creating and enhancing data solutions using various programming languages and tools Creating and enhancing data architectures that meet the requirements of the business Communicate inside if the tech league group to find new approaches Missions Job description: Our team Data-as-a-service is expanding, and we need 3 big data experts to join us! Today we manage SG Data platform service offers and data tools: Data ingestion: to ingest the data from a data source Data processing: to process, transform and distribute the data to the target location Data exposition : to distribute and expose the data hosted in the data platform Data cleaning: to purge the data on the Lake in a secure way Data tools: data formatter, data anonymizer As a big data engineer, youll develop, maintain and create new cloud-oriented features hand-by-hand with DDS/Data Foundation teams to bring forward the data approach across all SG entities and subsidiaries. Profile Experience: 3-5 Years Skills: - Computer programming: Spark, Scala, Java, Python - Operating system knowledge for Unix, Linux - Databases and SQL - ETL and data warehousing - Hadoop - Apach Spark Tasks: Maintain an excellent service level of the platform and avoid issues. Researching new methods of obtaining valuable data and improving its quality Creating and enhancing data solutions using various programming languages and tools Creating and enhancing data architectures that meet the requirements of the business Communicate inside if the tech league group to find new approaches

One address, no account. We’ll tell you when matching roles go live.

More at Photon

Related open roles

View all roles