Cloud Engineer

Job Description: Skills: Spark/Scala/Airflow/Python/Java/Azure/AWS/GCP/Shell/SQL/Lead

Project Summary: Building a Batch Data Processing product that would include below high-level requirements (Engineer would help in doing below activities): A Self-service Metadata driven framework centered on data extraction, data harmonization, data integrity, auditing, balance & controls, enrichments, storage. BDP supports First Mile, Second Mile, Data Butler & Data Export products. Highly scalable data management solution for offline data processing and storage. Opensource technologies: Airflow, Spark, Java, Python, Scala, SQL, Cloud etc Top 5-10 responsibilities:

Hands on Java/Scala Development building data pipeline frameworks Hands on Cloud experience to deploy and manage container workloads Hands on SQL Agile Development Offshore/onsite experience Required skills/technologies:

Spark/Scala Python Java Cloud (Azure/AWS/GCP) Scripting (Shell/SQL) Preferred skills/attributes:

Airflow Infrastructure and Development experience Kubernetes

A cloud engineer is an IT professional responsible for any technological duties associated with cloud computing, including design, planning, management, maintenance and support. Job Responsibilities for Cloud Engineer: Installs and maintains cloud-based applications, systems, and associated infrastructures. Translates business requirements into code and documentation while managing the life-cycle and communication for assigned projects. Analyzes and defines business requirements to determine specifications and standards. Oversees the proper implementation and integration of web and cloud-based applications. Stays informed of emerging cloud technologies and evaluates the value to the organization’s operations. Monitors system performance, troubleshooting and resolving errors. Ability to consult with internal and external resources to develop cloud solutions for a range of products. Ensures quality of the solutions are robust, scalable and efficient to meet the needs of the business.

Knowledge and Skills for Cloud Engineer: Requires experience with one or more cloud platform. Experience working with large infrastructure hosting environments including knowledge of Application Hosting, distributed messaging architectures, network technologies (Ex: VPNs, TCP/IP, Firewalls, Routing, etc.), security technologies (Ex: public key cryptography and infrastructure, smart cards, authentication, authorization, etc.). Demonstration of thorough understanding of how discrete infrastructure components work together to provide reliable and secure hosting environment. Vast understanding of cloud services and solutions in platforms such as Azure or AWS Comprehensive understanding of IT security best practices and threat protection Must have a good understanding of connected embedded systems tradeoffs, protocols, etc