Hadoop developer

Must Have:

1. 5+ years of experience with Big Data, Hadoop on Data ... Python scripts, PySpark programs, HDFS commands, HDFS file formats (Parquet, Avro, ORC etc.) - hadoop developer skills
2. Db2 sql
3. Snowflake (Nice to have)
4. Knowledge of USAA systems, ( Control-m, Servicenow, etc)…Also nice to have.

Job Requirements:

Primary Responsibilities:

• Identifies and manages existing and emerging risks that stem from business activities and the job role.

• Ensures risks associated with business activities are effectively identified, measured, monitored, and controlled.

• Follows written risk and compliance policies and procedures for business activities.

• Design and implement complex technical solutions.

• Design, build, manage and optimize data pipelines for data structures encompassing data transformation, data models, schemas, metadata, data quality, and workload management.

• Participate in daily standups and lead design reviews.

• Breakdown business features into technical stories and approaches.

• Analyze data and enable machine learning. Create proof of concepts and prototypes.

• Implement efficient defect management, root cause analysis, and resolution processes.

• Assist in setting technical direction for the team.

• Mentor and coach junior engineers.

Minimum Requirements:

• Bachelor's degree in related field of study, OR 4 additional years of related experience beyond the minimum required.

• And 6 years of data management experience (10 Years total work experience in lieu of a degree) implementing data solutions demonstrating depth of technical understanding within a specific discipline(s)/technology(s)

• Deep knowledge of a technology or product line.

When you apply for this position, you will be required to answer some initial questions. This will take approximately 5 minutes. Once you begin the questions you will not be able to finish them at a later time and you will not be able to change your responses.

Preferred Experience:

• Snowflake administration

• Security access monitoring

• Security management for Snowflake including: roles, service IDs and user access

• Database requests for new Snowflake compute Warehouses, schemas, and databases

• Document processes and guidelines

• Performance monitoring to include: Review high cost usage, provide feedback to users, and warehouse usage and size