Source description
About the role
Role: Big Data Engineer
Location: Remote
Duration: 12 Months (Only W2)
Job Description:
Key Job Responsibilities
Analyze data needs and objectives within the broader journey
Source, analyze and organize raw data, prepare data for transformation and consumption.
Develop analytical tools and content.
Identify ways to improve data governance, reliability, efficiency, and quality.
Build applications ensuring that the code follows latest coding practices and industry standards. Build using modern design patterns and architectural principles. Ensure developed solutions remain compliant with all applicable Prudential standards. Solve complex problems and provides new perspective on existing problems. Develop through collaboration and deliver application component solutions.
Develop high quality, well documented, and efficient code supporting testing and automation.
Support product owner in defining future stories and tech lead in defining technical designs.
Participate in design conversations and develop the business logic and backend systems of the MVP experience. Participates in the design conversations; conveys ideas within train and to groups outside of train.
Competencies – Knowledge, Skills, Abilities
Candidate with 5+ years of experience in a Data Engineer role who has attained a degree in Computer Science, Statistics, Informatics, Information Systems, or another quantitative field. Should have experience using following software/tools:
Build processes supporting data transformation, data structure, metadata, dependency, and workload management.
Successful history of manipulating, processing, and extracting value from large, disconnected structured and unstructured datasets.
Advanced working SQL knowledge and experience working with relational databases.
Experience building and optimizing data pipelines, architecture, and data sets.
Working knowledge of message queuing, stream processing, and highly scalable data stores.
Strong project management and organization skills.
Experience supporting and working with agile cross functional teams in a dynamic environment
Background in financial services functions strongly desirable.
Top 5 Skills Required:
Big data tools
Relational and NoSQL databases
Data pipeline and workflow management tools
AWS cloud services
Stream processing systems
Object oriented and scripting language
big data, Data pipeline, workflow
More at Prowesys