Big Data Engineer

The successful candidate will build data solutions using state of the art technologies to acquire, ingest and transform big datasets. Resource will be responsible working a project to enhance and create capabilities around a mobile application that Investors use for an independent broker-dealer client. Design and build data pipelines to support applications and data science projects following software engineering best practice. Design and develop data applications using big data technologies to ingest, process, and analyze large disparate datasets. Build robust data pipelines on Cloud using Airflow, Spark/EMR, Kinesis, Kafka, Lambda or other technologies. Build the infrastructure required for optimal extraction, transformation, and loading of data from various data sources using SQL and AWS ‘big data’ technologies. Work with data and analytics experts to strive for greater functionality in our data systems. Implement architectures to handle large scale data and its organizat