Source description
About the role
Required Qualifications
Bachelor's or Master's degree in Computer Science, Engineering, or related field. 5+ years of experience as a data engineer building ETL/ELT data pipelines. Experience with data engineering best practices for the full software development life cycle, including coding standards, code reviews, source control management (GIT, continuous integrations, testing, and operations) Experience in programming language Python and SQL good to have Java, C#, C++, Go, Ruby, and Rust Experience with Agile, DevOps & Automation [of testing, build, deployment, CI/CD, etc.], Airflow Experience with Docker, Kubernetes, Shell Scripting 2+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud) 3+ years experience with distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL) 2+ years experience working on real-time data and streaming applications 2+ years of experience with NoSQL implementations (DynamoDB, MongoDB, Redis, Elasticache) 2+ years of data warehousing experience (Redshift, Snowflake, Databricks, etc.) 2+ years of experience with UNIX/Linux including basic commands and shell scripting Experienced with visualization tools like SSRS, Excel, PowerBI, Tableau, Google Looker, Azure Synapse
More at Thoughtwave Software and Solutions