Source description
About the role
Job Details Responsibilities: * Design, develop, and maintain complex ETL transformations using advanced SQL * Process and transform large-scale datasets (millions of rows) efficiently and reliably * Build and optimize SQL-based data transformations leveraging CTEs and window functions * Support and enhance data pipelines running in an AWS-based environment * Work with SQL-driven Spark workloads where applicable * Utilize template-based shell and Python scripts to support ETL workflows * Collaborate across distributed teams to support evolving data needs and priorities * Troubleshoot performance and data quality issues across ETL processes REQUIREMENTS: * Strong, hands-on experience with advanced SQL, including CTEs and window functions * Proven experience working with large datasets at scale * Experience performing ETL transformations in production environments * Familiarity with AWS data services, particularly Athena and/or EMR * Ability to work in an agile environment with shifting priorities and multiple workstreams Preferred Skills: * Python scripting experience * Shell scripting experience * Experience working with Spark (SQL-based Spark workloads preferred) * Exposure to AWS analytics and big data services
More at Artifint Technologies