Software Development Engineer II - Data & Reporting

As a Software Development Engineer II (SDE2) at Editorialist, you will play a crucial role in our Data & Reporting team, focusing on transforming raw data into actionable insights that drive business decisions across various domains. Here is what you will be responsible for: - Designing and implementing scalable data pipelines using Spark (Scala/PySpark) and managing workflows in Databricks. - Working with structured/unstructured data to create curated data layers (bronze, silver, gold) for different reporting needs. - Developing and maintaining integrations with internal APIs and external data sources for data ingestion and transformation. - Collaborating with cross-functional teams to deliver dashboards and reports using BigQuery and Looker. - Partnering with backend teams and data stakeholders to enhance data quality, lineage, and performance. - Troubleshooting data discrepancies and ensuring timely delivery of critical reports to business stakeholders. To excel in this role, you should have: - 3+ years of experience in a similar data engineering or backend-focused role. - Strong programming skills in Scala, Python, and/or Java. - Solid understanding of Apache Spark, Databricks, and big data processing. - Experience with Google BigQuery, Looker, or other BI/reporting tools. - Working knowledge of backend development, including Java/Python, RESTful APIs, and MySQL/PostgreSQL. - Experience with batch and near-real-time data pipelines, preferably on GCP or other cloud platforms. - Strong problem-solving skills and the ability to work independently in a remote setup. Bonus points if you have: - Familiarity with Airflow or other orchestration tools. - Experience in fashion or e-commerce domains. In return, you can expect: - Best in class compensation and benefits. - A fast-paced, tech-savvy start-up environment where your code makes a real-world impact. - Exposure to international teams across the US, Europe, and Asia. - Flexible work culture with a home office setup allowance and health insurance for yourself and your family. As a Software Development Engineer II (SDE2) at Editorialist, you will play a crucial role in our Data & Reporting team, focusing on transforming raw data into actionable insights that drive business decisions across various domains. Here is what you will be responsible for: - Designing and implementing scalable data pipelines using Spark (Scala/PySpark) and managing workflows in Databricks. - Working with structured/unstructured data to create curated data layers (bronze, silver, gold) for different reporting needs. - Developing and maintaining integrations with internal APIs and external data sources for data ingestion and transformation. - Collaborating with cross-functional teams to deliver dashboards and reports using BigQuery and Looker. - Partnering with backend teams and data stakeholders to enhance data quality, lineage, and performance. - Troubleshooting data discrepancies and ensuring timely delivery of critical reports to business stakeholders. To excel in this role, you should have: - 3+ years of experience in a similar data engineering or backend-focused role. - Strong programming skills in Scala, Python, and/or Java. - Solid understanding of Apache Spark, Databricks, and big data processing. - Experience with Google BigQuery, Looker, or other BI/reporting tools. - Working knowledge of backend development, including Java/Python, RESTful APIs, and MySQL/PostgreSQL. - Experience with batch and near-real-time data pipelines, preferably on GCP or other cloud platforms. - Strong problem-solving skills and the ability to work independently in a remote setup. Bonus points if you have: - Familiarity with Airflow or other orchestration tools. - Experience in fashion or e-commerce domains. In return, you can expect: - Best in class compensation and benefits. - A fast-paced, tech-savvy start-up environment where your code makes a real-world impact. - Exposure to international teams across the US, Europe, and Asia. - Flexible work culture with a home office setup allowance and health insurance for yourself and your family.