data engineer

Data engineer Remote Required Skills : ALL REQUIRED - Azure, Azure Databricks, SQL, Python, Pyspark Basic Qualifications : Additional Skills : Azure Data Factory Job Description : Data Engineer 100% Remote - EST Hours Data programmer – versed in Python, Spark, SQL – Pandas, PySpark, SparkSQL are all ideal. Heavily immersed in Azure databricks, Azure DevOps, 100% Azure cloud environment. Exposure to how Azure development pipeline environments work, how to work within an Azure DevOps environment. Azure Data lake, knowledge of datafactory is a plus Structured and unstructured data, managed instances of SQL, Structured data, JSON objects, consume and manipulate those NoSQL type skillset Front end is expanded through databricks – long-term that may change. SQL querying, some SQL programming, T-SQL does not come into play. Spark SQL Customer facing, day to day interfacing with the client – customer service focused Top Requirements: Python – Pandas, native PySpark libraries ideally. SQL – data reads and writes, SQL to pull data. Joins, reads, writes. Spark Azure – databricks ideally. Databricks Customer facing Nice to have: Azure Data Factory