Azure Data Engineer
Role:
• Identify the necessary data sets for each Use Case in cooperation with the Source Teams and Business Analysts.
• Incorporate data into the Enterprise Data Lake.
• Transfer and convert data from the Data Lake to SQL databases or SQL Data Warehouses as needed for each Use Case.
• Apply logic according to business requirements, such as defining Key Performance Indicators (KPIs).
• Work closely with other IT delivery teams to develop a comprehensive solution for a given Use Case.
• Manage the life cycle of the delivered use cases.
Essential requirements:
• Experience with the Microsoft Azure Platform (Data Lake, Data Factory, Databricks, Data Warehouse, Azure DevOps)
• Experience in DataBase and Information Modelling
• Experience with data wrangling using SQL and Python (R is a bonus)
• Experience with the Apache Spark Framework (preferably PySpark - Python)
• Experience with scripting languages such as Python and PowerShell (C#/.NET)
• Experience integrating systems and services
• Experience consuming REST APIs
• Experience developing REST APIs (preferably with Flask - Python)
• Experience with Docker containers
Please explain how you meet all the requirements when applying.
Utilization: 100%
Location: Lund 3 days/week
Period: 06-11-2023 - 29-11-2024(with a good chance of extension)
Last day to apply: 03-11-2023
We present regularly. This means that we sometimes remove the assignements from our website before the final application deadline. If you are interested in an assignement, we recommend that you submit your application as soon as possible.
If the above job description does not suit you, do not hesitate to Connect with us to learn about future assignments!