Lead Data Engineer
As a Lead Data Engineer with the Data & Analytics team, you will be accountable for designing, and developing scalable and effective data architectures that align with overall business objectives. This will include implementing data ingestion, processing and presentation capabilities. This role will see you working closely with the stakeholders across our global business to deliver high-value solutions across all our departments and locations.
You will be working in a development environment that takes agility seriously and produces amazing technological solutions for the wider business. As a key member of our team, you will work very closely with product owners, senior technical team and end-users to deliver the best possible solutions with the latest techniques and tools.
Some of your duties will include:
-
Design & build data pipelines (Microsoft Fabric, Azure Data Factory, SSIS, stored procedures, Python, Databricks, C#) to ingest data from external systems
-
Design and build data lakehouse layers (Microsoft Fabric, Azure Datalake) and data warehouse layers (Azure SQL, SQL Server) to facilitate reporting
-
Design & build Power BI semantic models
-
Maintain existing platform and provide operational support
-
Lead and mentor a team of data engineers and provide technical guidance
-
Define standards, processes and practices for the data engineers to follow. Ensure seamless integration between different data systems and platforms
-
Identify and address performance bottlenecks and optimize data processing performance
Some of the essential skills you’ll have are:
-
Bachelor’s degree or equivalent qualification in Business Information Systems, Information Technology, or related field
-
Minimum of 3+ years analytical solutions using Microsoft SQL Server Stack, Azure SQL or Microsoft Fabric
-
Excellent T-SQL and Python skills
-
Experience (3+ years) with modern data warehouses/data lakes, relational databases, dimensional modelling and Kimball methodology
-
Experience with source control (Git)