Senior Data Engineer, SEO, Perm, Liverpool/ Newport

Job summary

Job Purpose

As a member of the multi-skilled DDaT function, the Senior Data Engineer designs, builds and maintains the data pipelines, integrations and data processing services that underpin both the Commission’s operational systems and its analytical data estate. The role helps shape the evolution of the Commission’s data platform by applying solid data engineering and modelling practices to ensure data is structured, reusable and well-governed.

The Senior Data Engineer designs and develops data flows and transformations across products and platforms, including the SQL logic, stored procedures and views needed to prepare and structure data for use across services and analytical workloads. The role also contributes to evolving the Commission’s Azure data platform, including the use of Synapse and layered data architecture approaches where appropriate.

As a senior member of the engineering capability, You will provide technical leadership, mentoring and promote consistent engineering standards, patterns and best practice across delivery teams.

Job description

Key responsibilities:

1. Programming and Build (Data Engineering) You will design, build, test and maintain scalable data pipelines and data processing solutions using modern engineering practices.
2. Data Integration You will design and implement data ingestion and integration patterns across Azure services, ensuring they are secure, efficient and maintainable.
3. Data Modelling Apply data modelling principles to develop models that support analytics and operational use, working with analysts and architects to ensure accuracy and usability.
4. Data Standards and Best Practice Improve data engineering standards, coding conventions and design patterns, ensuring consistency across pipelines and services.
5. Technical Leadership Mentor data engineers, review code and pipelines, and provide guidance on data engineering best practice across delivery teams.
6. Problem Resolution (Data) Investigate, diagnose and resolve data issues, ensuring root cause analysis and preventative measures are implemented.
7. Performance and Reliability Engineering You Will monitor, optimise and troubleshoot data pipelines and storage solutions to ensure reliable, performant and cost-effective services.

Person specification

Essential Criteria

Ability:

• Technical problem-solving able to diagnose and resolve complex data issues and deliver robust solutions.
• Collaboration able to work effectively with engineers, analysts, architects and service teams.
• Communication able to explain data engineering concepts to technical and non-technical stakeholders.
• Attention to detail able to ensure data quality, accuracy and reliability.
• Technical leadership provided across delivery teams by guiding design decisions, reviewing pipelines and code, and ensuring alignment with agreed standards, patterns and architectural guardrails.

Experience:

• Designing and building data pipelines using modern cloud data platforms (e.g. Azure Synapse, Data Factory, Databricks).
• Developing performant SQL-based transformations and ELT patterns.
• Working with relational and/or big data technologies.
• Using CI/CD, version control and automated testing in data engineering workflows.
• Supporting a data platform across multiple environments including production.

Technical:

• Strong SQL and data transformation skills.
• Proficiency in Azure data tools (e.g., ADF, Synapse, Delta Lake, Data Lake Gen2).
• Knowledge of ETL/ELT principles and data integration patterns.
• Familiarity with infrastructure-as-code, DevOps practices and monitoring.
• Experience with Python, PySpark or similar languages desirable.

Behaviours

We'll assess you against these behaviours during the selection process:

• Changing and Improving
• Delivering at Pace
• Communicating and Influencing

Benefits

Alongside your salary of £44,027, Charity Commission contributes £12,754 towards you being a member of the Civil Service Defined Benefit Pension scheme. Find out what benefits a Civil Service Pension provides (opens in a new window).

This is your chance to make a contribution that really matters and to make an impact in an organisation where your voice will be heard and your hard work noticed.

Watch this short video to find out more about us.

We operate a flexible hybrid working policy where office attendance is combined with at least 3 days homeworking per week dependent on role requirements.

We recognise everyone as an individual, accepting people for who they are and treating everyone fairly. We welcome the unique contribution diverse applicants bring from all backgrounds and we aim to have a workforce that represents the wider society that we serve. We champion inclusion and wellbeing, aiming to create a workplace where everyone feels valued and has a sense of belonging.

We do not discriminate on the basis of culture, ethnicity, race, nationality or national origin, age, sex, gender identity or expression, religion or belief, disability status, sexual orientation, educational or social background or any other factor.

We offer access to the highly competitive Civil Service Pension Scheme (employer contributions of 28.97%), far more than in the private sector, and a flexible, family-friendly environment. Additionally you can look forward to other great benefits via our ‘Perkbox’ and ‘Edenred’ schemes. These include everything from an interest-free season ticket loan and bicycle loan (after two months) to discounts on gym membership, cinema tickets and restaurants. Please see the attached Charity Commission benefits document.

A minimum of 25 days of paid annual leave, increasing by one day per year up to a maximum of 30 days per year.

The Charity Commission’s operational ambition is to realise the Commission’s values of being an expert regulator that is fair, balanced, and independent, which works in a way that is supportive, collaborative, and innovative to achieve our ambitions. We want to develop our capability to regulate charities to realise this goal and meet our statutory and public duties to ensure that charity in England and Wales can deliver maximum benefit to society in a way that upholds its reputation in the eyes of the public.

Work at the Charity Commission and you’ll make a difference every day to:

• The 170,000 charities of all shapes and sizes that we regulate across England and Wales.
• The trustees we partner with and advise.
• The people and causes that benefit from the £10bn generously donated each year by the public.

Find out more about working for us here.

To note: Any move across the Civil Service on or after 4 October 2018 may have implications on an employee’s ability to carry on claiming childcare vouchers.

Visa Sponsorship

Please note that we are currently unable to offer Skilled Worker Sponso