Data Engineer

Job summary

Please note this role requires you to pass Security Check clearance. For further information, please see 'Selection process details'.

Are you an experienced Data Engineer with strong Analytical skills?

Do you want to utilise best in class technologies to deliver exceptional cloud-based data products for Data Analysts and Scientists?

DWP’s Digital Group is looking for experienced Data Engineers to fill post in Management Information (MI) team.

The MI team provides strategic capabilities for MI reporting and data visualisations across DWP. Working with modern cloud environments alongside legacy on-premises technologies, you’ll play a key role in developing the DWP Data Engineering Strategy for MI products and services.

Successful candidates will join a fast-paced environment with a wide portfolio of products for analytical use and a challenging delivery roadmap. You’ll focus on a variety of tasks, supporting platform live service and delivering high quality, data transformation products.

Job description

• Building and maintain scalable data engineering solutions that power analytical reporting, working in line with DWP’s engineering standards.
• Collaborating with stakeholders across DWP to gather and clarify requirements where needed and translate them into scalable back-end data processes that support MI reporting needs.
• Maintaining comprehensive technical documentation and collaborative workspaces in Confluence to improve transparency, knowledge sharing, and onboarding.
• Working closely with other junior data engineers to provide guidance, share technical expertise, and actively support ongoing knowledge sharing.
• Reviewing code developed by fellow engineers to ensure quality, maintainability, and adherence to DWP coding standards.

Person specification

See selection process for further details.

If you would like to learn more about the role, please contact [email removed].

Technical skills

We'll assess you against these technical skills during the selection process:

• Technical Breadth

Benefits

Alongside your salary of £44,447, Department for Work and Pensions contributes £12,876 towards you being a member of the Civil Service Defined Benefit Pension scheme. Find out what benefits a Civil Service Pension provides (opens in a new window).

We also have a broad benefits package built around your work-life balance which includes:

• Working patterns to support work/life balance such as job sharing, term-time working, flexi-time and compressed hours.
• Generous annual leave – at least 25 days on entry, increasing up to 30 days over time (pro–rata for part time employees), plus 9 days public and privilege leave.
• Support for financial wellbeing, including interest-free season ticket loans for travel, a cycle to work scheme and an employee discount scheme.
• Health and wellbeing support including our Employee Assistance Programme for specialist advice and counselling and the opportunity to join HASSRA a first-class programme of competitions, activities and benefits for its members (subscription payable monthly).
• Family friendly policies including enhanced maternity and shared parental leave pay after 1 year’s continuous service.
• Funded learning and development to support progress in your role and career. This includes industry recognised qualifications and accreditations, coaching, mentoring and talent development programmes.
• An inclusive and diverse environment with opportunities to join professional and interpersonal networks including Women’s Network, National Race Network, National Disability Network (THRIVE) and many more.

Hybrid Working

This role may be suitable for hybrid working, which is where an employee works part of the week in their DWP office and part of the week from home. This is a voluntary, non-contractual arrangement and your office will be your contractual place of work.

If a hybrid working arrangement is suitable for the role and for you, you will normally be required to spend a minimum of 60% of your contracted working hours from your DWP office.

If you have a disability, caring responsibilities, or other circumstances that may affect your ability to meet the minimum office attendance requirement, please discuss this with us using the contact details in this advert.

Salary Information

Pay for this role in National locations is from £44,447 to £54,813.

The maximum salary for the grade is £46,547, however a Digital Allowance of up to £8,266 per annum is available for exceptional candidates. Digital Allowance is non-salary, and non-pensionable, and is classed as a temporary allowance. It is reviewed annually where it could be retained, amended, or removed.

Pay for this role in London is from £50,044 to £51,528.

Our offer to successful candidates will be based on an assessment of your skills and experience as demonstrated at interview.

Existing Civil Servants who secure a new role on lateral transfer will maintain their current substantive salary.

Civil Servants who gain promotion will move to the bottom of the grade pay scale or receive a 10% increase applied to their current substantive salary, whichever is greater.

Any temporary allowances that you are currently in receipt of will not form part of the calculation to determine your pay. Any allowances that are in payment will cease when you move into your new role.

Things you need to know

Artificial intelligence

Artificial intelligence can be a useful tool to support your application, however, all examples and statements provided must be truthful, factually accurate and taken directly from your own experience. Where plagiarism has been identified (presenting the ideas and experiences of others, or generated by artificial intelligence, as your own) applications may be withdrawn and internal candidates may be subject to disciplinary action. Please see our candidate guidance (opens in a new window) for more information on appropriate and inappropriate use.

Selection process details

This vacancy is using Success Profiles (opens in a new window), and will assess your Experience and Technical skills.

Stage 1: Application

Your application will consist of four parts:

1. A Personal Details application form.

2. Employment history - this should contain your work experience and any skills, qualifications and accomplishments relevant to the jobs you have completed.

3. Personal statement - up to 750 words. This statement should be used to provide examples of how you meet the essential criteria below:

• Practitioner: Ability to orchestrate PySpark jobs on EMR, managing dependencies, workflow execution, and operational efficiency.
• Working: Knowledge of designing event-driven architectures, leveraging AWS Lambda functions to trigger PySpark workflows based on real-time data ingestion and processing needs.
• Practitioner: Experienced in provisioning cloud infrastructure using Amazon EC2