skip navigation
skip mega-menu

Data Engineer - ONS - SEO

Government Digital & Data -

Full-time (Permanent)
£39,394 - £47,672
Published on
31 October 2024
Deadline
14 November 2024

Job summary

This is an exciting opportunity to join one of several Data Engineering teams within the Office for National Statistics (ONS). We're looking for Data Engineers to build cutting edge data products and pipelines that provide high quality data for analysts at the ONS in a timely, consistent, auditable, and reproducible way.

This role will deliver standardised and engineered external and internal key strategic data sources needed for national statistics. Also, at times delivering rich and timely datasets, at ONS and across government in response to national events; for example, having a key role in providing COBR and the Cabinet Office key data insights during COVID and enabling cost of living crisis experimental statistics, and building cross-government Integrated Data Sharing platform (IDS), which form a pillar of the current national infrastructure priorities.

Job description

Our tech stack is Python, PySpark and SQL. On the cloud we work with Google Cloud Platform (GCP) cloud or Amazon Web Services (AWS) with Cloudera.

We’re looking for someone with technical skills but also a great attitude, who is proactive, takes pride in the quality of their work and has an eagerness to develop their technical skills to the next level. We welcome applications from varied technical backgrounds including but not limited to: data analysis, data science, software engineering or related technical disciplines.

As well as day-to-day processing and delivery we work as a team to develop the capability of the organisation – developing reusable and increasingly automated code, tools, and best practice so that we and others across the organisation can build the data pipelines needed to support the growing work of a changing organisation. Your work will include data cleansing, validation, and enhancement processes to refine the quality and integrity of the data and prepare this for onward linkage.

We continue to invest in the development of our staff with internal and external training opportunities and encourage training and development so that we can stay on top of changing technology.

You will receive training & support in learning any aspects of our tech stack you are unfamiliar or less skilled in. This will include peer working with an experienced member of the team who is experienced in that tech stack and the way in which we work.

Responsibilities

Responsibilities include but are not limited to:

  • Designing and building robust data pipelines, ETL processes and contributing to a data validation package.
  • Working with a diverse team to achieve common goals but also working independently and planning own work.
  • Upholding a high standard of work, using established Data Engineering best practices agreed at the team level for coding, peer reviewing, testing and documentation, but also actively seeking and suggesting improvements.
  • Investigating and resolving data quality issues by implementing appropriate solutions.
  • Identifying areas of innovation and keeping up with the latest best practices and tools from across the industry.
  • Proactively using self-development time to grow your own technical and non-technical skillsets.
  • Learning and becoming an expert in at least one of our tools of your choosing, which aligns with the needs of the project.
  • Contributing to both the immediate team and the wider Data Engineering team. This could look like: sharing relevant knowledge, contributing to team-wide projects, or leading a session on a new process or technology.

Person specification

Essential Skills Criteria:

  • Programming and Build: You know how to use agreed standards and tools to design, code, test, correct and document moderate-to-complex programs and scripts from agreed specifications and subsequent iterations. You can collaborate with others to review specifications where appropriate. Although strong demonstration of technical abilities with other tools will be considered, experience in Python, PySpark, SQL and GIT are preferred.
  • Data Development Process: You can design, build and test data products that are complex or large-scale. You know how to build teams to complete data integration services.
  • Problem Resolution: You know how to respond to problems in databases, data processes, data products and services as they occur. You can initiate actions, monitor services and identify trends to resolve problems. You can determine the appropriate remedy and assist with implementation of it as well as preventative measures.
  • Communicating between the technical and non-technical: You know how to communicate to and between technical and non-technical stakeholders as well as facilitate discussions within a multidisciplinary team, with potentially difficult dynamics. You can advocate for the team externally. You know how to manage different perspectives.

Behaviours

We'll assess you against these behaviours during the selection process:

  • Delivering at Pace
  • Working Together

Technical skills

We'll assess you against these technical skills during the selection process:

  • Programming and Build
  • Problem Resolution
  • Data Development Process

Benefits

Alongside your salary of £39,394, Office for National Statistics contributes £11,412 towards you being a member of the Civil Service Defined Benefit Pension scheme. Find out what benefits a Civil Service Pension provides.

The Office for National Statistics is part of the Civil Service, and as such we share a number of key benefits with other departments, whilst also having our own unique offerings to support our 5400 valued colleagues across the business.

This role is part of the cross-government Government Digital and Data (formerly DDaT) profession framework. As a role within Government Digital and Data (formerly DDaT) at the ONS, we also offer benefits such as:

• Protected Learning Time to spend on your personal development and side-projects.

• A supportive and active Community of Practice which you will be expected to contribute to, helping ensure you and your colleagues get the training, development and opportunities you need to progress your careers.

ONS are committed to flexible ways of working that support a healthy work-life balance. ONS has already considered how this job could be right sized for applicants working flexibly and we are happy to explore options with you about working part time, in a job share or flexibly, in line with our hybrid working policies. 

Whether you are hearing about us for the first time or already know a bit about our organisation, we hope that the benefits pack attached (bottom of page) will give you a great insight into the benefits and facilities available to our colleagues and our fantastic working culture.

 

Inclusion & Accessibility

At ONS we are always looking to attract the very best people from the widest possible talent pool, and we are proud to be an inclusive, equal opportunities employer. As a member of the Business Disability Forum and a Disability Confident Leader we’re committed to ensuring that all candidates are treated fairly throughout the recruitment process.

As part of our application process, you will be prompted to provide details of any reasonable adjustments to our recruitment process that you need. If you would like to discuss any reasonable adjustments before applying, please contact the recruitment team in the first instance.

If you would like an accessible version of any of the attachments or recruitment documents below or linked to in this advert, please contact the recruitment team who will be happy to assist.

Things you need to know

Selection process details

This vacancy is using Success Profiles (opens in a new window), and will assess your Behaviours, Experience and Technical skills.

Security Clearance  

The requirement for SC clearance is to have been present in the UK for 3 consecutive years immediately prior to applying.  

A lack of UK residency in itself is not always a bar to security clearance, but the Department will need to consider eligibility by exception on a case-by-case basis. You will be asked to provide information regarding your UK residency during your application, and failure to provide this will result in your application being rejected.  

If you are unsure that you meet the eligibility above, please read the information available on Gov.uk on this link, or contact the recruitment email on the advert before applying to discuss, as failure to meet the residency requirements will result in your security clearance application being rejected and any offer of employment being withdrawn.  

 At the point of SC application, you will need to provide or give access to the following evidence:  

  • Departmental or company records (personnel files, staff reports, sick leave reports and security records) 
  • UK criminal records covering both spent and unspent criminal records 
  • Your credit and financial history with a credit reference agency 
  • Security Services records

Please note that in the future the security level of these roles may need to be increased to Developed Vetting (DV). This will be dependent on the nature of the work being carried out and will be discussed with you in advance should this be required.

We may also reach out to you mid-campaign to confirm eligibility for this role.

Applicant support

Applicants may utilise AI resources in their submissions; ensuring all information provided is factually accurate, truthful, and original, avoiding any form of plagiarism to maintain the authenticity and credibility of the application process. 

Stage 1 – Application & Sift 

Assessment at application stage will be based on your CV, work history, skills, experience and the responses you provide to the two questions in the application form.

The two questions in the application form will have a limit of 500 word limit for each response.

Your CV should be tailored to demonstrate any skills, knowledge and experience that are relevant to the content of the role detailed in the essential skills. More details are found in the role profile which is attached. 

In cases where there is a high number of applications the sift pass mark may be adjusted and candidates will be invited to interview in merit order, i.e. those scoring the highest.

Stage 2 – Interview

Should you be invited to interview, you will be assessed using various assessment techniques aligned to the Civil Service Success Profiles framework, where you'll be assessed against all the behaviours outlined in this advert. 

Interviews will be conducted by Video Conference.

A reserve list may be held for a period up to 12 months from which further appointments may be made.

We often have similar roles available at different grades. If a candidate is suitable for a similar role or a lower grade than they have applied for, we may offer the candidate that role without the need to go through a further selection process providing the role has the same behaviours and essential skills.

Important Dates:

Sift date: From 18/11/2024

Interview dates: From 02/12/2024

For the full terms and conditions of the post, please see attachment below. 

Feedback will only be provided if you attend an interview or assessment.

Security

Successful candidates must meet the security requirements before they can be appointed. The level of security needed is security check (opens in a new window).

See our vetting charter (opens in a new window).

People working with government assets must complete baseline personnel security standard (opens in new window) checks.

Nationality requirements

This job is broadly open to the following groups:

  • UK nationals
  • nationals of the Republic of Ireland
  • nationals of Commonwealth countries who have the right to work in the UK
  • nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities with settled or pre-settled status under the European Union Settlement Scheme (EUSS) (opens in a new window)
  • nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities who have made a valid application for settled or pre-settled status under the European Union Settlement Scheme (EUSS)
  • individuals with limited leave to remain or indefinite leave to remain who were eligible to apply for EUSS on or before 31 December 2020
  • Turkish nationals, and certain family members of Turkish nationals, who have accrued the right to work in the Civil Service

Further information on nationality requirements (opens in a new window)

Working for the Civil Service

The Civil Service Code (opens in a new window) sets out the standards of behaviour expected of civil servants.

We recruit by merit on the basis of fair and open competition, as outlined in the Civil Service Commission's recruitment principles (opens in a new window).

The Civil Service embraces diversity and promotes equal opportunities. As such, we run a Disability Confident Scheme (DCS) for candidates with disabilities who meet the minimum selection criteria.

The Civil Service also offers a Redeployment Interview Scheme to civil servants who are at risk of redundancy, and who meet the minimum requirements for the advertised vacancy.

Diversity and Inclusion

The Civil Service is committed to attract, retain and invest in talent wherever it is found. To learn more please see the Civil Service People Plan (opens in a new window) and the Civil Service Diversity and Inclusion Strategy (opens in a new window).

More jobs at Government Digital & Data

Lead Business Analyst-Department for Transport
£51,997
Full-time (Permanent)
Senior Software Engineer (AI Safety Institute)- Department for Science, Innovation & Technology-SCS1
£65,000 - £135,000
Full-time (Permanent)
Associate Delivery Manager (Ref: 90461) HM Courts and Tribunals Service-HEO
£32,827 - £40,403
Full-time (Permanent)
Technical Architect Vehicle Certification Agency-SEO
£57,400
Full-time (Permanent)
Software Engineer - ONS - HEO
£32,452
Full-time (Permanent)
IT Support Engineer - Met Office - EO
£26,954 - £29,531
Full-time (Permanent)
DDaT Senior BI Design & Integration Manager - MoD - SEO
£43,080
Full-time (Permanent)
Senior Software Engineer - SIS - G6
£75,077 - £83,677
Full-time (Permanent)
IT Asset & CMDB Manager - NSI - HEO
£38,000 - £41,000
Full-time (Permanent)
Digital Change Trainer - Ofsted - HEO
£34,623
Full-time (Permanent)
Lead Applied AI Engineer (i.AI) - CO - G6
£67,126 - £103,924
Full-time (Permanent)
Senior DevOps Engineer - IPO - SEO
£44,482 - £54,945
Full-time (Permanent)
Senior DevOps Engineer - MoJ - G7
£54,358 - £66,670
Full-time (Permanent)
Dev Ops Engineer - MHRA - SEO
£42,869
Full-time (Permanent)
Principal Network Engineer - OFGEM - G6
Full-time (Permanent)
Senior Software Engineer - SIS MI6 - G6
£75,077 - £83,677
Full-time (Permanent)
Data Engineer - Insolvency Service - HEO
£34,399 - £44,008
Full-time (Permanent)
Senior Data Engineer - HO - SEO
£44,720 - £52,130
Full-time (Permanent)
Oracle Database Engineer - DWP - SEO
£40,201 - £48,347
Full-time (Permanent)
Technical Architect (One Login) - GDS - G7
£55,403 - £89,880
Full-time (Permanent)
Senior Performance Test Engineer - DVLA - SEO
£40,808 - £57,400
Full-time (Permanent)
Lead Interaction Designer - DVLA - G7
£51,997
Full-time (Permanent)
Head of IT Services for Criminal Investigation & Avoidance Disruption - HMRC - SCS1
£76,000
Full-time (Permanent)
Risk and Intelligence IT Business Service Owner - HMRC - SCS1
£76,000
Full-time (Permanent)
Lead Technical Architect - Companies House - G7
£49,384 - £71,953
Full-time (Permanent)
Delivery Manager - IPO - SEO
£44,482 - £54,945
Full-time (Permanent)

Subscribe to our newsletter

Sign up here