skip navigation
skip mega-menu

G7 Lead Data Engineer, Infrastructure and Projects Authority-Cabinet Office

Government Digital & Data -

Full-time (Permanent)
£53,400 - £64,000
Published on
10 May 2024
21 May 2024

G7 Lead Data Engineer, Infrastructure and Projects Authority

Cabinet Office

Apply before 11:55 pm on Tuesday 21st May 2024


Return to search results

Cabinet Office Logo


£53,400 - £64,000

National - £53,400 - £59,700 London - £58,800 - 64,000. This position also attracts DDaT allowance. Offers above the band minimum are subject to our assessment of your skills and experience as demonstrated at interview. Salaries over the band minimum will be paid as a non-pensionable allowance.

A Civil Service Pension with an average employer contribution of 27%

Job grade

Grade 7

Contract type


Business area

CO - Infrastructure and Projects Authority - Note: this role is equivalent to ‘ Lead data engineer’ in the DDaT job framework

Type of role

Architecture and Data
Project Delivery


Birmingham, London

About the job

Job summary

The Infrastructure and Projects Authority (IPA) is the government’s centre of expertise for infrastructure and major projects. We sit at the heart of government, reporting to the Cabinet Office and HM Treasury. Our core teams include experts in infrastructure, project delivery and project finance who work with government departments and industry. We support the successful delivery of all types of infrastructure and major projects; ranging from railways, schools, hospitals and housing, to defence, IT and major transformation programmes. We lead the project delivery and project finance professions across government.

Our purpose is to continuously improve the way infrastructure and major projects are delivered, in order to support government priorities and improve people’s lives. We aspire to create the best performing project system of any country in the world.

The IPA works with government and industry to ensure projects are delivered efficiently and effectively, and to improve performance over time. We work on the overall project delivery system, which includes the projects, people and processes that together create the right environment for successful delivery. We measure how well the system is performing, so we can learn important lessons and continuously improve project performance over time.

The Team

The IPA Data and Insight Team has a mission to better understand, support and improve the deliverability and performance of Government’s projects now and into the future. 

We do this by collecting and maintaining project data; creating an enduring indispensable Government asset. We transform this crucial dataset into insights and advice at the project, portfolio and cross-Government system level so that the IPA, project delivery professionals across government, HMT and No10 can access the evidence they need to make the best decisions.

Specifically, for the Government Major Projects Portfolio (GMPP), we lead on:

  1. Data Collection and Management
  2. Management Information and custom reporting
  3. Advanced Analytics
  4. Promoting and Embedding a Data Culture

The Data and Insight Team prides itself on fostering a hard-working, supportive and inclusive environment, making the team a great place to work.

Job description

This is an exciting new role in the IPA, created to manage and connect the data and digital systems we use to ensure our products are effective and delivering their intended benefits, helping to inform leaders across the UK and promoting our aim of ensuring world class project delivery.

Responsibilities and Duties

As the lead Data Engineer you will lead on managing the platforms in use at the IPA, connecting them together, and developing interlinked IPA databases. 

Responsibilities and duties for the role include:

  • Reviewing, documenting and streamlining current IPA datasets and ETL processes to integrate systems and bring multiple data sources together for analysis
  • Design and build of databases and pipelines for the ingestion and transformation of data from our IPA data collection platforms and potentially from other government departments
  • Overall responsibility for managing critical IPA systems
  • Overseeing the transition from one legacy data collection platform to a newly commissioned system
  • Developing IPA Data Engineering capability in the AWS environment
  • Curating and cataloguing datasets from varying levels of maturity in partnership with the rest of the Data and Insights team
  • Proactively monitoring the platform to identify security, performance and capacity issues
  • Troubleshooting and identifying problems and suggesting innovative solutions
  • Updating and maintaining technical documentation and knowledge articles for support purposes

Person specification

You will be able to demonstrate the following skills, experience and behaviours in conjunction with the above responsibilities.


  • Extensive experience in building data pipelines (ETL and/or analytical)
  • Strong coding background in Python or similar and SQL experience
  • Experience in cloud infrastructure engineering, ideally with AWS
  • Ability to demonstrate an advanced understanding of design, technology and data principles to act as a recognised expert for a sizable organisation
  • Ability to articulate complex problems in simple terms and objectives
  • Demonstrable experience in meeting the needs of users across a variety of channels to deliver the most effective services


  • Experience in setting up and using APIs
  • Experience coaching and leading teams in Agile and DevOps processes
  • Experience in managing data platforms, ideally Salesforce or another CRM system
  • Ability to identify areas of innovation in data tools and techniques, and recognise appropriate timing for adoption
  • Previous experience leading on strategies for services, working effectively to get buy-in from the organisation and adapting where there are constraints to ensure delivery

More jobs at Government Digital & Data

Software Developer-HM Courts
Full-time (Permanent)
Senior Software Developer-HM Courts
£54,358 - £66,670
Full-time (Permanent)
Software Developer (Data Platform)-HM Courts
£39,868 - £50,039
Full-time (Permanent)
Lead Business Analyst-Department for Transport
Full-time (Permanent)
Senior Software Developer-HM Courts
£54,358 to £66,670
Full-time (Permanent)
UX Engineer - AI Safety Institute-Department for Science, Innovation & Technology
£85,000 - £115,000
Full-time (Permanent)
Senior DevOps Engineer (Image WebOps - Cloud Support & Automation)-Companies House
£33,134 - £49,000
Full-time (Permanent)
Lead Technical Architect (Software) - *Candidate pack updated* HM Land Registry
£63,100 - £80,400
Full-time (Permanent)
Lead Technical Architect (Emergency Services Mobile Communications Programme) Home Office
£57,000 - £67,100
Full-time (Permanent)
Infrastructure Engineer- GCHQ
£34,663 - £41,347
Full-time (Permanent)
Infrastructure Engineer / Specialist Infrastructure Engineer- GCHQ
£34,663 - £41,935
Full-time (Permanent)
Infrastructure Engineer / Specialist Infrastructure Engineer -GCHQ
£34,663 to £41,935
Full-time (Permanent)
Software Developer- Welsh Revenue Authority
£34,083 to £41,675
Full-time (Permanent)
Senior Software Developer (Pre-Recorded Evidence) (Ref: 87336) -HM Courts and Tribunals Service
£54,358 to £66,670
Full-time (Permanent)
Deputy Director, i.AI Strategy and Business Engagement -Cabinet Office
£75,000 to £117,800
Full-time (Permanent)
Lead Technical Architect(Ref: 87193)- Ministry of Justice
£66,314 to £75,810
Full-time (Permanent)
INDEX - Delivery Manager -Cabinet Office
£44,500 - £48,243
Full-time (Permanent)
Business Support Officer -Cabinet Office
£35,400 to £39,200
Full-time (Permanent)
Test Engineer -The Money and Pensions Service
£50,000 to £50,000
Full-time (Permanent)
Video Product Manager (Ref: 87291) -HM Courts and Tribunals Service
£32,827 - £40,403
Full-time (Permanent)
IT Service Manager -Gangmasters and Labour Abuse Authority
£30,500 to £36,500
Full-time (Permanent)
1241 - Application Developer – (Student Placement) -Welsh Government
£23,258 - £26,901
Full-time (Permanent)
Interaction Designer -Cabinet Office
£40,850 to £44,260
Full-time (Permanent)
Test Engineer -The Money and Pensions Service
: £50,000 to £50,000
Full-time (Permanent)
Software Engineer - Data Lab D&A Hub / Specialist Operational Services -National Crime Agency
£41,347 - £50,089
Full-time (Permanent)
Senior Infrastructure Engineer -National Crime Agency
£41,347 to £50,089
Full-time (Permanent)
Data Engineer - Data Lab D&A Hub -National Crime Agency
£41,347 to £50,089
Full-time (Permanent)
Engineering Technical Support Officer -National Crime Agency
Full-time (Permanent)
DevOps Engineer - LMA -Met Office
£33,794 - £36,235
Full-time (Permanent)
Senior Applications Operations Engineer -Cabinet Office
£40,850 - £44,260
Full-time (Permanent)

Subscribe to our newsletter

Sign up here