G7 Lead Data Engineer, Infrastructure and Projects Authority-Cabinet Office
Government Digital & Data -
G7 Lead Data Engineer, Infrastructure and Projects Authority
Cabinet Office
Apply before 11:55 pm on Tuesday 21st May 2024
Salary
£53,400 - £64,000
National - £53,400 - £59,700 London - £58,800 - 64,000. This position also attracts DDaT allowance. Offers above the band minimum are subject to our assessment of your skills and experience as demonstrated at interview. Salaries over the band minimum will be paid as a non-pensionable allowance.
A Civil Service Pension with an average employer contribution of 27%
Job grade
Grade 7
Contract type
Permanent
Business area
CO - Infrastructure and Projects Authority - Note: this role is equivalent to ‘ Lead data engineer’ in the DDaT job framework
Type of role
Analytical
Architecture and Data
Digital
Project Delivery
Location
Birmingham, London
About the job
Job summary
The Infrastructure and Projects Authority (IPA) is the government’s centre of expertise for infrastructure and major projects. We sit at the heart of government, reporting to the Cabinet Office and HM Treasury. Our core teams include experts in infrastructure, project delivery and project finance who work with government departments and industry. We support the successful delivery of all types of infrastructure and major projects; ranging from railways, schools, hospitals and housing, to defence, IT and major transformation programmes. We lead the project delivery and project finance professions across government.
Our purpose is to continuously improve the way infrastructure and major projects are delivered, in order to support government priorities and improve people’s lives. We aspire to create the best performing project system of any country in the world.
The IPA works with government and industry to ensure projects are delivered efficiently and effectively, and to improve performance over time. We work on the overall project delivery system, which includes the projects, people and processes that together create the right environment for successful delivery. We measure how well the system is performing, so we can learn important lessons and continuously improve project performance over time.
The Team
The IPA Data and Insight Team has a mission to better understand, support and improve the deliverability and performance of Government’s projects now and into the future.
We do this by collecting and maintaining project data; creating an enduring indispensable Government asset. We transform this crucial dataset into insights and advice at the project, portfolio and cross-Government system level so that the IPA, project delivery professionals across government, HMT and No10 can access the evidence they need to make the best decisions.
Specifically, for the Government Major Projects Portfolio (GMPP), we lead on:
- Data Collection and Management
- Management Information and custom reporting
- Advanced Analytics
- Promoting and Embedding a Data Culture
The Data and Insight Team prides itself on fostering a hard-working, supportive and inclusive environment, making the team a great place to work.
Job description
This is an exciting new role in the IPA, created to manage and connect the data and digital systems we use to ensure our products are effective and delivering their intended benefits, helping to inform leaders across the UK and promoting our aim of ensuring world class project delivery.
Responsibilities and Duties
As the lead Data Engineer you will lead on managing the platforms in use at the IPA, connecting them together, and developing interlinked IPA databases.
Responsibilities and duties for the role include:
- Reviewing, documenting and streamlining current IPA datasets and ETL processes to integrate systems and bring multiple data sources together for analysis
- Design and build of databases and pipelines for the ingestion and transformation of data from our IPA data collection platforms and potentially from other government departments
- Overall responsibility for managing critical IPA systems
- Overseeing the transition from one legacy data collection platform to a newly commissioned system
- Developing IPA Data Engineering capability in the AWS environment
- Curating and cataloguing datasets from varying levels of maturity in partnership with the rest of the Data and Insights team
- Proactively monitoring the platform to identify security, performance and capacity issues
- Troubleshooting and identifying problems and suggesting innovative solutions
- Updating and maintaining technical documentation and knowledge articles for support purposes
Person specification
You will be able to demonstrate the following skills, experience and behaviours in conjunction with the above responsibilities.
Essential:
- Extensive experience in building data pipelines (ETL and/or analytical)
- Strong coding background in Python or similar and SQL experience
- Experience in cloud infrastructure engineering, ideally with AWS
- Ability to demonstrate an advanced understanding of design, technology and data principles to act as a recognised expert for a sizable organisation
- Ability to articulate complex problems in simple terms and objectives
- Demonstrable experience in meeting the needs of users across a variety of channels to deliver the most effective services
Desirable:
- Experience in setting up and using APIs
- Experience coaching and leading teams in Agile and DevOps processes
- Experience in managing data platforms, ideally Salesforce or another CRM system
- Ability to identify areas of innovation in data tools and techniques, and recognise appropriate timing for adoption
- Previous experience leading on strategies for services, working effectively to get buy-in from the organisation and adapting where there are constraints to ensure delivery
