Senior Data Engineer

We need someone who can work with our Data Innovation Hub engineers and scientists, and

operational teams, to understand requirements and put in place the necessary services. The role

will use data engineering skills to deliver continual improvement, the provision of technical

guidance, and will enable insights to be derived from data pipelines.

As a senior data engineer, you will identify, specify, and innovate fit for purpose, scalable and

future-proof data services to meet complex user needs and will be able to:

• Work collaboratively with colleagues in the Hub, policy and operations teams to understand how they use data
• Specify, build, and deploy systems to extract, transform and load (ETL) data
• Develop our application programming interfaces (APIs) to expose data from multiple systems for internal and external stakeholders
• To share and embed best practice through knowledge of industry recognised data models and standards.
• Continuously seek ways to improve our data services and pipelines to be in line with industry best practice
• Lead initiatives to locate, catalogue and integrate data sets to derive actionable insights
• Provide our data scientists and analysts with the data and infrastructure required to undertake their analysis, be that traditional database tables or unstructured big data
• Develop systems that are compliant with our relevant information security and data management principles
• Represent Ofcom as we build our thought leadership for data innovation through engagement with regulators, stakeholders and at external events

Essential skills and Knowledge

Applicants should be able to demonstrate capability in:

• Developing, coding, testing, correcting and documenting programs or scripts, using technical tools such as Python, C++, Java, Spark
• Managing complex databases and environments such as PostgreSQL, Cosmos, Azure, and Linux to support SQL and NoSQL operations
• Engaging across organisational boundaries to understand requirements, translate these requirements into technical specifications and deliver business outcomes 
• Communicating technical concepts across organisational and technical boundaries, including to senior colleagues 
• Working under pressure to complete multiple tasks accurately and to established timelines 
• Working independently, demonstrating flexibility and adaptability 
• Building strong and trusted relationships between colleagues across organisational boundaries 
• Identifying with, and demonstrating a desire to promote, Ofcom's values of excellence, agility, empowerment and collaboration