skip navigation
skip mega-menu

Senior Data Engineer (UK Based)

CTS -

Full-time (Permanent)
Published on
6 May 2022

What you’ll do:

  • Work with customers to translate requirements into technical designs and follow this through to delivery of the solution. You will be able to design highly available, complex data platforms, and mentor others to be able to do so
  • Advise customers on modern approaches to data engineering and the best approach to solve their unique problems
  • Establish yourself as a trusted advisor and reliable point of contact for customers
  • Understand customer data structures and transformation requirements to build suitable solutions on Google Cloud Platform
  • Design, plan and build highly available, global and cloud native data platforms
  • Take the lead on technical projects, i.e be the technical point of escalation for more junior Engineers and engage regularly with the customer during the delivery of the solution.
  • Develop internal tooling and improve processes for the wider team and business.
  • Create engaging technical content to promote CTS and Google Cloud products and services (e.g. case studies and thought pieces)

 

Key Skills:

  • Extensive commercial experience in the area of data engineering or machine learning
  • Confident communicator both written and verbally
  • Extensive hands-on experience with at least one major cloud provider (GCP, AWS, Azure), including the use of their data related components to build solutions.
  • Experience designing and building large data architectures
  • Strong experience building ETL / ELT pipelines, Data Lakes and Data Warehouses
  • Significant experience in using languages like Python, R and SQL as well as Google database services like Firestore, Cloud SQL, Big Query or equivalents from other Cloud Providers
  • Experienced in using unit testing and CI / CD
  • Ability to think in abstract terms about application structures and strong understanding of security integration implications on this structure
  • A solid grounding working with common data modelling techniques and SQL (e.g. MS SQL, Oracle, PostgreSQL, MySQL)
  • Working knowledge of data governance principles (e.g. data profiling, data cataloguing, managing access controls, etc.)
  • A good understanding of some of the following:

Hadoop / Spark |  Apache Airflow | Apache Beam | Relational database technologies (Microsoft SQL, Oracle or PostgreSQL) |  Teradata |  Tensorflow | Analytical tools (Looker, Tableau, Qlik, Data Studio)

 

Desirable Skills:

  • Experience with or knowledge of Google Cloud Platform (e.g. Pub/Sub, Dataflow, BigQuery, Firestore, etc.)
  • Experience with or knowledge of AWS (e.g. Athena, EMR, Glue, Redshift, Kinesis, etc) or Azure (e.g. Synapse, Databricks, Data Factory, Event Hub, etc.)
  • Exposure to real time data ingestion / streaming data sources
  • Experience in or knowledge of working in an agile project based environment
  • Bachelor or Masters degree in Computer Science, Data Science or equivalent education

 

Subscribe to our newsletter

Sign up here