The Senior Data Engineer will have direct oversight and responsibility for the development, implementation, review, and establishment of data and techniques used in the Advanced Data Analytics Portfolio (DAP). As a Senior Data Engineer, you will work with project managers, data scientists, counter fraud experts, stakeholders, and senior management across the full extent of the NHSCFA and our wider stakeholders in pursuit of the above. Your primary responsibilities will include developing data pipelines, processing data, and preparing data suitable for analysis. Additionally, you will evaluate, maintain, and manage data pipelines, develop and maintain data models, and support the design of analytical services, products, and models that meet the needs of NHSCFA. You will also guide, develop, document, and maintain data pipelines and storage solutions used in the analytics environment, ensuring that the infrastructure and methods are secure, optimised, and scalable within the cloud computing environment. All of this must be aligned within the NHSCFA strategic framework that drives innovation and sustained organisational impact across the NHS and wider public sector.
This post is subject to NPP Vetting 2
Applicants can contact Susan Proctor, Data Science Manager, Susan.Proctor@nhscfa.gov.uk for an informal chat
Interviews w/c 27th May
We reserve the right to close the vacancy early.
Main duties of the job
- Develop and maintain robust, efficient, secure and reliable data pipelines using appropriate business tools.
- Build data pipelines that clean, transform, and present granular and aggregate data from disparate sources.
- Design, build, test, automate, and maintain architectures and processing workflows.
- Plan, develop and evaluate methods and processes for gathering, extracting, transforming and cleaning data and information.
- To undertake development of the data warehouse, including overall design, technical development and documentation of the data warehouse, infrastructure and ETL solutions covering multiple sources of data, working alongside NHSCFA specialists.
- Write ETL (extract, transform, load) scripts and code to ensure the ETL process performs optimally.
- Define and document the pre processing steps, data wrangling techniques and feature engineering undertaken on a given dataset.
- Design and maintain robust processes to ensure NHSCFA and external stakeholder datasets are separated and securely stored across within the NHSCFA tenancy.
- Implement data flows to connect data for analytics and business intelligence (BI) systems.
The closing date is 21 May 2024
