Senior data scientist

Successful candidates may be based in any of our office locations – Cardiff, Glasgow, or London. We especially welcome applicants from Cardiff and Glasgow.

Job Summary

Ofgem is Great Britain’s independent energy regulator. We’re at the forefront of change across the energy sector, driving toward Net Zero whilst protecting energy consumers – especially vulnerable people. 

 

We offer a diverse range of flexible working career opportunities: roles that are stimulating and rewarding, where you can get involved in ground-breaking work. And it’s important to us that we recruit from a wide range of professional and personal backgrounds. 

 

Effective use of data and artificial intelligence (AI) are at the centre of our work to bring about a Net Zero energy supply. As the energy sector becomes more digitalised we have a key role to play in ensuring that this is underpinned with best practice and regulation. 

 

As a Senior AI Data Scientist, you’ll be working in our dynamic and growing Data & AI team. It’s a team that’s cross-functional, diverse and knowledgeable. You'll accelerate data driven decision making, digital transformation, and enable AI and self-service analytics across Ofgem. You’ll be responsible for designing, building and deploying data science & AI models to answer strategic business questions using modern data science technologies such as Python, Azure Machine Learning, Azure AI Services, Copilot Studio, and Power BI. 

 

In this role, working closely with the Head of Data Science & AI, you’ll apply data science approaches and AI models across a wide range of energy market data and processes. You’ll embed and launch Data Science & AI models to help inform strategic decisions - assessing current software, architecture and capabilities, sourcing and preparing strategic data sets. You’ll also collaborate in the creation of Data Science & AI Best Practice and provide expertise to other Ofgem departments and external stakeholders. It’s a role that requires an understanding of strategic business initiatives and analysis, data assets, and Data Science product development as well as being able to use data visualisation and storytelling techniques to share conclusions and advise on impacts. 

 

It’s essential that you can bring mathematical, statistical and analytical/research skills and your knowledge in the development of data science, machine learning, analytics or statistical data products should include a core data science language. Your professional expertise should be complemented by highly developed communication and presentation skills along with a methodical approach and a keen focus on quality.

Job Description

Key Responsibilities

To support the team deliverables, that utilise your expertise to ensure successful outcomes across team members and collaborating teams

• Understand strategic business initiatives and analytical questions to answer.
• Design, develop, test, and deploy data science workflows using Microsoft Azure ML Studio with a Python data science stack.
• Ensure high-quality delivery of accurate data science models, and review that proposed solutions meet security, compliance, and governance requirements.
• Monitor model performance, identify drift and implement model retraining when appropriate.
• Use data visualisation and storytelling techniques to share analytic conclusions and their strategic impact.
• Collaborate closely with other teams to manage interdependencies, risks and resourcing to support portfolio delivery.
• Develop AI/ML proof-of-concepts and assist the business with evaluations to measure success and estimate value proposition.
  
  

Key Outputs and Deliverables

• Data Science and machine learning capability for Ofgem, which may include reusable analytics tools and artefacts, such as, data science workflows, ML pipelines, dashboards, actionable insights, etc.
• Expertise advising on selection of appropriate models and suitable algorithms depending on business requirements, aligning with best practice and ways of working.
• High-quality delivery of data science work, including accurate models, insightful dashboards and data visualisations.
• AI/ML proof-of-concepts applicable to Ofgem business processes, and estimation of value proposition.
• Technical documentation and training materials for Ofgem colleagues.
  
  

Key Responsibilities

To support the team deliverables, that utilise your expertise to ensure successful outcomes across team members and collaborating teams

• Understand strategic business initiatives and analytical questions to answer.
• Design, develop, test, and deploy data science workflows using Microsoft Azure ML Studio with a Python data science stack.
• Ensure high-quality delivery of accurate data science models, and review that proposed solutions meet security, compliance, and governance requirements.
• Monitor model performance, identify drift and implement model retraining when appropriate.
• Use data visualisation and storytelling techniques to share analytic conclusions and their strategic impact.
• Collaborate closely with other teams to manage interdependencies, risks and resourcing to support portfolio delivery.
• Develop AI/ML proof-of-concepts and assist the business with evaluations to measure success and estimate value proposition.
  
  

Key Outputs and Deliverables

• Data Science and machine learning capability for Ofgem, which may include reusable analytics tools and artefacts, such as, data science workflows, ML pipelines, dashboards, actionable insights, etc.
• Expertise advising on selection of appropriate models and suitable algorithms depending on business requirements, aligning with best practice and ways of working.
• High-quality delivery of data science work, including accurate models, insightful dashboards and data visualisations.
• AI/ML proof-of-concepts applicable to Ofgem business processes, and estimation of value proposition.
• Technical documentation and training materials for Ofgem colleagues.
  
  

Person specification

Essential Criteria

• Extensive experience with Python and data science Python packages (e.g. scikit-learn, pandas, numpy, etc). (LEAD)
• Understanding of data science concepts, AI / ML models, evaluation approaches, and data science applications to enhance business processes. (LEAD)
• Proven hands-on experience in Microsoft Azure ML Studio. (LEAD)
• Able to achieve and maintain SC clearance, which includes residency in the UK for at least 3 of the last 5 years. (Lead criteria)
• Experience using business intelligence tools, preferably Power BI.
• Experience applying Generative AI and prompting techniques.
• Strong understanding of data governance, model observability, and compliance frameworks.
• Proven ability to deliver secure, scalable, and responsible data science solutions.
• Microsoft certified: Azure Data Scientist Associate, or equivalent experience.
  
  

Desirable Criteria

• Knowledge of the Microsoft ecosystem, particularly M365, Power Platform, and Azure.
• Cyber security awareness.
  
  

Behaviours

We'll assess you against these behaviours during the selection process:

• Making Effective Decisions
• Working Together
• Managing a Quality Service
  
  

Alongside your salary of £47,895, OFGEM contributes £13,875 towards you being a member of the Civil Service Defined Benefit Pension scheme. Find out what benefits a Civil Service Pension provides.

Ofgem can offer you a comprehensive and competitive benefits package which includes; 30 days annual leave after 2 years; Excellent training and development opportunities; The opportunity to join the generous Civil Service pension which also includes a valuable range of benefits; hybrid working (currently 1 day a week in the office but this is kept under review), flexible working hours and family friendly policies. Plus lots of other benefits including clean and bright offices based centrally, engaged networks and teams and an opportunity to contribute to our ambitious and important targets of establishing a Net Zero energy system by 2050. This exciting blend of professional challenge and personal reward identifies career opportunities at Ofgem as something to get excited about.

Selection process details

This vacancy is using Success Profiles (opens in a new window), and will assess your Behaviours and Experience.

When you press the ‘Apply now’ button, you will be asked to complete personal details (not seen by the sift panel), your career history and qualifications.

You will then be asked to provide a 1250 word ‘personal statement’ evidencing how you meet the essential and desirable skills and capabilities listed in the role profile. Please ensure you demonstrate clearly, within your supporting statement, how you meet each of the criteria listed in the role profile.

Artificial Intelligence can be a useful tool to support your application, however, all examples and statements provided must be truthful, factually accurate and taken directly from your own experience. Where plagiarism has been identified (presenting the ideas and experiences of others, or generated by artificial intelligence, as your own) applications may be withdrawn and internal candidates may be subject to disciplinary action. Please see our candidate guidance for more information on appropriate and inappropriate use.

The personal information we have collected from you will be shared with Cifas who will use it to prevent fraud, other unlawful or dishonest conduct, malpractice, and other seriously improper conduct. If any of these are detected, you could be refused certain services or employment. Your personal information will also be used to verify your identity. Further details of how your information will be used by us and Cifas, and your data protection rights, can be found by [].

Please note SC is required for this role. Information and eligibility guidance can be found here: SC - Guidance Pack for Applicants - GOV.UK

Feedback will only be provided if you attend an interview or assessment.

This vacancy is using Success Profiles (opens in a new window), and will assess your Behaviours and Experience.

Security

Successful candidates must undergo a criminal record check.

Successful candidates must meet the security requirements before they can be appointed. The level of security needed is security check (opens in a new window).See our vetting charter (opens in a new window).

People working with government assets must complete baseline personnel security standard (opens in new window) checks.

Successful candidates must undergo a criminal record check.

Successful candidates must meet the security requirements before they can be appointed. The level of security needed is security check (opens in a new window).See our vetting charter (opens in a new window).

People working with government assets must complete baseline personnel security standard (opens in new window) checks.

Nationality requirements

This Job Is Broadly Open To The Following Groups

• UK nationals
• nationals of the Republic of Ireland
• nationals of Commonwealth countries who have the right to work in the UK
• nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities with settled or pre-settled status under the European Union Settlement Scheme (EUSS) (opens in a new window)
• nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities who have made a valid application for settled or pre-settled status under the European Union Settlement Scheme (EUSS)
• individuals with limited leave to remain or indefinite leave to remain who were eligible to apply for EUSS on or before 31 December 2020
• Turkish nationals, and certain family members of Turkish nationals, who have accrued the right to work in the Civil Service
  
  

Further information on nationality requirements (opens in a new window)

Working for the Civil Service

The Civil Service Code (opens in a new window) sets out the standards of behaviour expected of civil servants.

We recruit by merit on the basis of fair and open competition, as outlined in the Civil Service Commission's recruitment principles (opens in a new window).

The Civil Service embraces diversity and promotes equal opportunities. As such, we run a Disability Confident Scheme (DCS) for candidates with disabilities who meet the minimum selection criteria.

The Civil Service also offers a Redeployment Interview Scheme to civil servants who are at risk of redundancy, and who meet the minimum requirements for the advertised vacancy.

The Civil Service Code (opens in a new window) sets out the standards of behaviour expected of civil servants.

We recruit by merit on the basis of fair and open competition, as outlined in the Civil Service Commission's recruitment principles (opens in a new window).

The Civil Service embraces diversity and promotes equal opportunities. As such, we run a Disability Confident Scheme (DCS) for candidates with disabilities who meet the minimum selection criteria.

The Civil Service also offers a Redeployment Interview Scheme to civil servants who are at risk of redundancy, and who meet the minimum requirements for the advertised vacancy.

Diversity and Inclusion

The Civil Service is committed to attract, retain and invest in talent wherever it is found. To learn more please see the Civil Service People Plan (opens in a new window) and the Civil Service Diversity and Inclusion Strategy (opens in a new window).

This vacancy is part of the Great Place to Work for Veterans (opens in a new window) initiative.

The Civil Service welcomes applications from people who have recently left prison or have an unspent conviction. Read more about prison leaver recruitment (opens in new window).

Once this job has closed, the job advert will no longer be available. You may want to save a copy for your records.

Contact point for applicants

Job Contact

• Name : Jamie Wright
• Email : [email protected]
  
  

Recruitment team

• Email : [email protected]
  
  

Further information

Appointment to the Civil Service is governed by the Civil Service Commission’s Recruitment Principles. You have the right to complain if you feel there has been a breach of these Recruitment Principles.

In the first instance, you should raise the matter directly via [email protected]. If you are not satisfied with the response, you may bring your complaint to the Commission. For further information on bringing a complaint to the Civil Service Commission, please visit their website.