Postdoc Position in Explainable Reinforcement Learning

Faculty: 

Faculty of Science

Department: 

Department of Information and Computing Sciences

Hours per week: 

36 to 40

Application deadline: 

30 April 2025

Current advancements in energy technology has led to an increase in the use of photovoltaic panels in residential areas, and an increasing use of electric cars. Communities can now benefit from the energy produced by their own photovoltaic panels for daily energy use, as well as for charging their electric vehicles. However, it remains a challenge to manage the energy such that individuals maximise their use of energy in a just and fair manner.

In this research project, you will be working towards developing Reinforcement Learning (RL) models that intelligently manage the charging/discharging of electric vehicles in the energy-mobility-housing nexus. RL models, however, are often seen as “black-boxes”. To enhance transparency, you will design methods to reveal the decision-making structure of the models using Explainable Reinforcement Learning (XRL). This will allow for an in-detail analysis of the level of justness and fairness achieved with the proposed RL. For example, with XRL, you will quantify the distribution of benefits and costs that the RL decision strategy proposes across individuals. You will also identify driving factors and conditions that contribute to the decisions proposed by the RL model.

This Postdoc position is part of the Dutch NWO research project JUSTNEXUS . Within the project, you will have the opportunity to collaborate with several Dutch universities and researchers from multi-disciplinary backgrounds, and several industrial partners.

• You hold a PhD degree in Computer Science, Applied Mathematics or Operations Research, or you are within a few months from defending your PhD.
• You are familiar with Reinforcement Learning, Explainable Reinforcement Learning (XRL), fairness in Reinforcement Learning models.
• You have demonstrated programming skills (familiarity with Python is a plus).
• You are willing to work in a multi-disciplinary team with researchers, and with diverse teams of stakeholders.
• You possess collaboration and communication skills with an independent outlook in defining and solving research problems.
• You are proficient in English.
• Familiarity with the topics of charging schemes for electric vehicles, electric grids, and a just energy transition is a plus.

• a position for 12 months, with an extension of up to 12 months after a positive evaluation (for a total maximum duration of 24 months);
• a gross monthly starting salary of €4,060 in the case of full-time employment (salary scale 10.4 under the Collective Labour Agreement for Dutch Universities (CAO NU)); 
• 8% holiday pay and 8.3% year-end bonus; 
• a pension scheme, partially paid parental leave and flexible terms of employment based on the CAO NU. 

In addition to the terms of employment
external link
 laid down in the CAO NU, Utrecht University has a number of schemes and facilities of its own for employees. This includes schemes facilitating professional development
external link
, leave schemes and schemes for sports and cultural activities
external link
, as well as discounts on software and other IT products. We also offer access to additional employee benefits through our Terms of Employment Options Model. In this way, we encourage our employees to continue to invest in their growth. For more information, please visit Working at Utrecht University
external link
.

A better future for everyone. This ambition motivates our scientists in executing their leading research and inspiring teaching. At Utrecht University
external link
, the various disciplines collaborate intensively towards major strategic themes
external link
. Our focus is on Dynamics of Youth, Institutions for Open Societies, Life Sciences and Pathways to Sustainability. Sharing science, shaping tomorrow
external link
.

Working at the Faculty of Science
external link
 means bringing together inspiring people across disciplines and with a variety of perspectives and backgrounds. The Faculty
external link
 has six departments: Biology, Pharmaceutical Sciences, Information & Computing Sciences, Physics, Chemistry and Mathematics. Together, we
external link
 work on excellent research and inspiring education. We do so, driven by curiosity and supported by outstanding infrastructure. Visit us on LinkedIn
external link
 and discover how you can become part of our community.

The Department of Information and Computing Sciences
external link
 is nationally and internationally known for its research in computer science and information science. The department provides and contributes to the Bachelor's programmes in Computer Science, Information Science, and Artificial Intelligence and a number of research Master's programmes in these fields. It employs over 200 people, working in four divisions: Algorithms, AI & Data Science, Software and Interaction. The atmosphere is collegial and informal.

For more information, please contact Dr Mihaela Mitici
external link
at m.a.mitici@uu.nl .

Do you have a question about the application procedure? Please send an email to science.recruitment@uu.nl .

As Utrecht University, we want to be a home
external link
 for everyone. We value staff with diverse backgrounds, perspectives and identities, including cultural, religious or ethnic background, gender, sexual orientation, disability or age. We strive to create a safe and inclusive environment in which everyone can flourish and contribute.

If you are enthusiastic about this position, apply via the 'apply now' button. Please enclose:

• your motivation letter (max. one page);
• your curriculum vitae, including a complete list of all your publications;
• a copy of your PhD diploma;
• a copy of your PhD thesis - if this is not available, a current draft of your PhD thesis;
• two papers that you are most proud of;
• the telephone numbers and email addresses of two referees we may contact.

If you are within a few months from defending your PhD, you are also welcome to apply. In that case, please enclose a letter from your PhD supervisor indicating when you are likely to graduate.

The application deadline is 1 May 2025.