1. Vacancies
  2. PhD position Reinforcement learning for digital finance

PhD position Reinforcement learning for digital finance

We are looking for a highly motivated and creative Ph.D. candidate interested in developing and applying Reinforcement Learning (RL) models that support financial service providers in making better decisions under uncertainty. The implementation of such models requires resolving various issues regarding the digital ecosystem, regulatory compliance, and explainability. This Ph.D. project aims to address such implementation obstacles and thereby propel the field of digital finance. During the project, you will closely collaborate with industry and a doctoral training network spread throughout Europe, including extended research stays abroad.

Apply now
  • Hi! Are you my
    new colleague?
    Matthijs Noordzij
  • Hi! Are you my
    new colleague?
    Theodora Spirova
  • Hi! Are you my
    new colleague?
    Tanya Bondarouk
  • Hi! Are you my
    new colleague?
    Ipek Topan

Key takeaways

  • Hours
    38 - 40 hr.
  • Salary indication
    Salary gross/monthly
    based on full-time
    € 2,770 - € 3,539
  • Deadline
    30 Apr 2024

The successful applicant will join the Industrial Engineering and Business Information Systems (IEBIS) section of the High-Tech Business & Entrepreneurship Department (HBE) at the Faculty of Behavioural, Management and Social Sciences (BMS).

Background

This Ph.D. position is one four positions at the University of Twente (UT) and one of 19 positions in the context of the international Marie Sk?odowska-Curie Actions project DIGITAL. For the general description of DIGITAL and its Ph.D. positions, please check this page. Information about all other positions is available at EURAXESS, if you would be interested in any of the other positions as well, clearly state that in your cover letter.

DIGITAL' main goal? To significantly advance the methodologies and business models for Digital Finance through the use of five interconnected research objectives:

1. Ensure sufficient data quality to contribute to the EU's efforts to build a single digital market for data;
2. Address deployment issues of complex artificial intelligence models for real-world financial problems;
3.  Validate the utility of pioneering eXplainable Artificial Intelligence (XAI) algorithms to financial applications and extend existing frameworks;
4. Design risk management tools concerning the applications of Blockchain technology in Finance;
5.  Simulate financial markets and evaluate products with a sustainability component.

The challenge

Reinforcement Learning (RL) has become a popular paradigm for automating decision-making under uncertainty in complex environments. Although deep RL has had several breakthroughs in recent years and proven impressive algorithmic performance in closed environments, it has not yet found its way to real-world applications in open environments. In practice, RL algorithms have to work with imperfect data, be integrated into existing ecosystems, and be of use to human decision-makers. Additionally, the financial sector is subject to heavy regulation and high standards concerning risk management, fairness, and explainability. Although successful integration of RL may enhance the quality of decision-making in digital finance, several hurdles need to be overcome. Thus, this Ph.D. project examines how RL can advance digital finance.

You will address several RL implementation issues in digital finance, including both technical challenges and domain-specific ones. Utility-based RL results will improve financial decision-making by developing multi-criteria analysis, extreme scenarios, and risk management methods. RL in decision support will be optimized for explainability, regulatory compliance, model abstractions, and human judgment. We will also examine technological challenges like digital twin environments, machine learning pipelines, and digital finance ecosystem integration.

Your profile

We look for a highly motivated, enthusiastic researcher who is driven by curiosity and has/is:

General skills:

  • Master’s degree or equivalent experience in Business, Economics, Engineering, Information Technology, Computational Science or related fields;
  • A strong passion and outstanding skills in data science and experience working with programming languages and statistical software such as Python, R, Stata or SAS;
  • Knowledge of quantitative modeling of financial markets, econometric techniques, machine learning, or quantitative empirical research methods;
  • The ability to work on real-world problems in an interdisciplinary and internationally oriented environment;
  • Good communication skills and an excellent command of English.

Project-specific skills:

  • Good programming skills. Experience with machine learning libraries (e.g., TensorFlow, PyTorch, Jax) is helpful;
  • Strong mathematical background, in particular statistics & probability, linear algebra, calculus, optimization, and Markov decision processes;
  • Knowledge of data engineering concepts such as machine learning pipelines, product deployment, and data ingestion;
  • Interest in practical applications of reinforcement learning, with attention to aspects such as explainability and regulation;
  • Familiarity with reinforcement learning (machine learning) is a plus.

Interested and motivated candidates are encouraged to apply, even when not yet possess all desired skills. Through self-driven learning and doctoral training, you will be able to develop relevant skills on the job.

Secondments at Industry and the European Central Bank

This Ph.D. position includes two research stays at industrial partners: Provisionally, you will be 18 months at CardoAI in Milan, Italy. Second, you will have six months at the European Central Bank (ECB) in Frankfurt, Germany. During those secondments, you will gain hands-on experience on industry-relevant research projects related to applications of AI in finance. Precise details are subject to change.

Our offer

We encourage high responsibility and independence while collaborating with colleagues, researchers, other university staff, and partners. We follow the terms of employment by the Dutch Collective Labour Agreement for Universities (CAO). Our offer contains: a full-time 4-year Ph.D. position with a qualifier in the first year; excellent mentorship in a stimulating research environment with excellent facilities; and a personal development program within the Twente Graduate School. It also includes:

  • Gross monthly salary of € 2.770 in the first year, increasing each year up to € 3.539 in the fourth year;
  • Excellent benefits including a holiday allowance of 8% of the gross annual salary, an end-of-year bonus of 8.3%, and a solid pension scheme;
  • 29 holidays per year in case of full-time employment;
  • A training program as part of the Twente Graduate School and the European MSCA Doctoral Training Programme on Digital Finance, where you and your supervisors will settle a plan for a suitable education and supervision;
  • A green campus with free access to sports facilities and an international scientific community;
  • A family-friendly institution that offers parental leave (both paid and unpaid);
  • A full status as an employee at the UT, including pension, health care benefits, and good secondary conditions are part of our collective labor agreement CAO-NU for Dutch universities.

Information and application

Are you interested in being part of our team? Please submit your application, and include:

The deadline for the application is 30 April 2024.

Additional information can be acquired via email from dr. Wouter van Heeswijk or dr. Joerg R. Osterrieder via email: msca-digitalfinance@utwente.nl.

Share this vacancy

About the department

The HBE cluster is dedicated to encouraging a supportive and inclusive working culture. Our aim is that all job applicants are given equal opportunities. When we select candidates for employment, it will be on the basis of their competence and ability. To support workforce diversity, we are open to offering flexible working conditions on an individual basis to support work-life balance, that may include a contract of employment, working hours and location, or childcare arrangements.

The High Business Entrepreneurship corporate video can be watched via this link.

About the organisation

The Faculty of Behavioral, Management and Social sciences (BMS) aims to play a key role in understanding, jointly developing and evaluating innovations in society. Technological developments are the engine of innovation. As a technical university that puts people first, we tailor them to human needs and behavior and use social engineering to integrate them into society. We also ensure adequate governance at public and private level, and robust, inclusive and fair organizational structures. We do this by developing, sharing and applying high-quality knowledge in Psychology, Business Administration, Public Administration, Communication Sciences, Philosophy, Educational Sciences and Health Sciences. Our research and education in these disciplines revolves around tackling and solving societal challenges. The research programs of BMS are closely linked to the research of the UT institutes Mesa+ Institute for Nanotechnology, TechMed Center and Digital Society Institute.

As an employer, the Faculty of BMS offers work that matters. We equip you to create new possibilities for yourself and for our society. With us, you will become part of a leading technical university with increasing, positive social impact. We offer an open, inclusive and entrepreneurial atmosphere, in which we encourage you to make healthy choices, for example through our flexible, adaptable benefits.

Want to know more?

Heeswijk, W.J.A. van (Wouter)

Heeswijk, W.J.A. van (Wouter)
Assistant Professor

Heeswijk, W.J.A. van (Wouter)
Assistant Professor

Do you have questions about this vacancy? Then you can contact Wouter for all substantive questions about this position and the application procedure. For general questions about working for the UT, please refer to the chatbot.

How to apply

Step 1

Apply.
When you see a vacancy that appeals to you, you can apply online. We ask you to upload a CV and motivation letter and/or list of publications. You will receive a confirmation of receipt by e-mail.

Apply now

Step 2

Selection.
The selection committee will review your application and you will receive a response within 2 weeks after the vacancy has been closed.

Step 3

1st interview.
The 1st (online or in person) meeting serves as an introduction where we introduce ourselves to you and you to us. You may be asked to give a short presentation. This will be further explained in the invitation.

Step 4

2nd interview.
In the second interview, we will further discuss the job content, your skills and your talents.

Step 5

The offer.
If the conversations are positive, you will be made a suitable offer. If applicable, we will sign you up for screening.

Your Colleagues

About the BMS faculty

Curious about what The Faculty of Behavioral, Management and Social sciences (BMS) stands for? Check out the BMS website for more information.

A job that matters

Create new opportunities for yourself, your colleagues and our society. Scientist or teacher, administrator or facilitator, thinker or doer, energetic leader or silent support – your work at the University of Twente matters. And you too!

  • Our mission
    Human Touch

    At the UT it’s all about people, in line with our university’s High Tech Human Touch philosophy. In everything we do, the well-being and future of our students and staff are paramount. From research and teaching to personnel management, campus management and the use of new technologies.

  • Our mission
    We are a university of technology

    Our university is a public institution that serves society. We are accountable to society for the ways in which we use our academic freedom. We are responsible for ensuring that the power of science and technology is harnessed to achieve the best possible impact in a changing world. We cherish our rich tradition of combining technical and social sciences in our five profiling themes: Improving healthcare by personalized technologies; Creating intelligent manufacturing systems; Shaping our world with smart materials; Engineering our digital society; and Engineering for a resilient world.

  • Our mission
    We help to strengthen society

    We help society meet the challenges of today and tomorrow. But we are also transparent about what science and technology can and cannot do in finding sustainable solutions. And help translate these solutions into everyday life.

  • Our mission
    We are sustainable

    We want our communities to flourish and show resilience, so we seize opportunities for innovation. We are knowledgeable and have an eye for what society needs. Our students and staff receive all the guidance they need in their quest for ecological, social and economic sustainability.
    “The University of Twente is all about people. Our sustainable technologies help to strengthen society.”

Browse all jobs