PhD position on understanding algorithmic collusion by decentralized multiagent reinforcement learning
This PhD position offers you the opportunity to join an international and interdisciplinary community of researchers getting to grips with the dynamics of decentralized multiagent reinforcement learning. Your contributions will be from the perspective of applied mathematics but will be strongly motivated by social welfare considerations.
How can we design decentralized multiagent reinforcement learning (MARL) algorithms with equilibrium selection control? This is the central research question of this PhD project. We will be particularly interested in determining whether decentralized MARL algorithms used for pricing or trading can learn to collaborate to raise prices. By developing an understanding of if and how this is possible, we can inform policymakers on how to regulate the use of algorithms in such environments.
To address this issue, we will begin by characterizing the probability of reaching different equilibria under the dynamics of provably convergent decentralized MARL algorithms. With this characterization in hand, we will study how design choices in the algorithmic structure affect these probabilities. These two steps will initially be executed for simple environments and with deterministic dynamics, and then they will be scaled up to more complex environments with stochastic dynamics. Our starting point will be the Decentralized Q-learning algorithm, as it offers significant flexibility in its design and is provably convergent in a large class of games.
Information and application
Are you interested in this position? Please send your application via the 'Apply now' button below before the 4th of March and include:
- A cover letter (maximum 2 pages A4), emphasizing your specific interest, qualifications, motivations to apply for this position.
- A Curriculum Vitae, including a list of all courses attended and grades obtained, and, if applicable, a list of publications and references.
- An IELTS-test, Internet TOEFL test (TOEFL-iBT), or a Cambridge CAE-C (CPE). Applicants with a non-Dutch qualification and who have not had secondary and tertiary education in English can only be admitted with an IELTS-test showing a total band score of at least 6.5, internet. TOEFL test (TOEFL-iBT) showing a score of at least 90, or a Cambridge CAE-C (CPE).
For more information regarding this position, you are welcome to contact (Janusz Meylahn at firstname.lastname@example.org)
About the department
The position will be in the Applied Mathematics department. The Applied Mathematics department has an active research portfolio in stochastic operations research, algorithmic discrete mathematics, complex networks, statistics, systems theory, computational science, and artificial intelligence with applications in health care, energy systems, traffic, and imaging. See MOR and SACS, and MDS
Our research group, Stochastic Operations Research (SOR), conducts mathematical education and research of internationally high standards in the areas of stochastic processes and mathematics of operations research to contribute to the development of mathematics in a multidisciplinary engineering environment and contribute to a better understanding and functioning of our increasingly complex society. See SOR.
About the organisation
The faculty of Electrical Engineering, Mathematics and Computer Science (EEMCS) uses mathematics, electronics and computer technology to contribute to the development of Information and Communication Technology (ICT). With ICT present in almost every device and product we use nowadays, we embrace our role as contributors to a broad range of societal activities and as pioneers of tomorrow's digital society. As part of a people-first tech university that aims to shape society, individuals and connections, our faculty works together intensively with industrial partners and researchers in the Netherlands and abroad, and conducts extensive research for external commissioning parties and funders. Our research has a high profile both in the Netherlands and internationally. It has been accommodated in three multidisciplinary UT research institutes: Mesa+ Institute, TechMed Centre and Digital Society Institute.