- SUMO
- MATLAB
- Code
- ML
- Online-learning
- MAB
- Tutorials
- Notes
- Experiment
•
•
•
•
•
•
•
•
-
UCB Under Gradual Distribution Decay
Investigating how UCB exploration parameters interact with different rates of gradual arm quality degradation
-
UCB Under Non-stochastic Enviroment
Exploring how UCB algorithms adapt when arm reward distributions suddenly shift in non-stationary environments
-
UCB Exploration in Sparse Rewarded Bandits
Investigating how UCB hyperparameter affects arm selection when dealing with sparse reward distributions in stochastic multi-armed bandits
-
MAB: A Introduction
An overview of the classic multi-armed bandit problem and its three main variants - stochastic, adversarial, and Bayesian bandits, with a brief look at contextual extensions
-
SUMO Simulation with Ray Tracing
A comprehensive tutorial on creating vehicular networks with SUMO and MATLAB ray tracing