Forgetful Exploration

Here, I provide a vibe-coded dashboard for interactive visualization of our Gaussian-process forgetful generalization model (see preprint). The model instantiates an exploration/exploitation mechanism with time- and reward-based forgetfulness. The main innovation is adapting the notion of heteroskedastic Gaussian Process Regression to the process of Episodic RL with variable-precision memory that depends on time and asymmetric, reward-modulated surprise. The model app is expected to change until we consolidate the model and publish the results.

Go to app Preprint