Javascript must be enabled for the correct page display

Do Not Learn If You Trust Yourself: Efficient Resource-Constrained Online Learning Using Uncertainty

Tešnar, Michal (2024) Do Not Learn If You Trust Yourself: Efficient Resource-Constrained Online Learning Using Uncertainty. Bachelor's Thesis, Artificial Intelligence.

[img]
Preview
Text
Bachelor_s_Thesis.pdf

Download (21MB) | Preview
[img] Text
toestemming.pdf
Restricted to Registered users only

Download (136kB)

Abstract

Machine learning proves effective in constructing dynamics models from data, especially for underwater vehicles. Continuous refinement of these models using incoming data streams, however, often requires storage of an overwhelming amount of redundant data. This thesis investigates the use of uncertainty in the selection of data points to rehearse in online learning when storage capacity is constrained. The models are learned using an ensemble of multilayer perceptrons as they perform well at predicting epistemic uncertainty. We present three novel approaches: the Threshold method, which excludes samples with uncertainty below a specified threshold, the Greedy method, designed to maximize uncertainty among the stored points, and Threshold-Greedy, which combines the previous two approaches. The methods are assessed on data collected by an underwater vehicle Dagon. Comparison with baselines reveals that the Threshold exhibits enhanced stability throughout the learning process and also yields a final model with the lowest testing loss. We also conducted detailed analyses on the impact of model parameters and storage size on the performance of the models.

Item Type: Thesis (Bachelor's Thesis)
Supervisor name: Valdenegro Toro, M.A.
Degree programme: Artificial Intelligence
Thesis type: Bachelor's Thesis
Language: English
Date Deposited: 29 Feb 2024 12:29
Last Modified: 29 Feb 2024 12:29
URI: https://fse.studenttheses.ub.rug.nl/id/eprint/32004

Actions (login required)

View Item View Item