Planned intervention: On Thursday March 28th 07:00 UTC Zenodo will be unavailable for up to 5 minutes to perform a database upgrade.
Published January 2, 2023 | Version v1
Conference paper Open

AdvisIL - A Class-Incremental Learning Advisor

  • 1. Université Paris-Saclay, CEA, LIST
  • 2. Université Grenoble Alpes, CEA, LIST
  • 3. Université Paris-Saclay, CentraleSupélec

Description

Recent class-incremental learning methods combine deep neural architectures and learning algorithms to handle streaming data under memory and computational constraints. The performance of existing methods varies depending on the characteristics of the incremental process. To date, there is no other approach than to test all pairs of learning algorithms and neural architectures on the training data available at the start of the learning process to select a suited algorithm-architecture combination. To tackle this problem, in this article, we introduce AdvisIL, a method which takes as input the main characteristics of the incremental process (memory budget for the deep model, initial number of classes, size of incremental steps) and recommends an adapted pair of learning algorithm and neural architecture. The recommendation is based on a similarity between the user-provided settings and a large set of pre-computed experiments. AdvisIL makes class-incremental learning easier, since users do not need to run cumbersome experiments to design their system. We evaluate our method on four datasets under six incremental settings and three deep model sizes. We compare six algorithms and three deep neural architectures. Results show that AdvisIL has better overall performance than any of the individual combinations of a learning algorithm and a neural architecture. AdvisIL's code is available at https://github.com/EvaJF/AdvisIL.

Files

AdvisIL_camera_ready.pdf

Files (1.1 MB)

Name Size Download all
md5:6e483f848bbaf6417e136839769fd1ea
674.2 kB Preview Download
md5:f14e0a61ee07a119d1dc4686804a695b
378.4 kB Preview Download

Additional details

Funding

AI4Media – A European Excellence Centre for Media, Society and Democracy 951911
European Commission