Although a number of studies are devoted to novel category discovery, most of them assume a static setting where both labeled and unlabeled data are given at once for finding new categories. In this work, we focus on the application scenarios where unlabeled data are continuously fed into the category discovery system. We refer to it as the Continuous Category Discovery (CCD) problem, which is significantly more challenging than the static setting. A common challenge faced by novel category disc…