This paper focuses on the prevalent performance imbalance in the stages of incremental learning. To avoid obvious stage learning bottlenecks, we propose a brand-new stage-isolation based incremental learning framework, which leverages a series of stage-isolated classifiers to perform the learning task of each stage without the interference of others. To be concrete, to aggregate multiple stage classifiers as a uniform one impartially, we first introduce a temperature-controlled energy metric for indicating the confidence score levels of the stage classifiers. We then propose an anchor-based energy self-normalization strategy to ensure the stage classifiers work at the same energy level. Finally, we design a voting-based inference augmentation strategy for robust inference. The proposed method is rehearsal free and can work for almost all continual learning scenarios. We evaluate the proposed method on four large benchmarks. Extensive results demonstrate the superiority of the proposed method in setting up new state-of-the-art overall performance. \emph{Code is available at} \url{https://github.com/iamwangyabin/ESN}.

在本文中，我们提出了一种新的机构指导的半监督计数方法。首先，我们建立了一个可学习的辅助结构，即密度代理，将公认的前景区域特征带到相应的密度子类（代理）和推开背景的区域。其次，我们提出了密度引导的对比度学习损失，以巩固主链特征提取器。第三，我们通过使用变压器结构进一步完善前景特征来构建回归头。最后，提供了有效的噪声抑郁丧失，以最大程度地减少注释噪声的负面影响。对四个挑战性人群计数数据集进行的广泛实验表明，我们的方法在很大的边距中实现了与最先进的半监督计数方法相比最先进的性能。代码可用。

最新的深层神经网络仍在努力解决持续学习中的灾难性遗忘问题。在本文中，我们提出了一种简单的范式（称为S宣传）和两种具体方法，以高度降低最典型的连续学习场景之一，即域增量学习（DIL）。范式的关键思想是通过预先训练的变压器独立学习提示，以避免使用常规方法中通常出现的示例。这导致了双赢游戏，提示可以为每个域获得最佳状态。跨域的独立提示仅请求一个单一的跨凝结损失，以进行训练，而一个简单的K-NN操作作为推理的域标识符。学习范式得出了图像及时的学习方法和全新的语言图像及时学习方法。拥有出色的可伸缩性（每个域的参数增加0.03％），我们最好的方法在三个标准的最先进的无典范方法上实现了显着的相对改进（平均约30％）当他们使用示例时，DIL任务甚至相对超过了他们的最好的任务。

本文旨在解决一次性对象计数的具有挑战性的任务。鉴于包含新颖的图像，以前看不见的类别对象的图像，任务的目标是仅使用一个支持边界框示例计算所需类别中的所有实例。为此，我们提出了一个计数模型，您只需要查看一个实例（LAONET）。首先，特征相关模块结合了自我关注和相关的模块来学习内部关系和关系。它使得网络能够在不同的情况下对旋转和尺寸的不一致具有稳健性。其次，刻度聚合机制旨在帮助提取具有不同比例信息的特征。与现有的几次计数方法相比，LaOnet在以高收敛速度学习时达到最先进的结果。代码即将推出。

无意识和自发的，微小表达在一个人的真实情绪的推动中是有用的，即使尝试隐藏它们。由于它们短的持续时间和低强度，对微表达的识别是情感计算中的艰巨任务。基于手工制作的时空特征的早期工作最近被不同的深度学习方法取代了现在竞争最先进的性能。然而，捕获本地和全球时空模式的问题仍然挑战。为此，本文我们提出了一种新颖的时空变压器架构 - 据我们所知，是微表达识别的第一种纯粹变压器的方法（即任何卷积网络使用的方法）。该架构包括用于学习空间模式的空间编码器，用于时间维度分析的时间聚合器和分类头。三种广泛使用的自发性微表达数据集，即Smic-HS，Casme II和SAMM的综合评估表明，该方法始终如一地优于现有技术，是发表在微表达上发表文献中的第一个框架在任何上述数据集上识别以实现未加权的F1分数大于0.9。

3D视觉跟踪对深度空间勘探程序非常重要，这可以保证航天器灵活地接近目标。在本文中，我们专注于3D跟踪的学习准确和实时方法。考虑到这一主题几乎没有公共数据集，提出了一个新的大规模3D小行星跟踪数据集，包括双目视频序列，深度图和各种各样的小行星的点云，具有各种形状和纹理。从仿真平台的电源和便利性中受益，将自动生成所有2D和3D注释。同时，我们提出了一个基于深度学习的3D跟踪框架，名称为Track3D，其涉及2D单眼跟踪器和新型轻量级Amodal轴对齐边界箱网络，A3BoxNet。评估结果表明，与基线算法相比，Track3D以准确性和精度实现了最先进的3D跟踪性能。此外，我们的框架具有良好的概括能力，可提供2D单眼跟踪性能。

Existing federated classification algorithms typically assume the local annotations at every client cover the same set of classes. In this paper, we aim to lift such an assumption and focus on a more general yet practical non-IID setting where every client can work on non-identical and even disjoint sets of classes (i.e., client-exclusive classes), and the clients have a common goal which is to build a global classification model to identify the union of these classes. Such heterogeneity in client class sets poses a new challenge: how to ensure different clients are operating in the same latent space so as to avoid the drift after aggregation? We observe that the classes can be described in natural languages (i.e., class names) and these names are typically safe to share with all parties. Thus, we formulate the classification problem as a matching process between data representations and class representations and break the classification model into a data encoder and a label encoder. We leverage the natural-language class names as the common ground to anchor the class representations in the label encoder. In each iteration, the label encoder updates the class representations and regulates the data representations through matching. We further use the updated class representations at each round to annotate data samples for locally-unaware classes according to similarity and distill knowledge to local models. Extensive experiments on four real-world datasets show that the proposed method can outperform various classical and state-of-the-art federated learning methods designed for learning with non-IID data.

This is paper for the smooth function approximation by neural networks (NN). Mathematical or physical functions can be replaced by NN models through regression. In this study, we get NNs that generate highly accurate and highly smooth function, which only comprised of a few weight parameters, through discussing a few topics about regression. First, we reinterpret inside of NNs for regression; consequently, we propose a new activation function--integrated sigmoid linear unit (ISLU). Then special charateristics of metadata for regression, which is different from other data like image or sound, is discussed for improving the performance of neural networks. Finally, the one of a simple hierarchical NN that generate models substituting mathematical function is presented, and the new batch concept ``meta-batch" which improves the performance of NN several times more is introduced. The new activation function, meta-batch method, features of numerical data, meta-augmentation with metaparameters, and a structure of NN generating a compact multi-layer perceptron(MLP) are essential in this study.

Detecting abrupt changes in data distribution is one of the most significant tasks in streaming data analysis. Although many unsupervised Change-Point Detection (CPD) methods have been proposed recently to identify those changes, they still suffer from missing subtle changes, poor scalability, or/and sensitive to noise points. To meet these challenges, we are the first to generalise the CPD problem as a special case of the Change-Interval Detection (CID) problem. Then we propose a CID method, named iCID, based on a recent Isolation Distributional Kernel (IDK). iCID identifies the change interval if there is a high dissimilarity score between two non-homogeneous temporal adjacent intervals. The data-dependent property and finite feature map of IDK enabled iCID to efficiently identify various types of change points in data streams with the tolerance of noise points. Moreover, the proposed online and offline versions of iCID have the ability to optimise key parameter settings. The effectiveness and efficiency of iCID have been systematically verified on both synthetic and real-world datasets.

Time-series anomaly detection is an important task and has been widely applied in the industry. Since manual data annotation is expensive and inefficient, most applications adopt unsupervised anomaly detection methods, but the results are usually sub-optimal and unsatisfactory to end customers. Weak supervision is a promising paradigm for obtaining considerable labels in a low-cost way, which enables the customers to label data by writing heuristic rules rather than annotating each instance individually. However, in the time-series domain, it is hard for people to write reasonable labeling functions as the time-series data is numerically continuous and difficult to be understood. In this paper, we propose a Label-Efficient Interactive Time-Series Anomaly Detection (LEIAD) system, which enables a user to improve the results of unsupervised anomaly detection by performing only a small amount of interactions with the system. To achieve this goal, the system integrates weak supervision and active learning collaboratively while generating labeling functions automatically using only a few labeled data. All of these techniques are complementary and can promote each other in a reinforced manner. We conduct experiments on three time-series anomaly detection datasets, demonstrating that the proposed system is superior to existing solutions in both weak supervision and active learning areas. Also, the system has been tested in a real scenario in industry to show its practicality.