长期内记忆LSTM的结构通过捕获传感器激活的顺序及其时间依赖性，证明了智能家庭中日常生活识别活动的效率。尽管如此，它们仍然在处理语义和传感器的上下文方面仍然失败。超过孤立的ID及其有序的激活值，传感器也携带含义。实际上，他们的性质和活化类型可以翻译各种活动。他们的日志彼此相关，创建全局上下文。我们建议使用并比较两种自然语言处理嵌入方法，以增强活动序列分类任务中的基于LSTM的结构：Word2VEC，静态语义嵌入和ELMO，一个上下文嵌入。结果，在真正的智能家庭数据集上，表明该方法提供了有用的信息，例如传感器组织地图，并且在日常活动类之间产生了不太困惑。它有助于更​​好地在具有其他居民或宠物的竞争活动的数据集上执行。我们的测试还表明，嵌入式可以在不同的数据集上预先预先估计，而不是目标，从而实现转移学习。因此，我们表明考虑到传感器的背景和他们的语义增加了分类性能并启用转移学习。

老年人的数量越来越多，对医疗保健以及特别是康复医疗保健令人担忧。辅助技术和辅助机器人特别可能有助于改善这一过程。我们开发一个能够向患者展示康复锻炼的机器人教练，观看患者进行练习并给予他的反馈，以提高他的表现并鼓励他。该系统的HRI基于我们的研究与康复治疗师和目标人群的团队。系统依赖于人类运动分析。我们开发了一种学习概率表达的方法，从专家演示中学习理想运动。使用使用Microsoft Kinect V2捕获的位置和取向特征采用高斯混合模型。为了评估患者的动作，我们提出了一个时间的多级分析，暂时和空间上识别并解释了身体部位误差。该分析与分类算法相结合允许机器人提供教练建议，以使患者提高他的运动。三次康复演习的评价表明了提出的学习和评估Kinaesthetic运动的方法。

辅助机器人，特别是机器人教练可能非常有助于康复医疗保健。在这种情况下，我们提出了一种基于高斯过程潜在变量模型（GP-LVM）的方法，以在物理治疗师，机器人教练和患者之间转移知识。我们的模型能够将视觉人体功能映射到机器人数据，以便于机器人学习和模仿。此外，我们建议扩展模型，以适应机器人的理解，在评估康复练习期间对患者的身体限制。实验评估表明，根据患者的限制，机器人模仿和模型适应的有希望的结果。

Diabetic Retinopathy (DR) is a leading cause of vision loss in the world, and early DR detection is necessary to prevent vision loss and support an appropriate treatment. In this work, we leverage interactive machine learning and introduce a joint learning framework, termed DRG-Net, to effectively learn both disease grading and multi-lesion segmentation. Our DRG-Net consists of two modules: (i) DRG-AI-System to classify DR Grading, localize lesion areas, and provide visual explanations; (ii) DRG-Expert-Interaction to receive feedback from user-expert and improve the DRG-AI-System. To deal with sparse data, we utilize transfer learning mechanisms to extract invariant feature representations by using Wasserstein distance and adversarial learning-based entropy minimization. Besides, we propose a novel attention strategy at both low- and high-level features to automatically select the most significant lesion information and provide explainable properties. In terms of human interaction, we further develop DRG-Net as a tool that enables expert users to correct the system's predictions, which may then be used to update the system as a whole. Moreover, thanks to the attention mechanism and loss functions constraint between lesion features and classification features, our approach can be robust given a certain level of noise in the feedback of users. We have benchmarked DRG-Net on the two largest DR datasets, i.e., IDRID and FGADR, and compared it to various state-of-the-art deep learning networks. In addition to outperforming other SOTA approaches, DRG-Net is effectively updated using user feedback, even in a weakly-supervised manner.

Research has shown that climate change creates warmer temperatures and drier conditions, leading to longer wildfire seasons and increased wildfire risks in the United States. These factors have in turn led to increases in the frequency, extent, and severity of wildfires in recent years. Given the danger posed by wildland fires to people, property, wildlife, and the environment, there is an urgency to provide tools for effective wildfire management. Early detection of wildfires is essential to minimizing potentially catastrophic destruction. In this paper, we present our work on integrating multiple data sources in SmokeyNet, a deep learning model using spatio-temporal information to detect smoke from wildland fires. Camera image data is integrated with weather sensor measurements and processed by SmokeyNet to create a multimodal wildland fire smoke detection system. We present our results comparing performance in terms of both accuracy and time-to-detection for multimodal data vs. a single data source. With a time-to-detection of only a few minutes, SmokeyNet can serve as an automated early notification system, providing a useful tool in the fight against destructive wildfires.

Collecting large-scale medical datasets with fully annotated samples for training of deep networks is prohibitively expensive, especially for 3D volume data. Recent breakthroughs in self-supervised learning (SSL) offer the ability to overcome the lack of labeled training samples by learning feature representations from unlabeled data. However, most current SSL techniques in the medical field have been designed for either 2D images or 3D volumes. In practice, this restricts the capability to fully leverage unlabeled data from numerous sources, which may include both 2D and 3D data. Additionally, the use of these pre-trained networks is constrained to downstream tasks with compatible data dimensions. In this paper, we propose a novel framework for unsupervised joint learning on 2D and 3D data modalities. Given a set of 2D images or 2D slices extracted from 3D volumes, we construct an SSL task based on a 2D contrastive clustering problem for distinct classes. The 3D volumes are exploited by computing vectored embedding at each slice and then assembling a holistic feature through deformable self-attention mechanisms in Transformer, allowing incorporating long-range dependencies between slices inside 3D volumes. These holistic features are further utilized to define a novel 3D clustering agreement-based SSL task and masking embedding prediction inspired by pre-trained language models. Experiments on downstream tasks, such as 3D brain segmentation, lung nodule detection, 3D heart structures segmentation, and abnormal chest X-ray detection, demonstrate the effectiveness of our joint 2D and 3D SSL approach. We improve plain 2D Deep-ClusterV2 and SwAV by a significant margin and also surpass various modern 2D and 3D SSL approaches.

我们介绍了第一项经验研究，研究了突发性检测对意向检测和插槽填充的下游任务的影响。我们对越南人进行了这项研究，这是一种低资源语言，没有以前的研究，也没有公共数据集可用于探索。首先，我们通过手动添加上下文不满并注释它们来扩展流利的越南意图检测和插槽填充phoatis。然后，我们使用强基线进行实验进行实验，以基于预训练的语言模型，以检测和关节意图检测和插槽填充。我们发现：（i）爆发对下游意图检测和插槽填充任务的性能产生负面影响，并且（ii）在探索环境中，预先训练的多语言语言模型XLM-R有助于产生更好的意图检测和插槽比预先训练的单语言模型phobert填充表演，这与在流利性环境中通常发现的相反。

近年来，美国西部野蛮火灾的大小和频率显着增加。在高火灾日，小火点火可以迅速增长并失控。早期检测初始烟雾的火点火可以帮助响应在难以管理之前对这种火灾进行响应。过去的野火烟雾检测的深入学习方法遭受了小型或不可靠的数据集，使得难以将性能推断为现实世界的情景。在这项工作中，我们展示了火点火图书馆（Figlib），这是一个近25,000个标记的野火烟雾图像的公共数据集，从南加州部署的固定视图相机看。我们还介绍了Smokeynet，一种新的深度学习架构，使用相机图像的时空信息，用于实时野火烟雾检测。在迪拉布数据集上培训时，SmokeyNet优于相当的基线和竞争对手的人类性能。我们希望Figlib数据集和Smokynet架构的可用性将激励进一步研究野火烟雾检测的深度学习方法，导致自动化通知系统，减少野火响应的时间。

数十种归因方法背后的一个原理是在输入功能（此处，令牌）作为其归属中删除之前和之后的预测差异。流行的输入边缘化方法（IM）方法（Kim等，2020）使用BERT代替令牌，从而产生更合理的反事实。而Kim等人。 （2020）报道IM是有效的，我们发现这个结论并不令人信服，因为论文中使用的Deletionbert指标对IM有偏见。重要的是，这种偏见存在于基于缺失的指标中，包括插入，充分性和全面性。此外，我们使用6个指标和3个数据集的严格评估没有发现IM比剩余的（LOO）基线更好的证据。我们发现IM不比LOO更好的两个原因：（1）从输入中删除单个单词仅略微降低了分类器的精度； （2）一个高度可预测的词总是给出接近零的归因，无论其对分类器的真正重要性。相比之下，通过BERT使石灰样品更加自然可在几种咆哮指标下始终提高酸橙精度。

Here, we demonstrate how machine learning enables the prediction of comonomers reactivity ratios based on the molecular structure of monomers. We combined multi-task learning, multi-inputs, and Graph Attention Network to build a model capable of predicting reactivity ratios based on the monomers chemical structures.