2026-03-02

Title: U-CAN: Utility-Aware Contrastive Attenuation for Efficient Unlearning in Generative Recommendation

• Authors: Zezheng Wu, Rui Wang, Xinghe Cheng, Yang Shao, Qing Yang, Jiapu Wang, Jingwei Zhang
• Subjects: cs.LG
• Abstract URL: https://arxiv.org/abs/2602.23400
• Pdf URL: https://arxiv.org/pdf/2602.23400
• Copy Paste: [[2602.23400]] U-CAN: Utility-Aware Contrastive Attenuation for Efficient Unlearning in Generative Recommendation(https://arxiv.org/abs/2602.23400)
• Keywords: generation, generative
• Abstract: Generative Recommendation (GenRec) typically leverages Large Language Models (LLMs) to redefine personalization as an instruction-driven sequence generation task. However, fine-tuning on user logs inadvertently encodes sensitive attributes into model parameters, raising critical privacy concerns. Existing Machine Unlearning (MU) techniques struggle to navigate this tension due to the Polysemy Dilemma, where neurons superimpose sensitive data with general reasoning patterns, leading to catastrophic utility loss under traditional gradient or pruning methods. To address this, we propose Utility-aware Contrastive AttenuatioN (U-CAN), a precision unlearning framework that operates on low-rank adapters. U-CAN quantifies risk by contrasting activations and focuses on neurons with asymmetric responses that are highly sensitive to the forgetting set but suppressed on the retention set. To safeguard performance, we introduce a utility-aware calibration mechanism that combines weight magnitudes with retention-set activation norms, assigning higher utility scores to dimensions that contribute strongly to retention performance. Unlike binary pruning, which often fragments network structure, U-CAN develop adaptive soft attenuation with a differentiable decay function to selectively down-scale high-risk parameters on LoRA adapters, suppressing sensitive retrieval pathways and preserving the topological connectivity of reasoning circuits. Experiments on two public datasets across seven metrics demonstrate that U-CAN achieves strong privacy forgetting, utility retention, and computational efficiency.
• 摘要：生成推荐 (GenRec) 通常利用大型语言模型 (LLM) 将个性化重新定义为指令驱动的序列生成任务。然而，对用户日志的微调会无意中将敏感属性编码到模型参数中，从而引发严重的隐私问题。由于多义困境，现有的机器遗忘（MU）技术难以应对这种紧张局势，即神经元将敏感数据与一般推理模式叠加，导致传统梯度或修剪方法下灾难性的效用损失。为了解决这个问题，我们提出了实用感知对比衰减（U-CAN），这是一种在低阶适配器上运行的精确忘却框架。 U-CAN 通过对比激活来量化风险，并关注具有不对称反应的神经元，这些神经元对遗忘集高度敏感，但对保留集受到抑制。为了保障性能，我们引入了一种效用感知校准机制，该机制将权重大小与保留集激活规范相结合，为对保留性能有很大贡献的维度分配更高的效用分数。与经常破坏网络结构的二元剪枝不同，U-CAN 开发了具有可微衰减函数的自适应软衰减，可以选择性地缩小 LoRA 适配器上的高风险参数，抑制敏感检索路径并保留推理电路的拓扑连接性。对两个公共数据集的七个指标的实验表明，U-CAN 实现了强大的隐私遗忘、效用保留和计算效率。

Title: DesignSense: A Human Preference Dataset and Reward Modeling Framework for Graphic Layout Generation

• Authors: Varun Gopal, Rishabh Jain, Aradhya Mathur, Nikitha SR, Sohan Patnaik, Sudhir Yarram, Mayur Hemani, Balaji Krishnamurthy, Mausoom Sarkar
• Subjects: cs.CV, cs.AI
• Abstract URL: https://arxiv.org/abs/2602.23438
• Pdf URL: https://arxiv.org/pdf/2602.23438
• Copy Paste: [[2602.23438]] DesignSense: A Human Preference Dataset and Reward Modeling Framework for Graphic Layout Generation(https://arxiv.org/abs/2602.23438)
• Keywords: generation
• Abstract: Graphic layouts serve as an important and engaging medium for visual communication across different channels. While recent layout generation models have demonstrated impressive capabilities, they frequently fail to align with nuanced human aesthetic judgment. Existing preference datasets and reward models trained on text-to-image generation do not generalize to layout evaluation, where the spatial arrangement of identical elements determines quality. To address this critical gap, we introduce DesignSense-10k, a large-scale dataset of 10,235 human-annotated preference pairs for graphic layout evaluation. We propose a five-stage curation pipeline that generates visually coherent layout transformations across diverse aspect ratios, using semantic grouping, layout prediction, filtering, clustering, and VLM-based refinement to produce high-quality comparison pairs. Human preferences are annotated using a 4-class scheme (left, right, both good, both bad) to capture subjective ambiguity. Leveraging this dataset, we train DesignSense, a vision-language model-based classifier that substantially outperforms existing open-source and proprietary models across comprehensive evaluation metrics (54.6% improvement in Macro F1 over the strongest proprietary baseline). Our analysis shows that frontier VLMs remain unreliable overall and fail catastrophically on the full four-class task, underscoring the need for specialized, preference-aware models. Beyond the dataset, our reward model DesignSense yields tangible downstream gains in layout generation. Using our judge during RL based training improves generator win rate by about 3%, while inference-time scaling, which involves generating multiple candidates and selecting the best one, provides a 3.6% improvement. These results highlight the practical impact of specialized, layout-aware preference modeling on real-world layout generation quality.
• 摘要：图形布局是跨不同渠道进行视觉交流的重要且引人入胜的媒介。虽然最近的布局生成模型已经展示了令人印象深刻的功能，但它们经常无法符合细致入微的人类审美判断。现有的在文本到图像生成上训练的偏好数据集和奖励模型不能推广到布局评估，其中相同元素的空间排列决定质量。为了解决这一关键差距，我们引入了 DesignSense-10k，这是一个包含 10,235 个人工注释偏好对的大型数据集，用于图形布局评估。我们提出了一个五阶段的管理管道，它使用语义分组、布局预测、过滤、聚类和基于 VLM 的细化来生成跨不同宽高比的视觉连贯布局转换，以生成高质量的比较对。人类偏好使用 4 类方案（左、右、都好、都坏）来注释，以捕获主观模糊性。利用该数据集，我们训练 DesignSense，这是一种基于视觉语言模型的分类器，在综合评估指标上大大优于现有的开源和专有模型（Macro F1 比最强的专有基线提高了 54.6%）。我们的分析表明，前沿 VLM 总体上仍然不可靠，并且在完整的四类任务上会灾难性地失败，这强调了对专门的偏好感知模型的需求。除了数据集之外，我们的奖励模型 DesignSense 在布局生成方面产生了切实的下游收益。在基于 RL 的训练期间使用我们的判断将生成器获胜率提高了约 3%，而推理时间缩放（涉及生成多个候选者并选择最佳候选者）提供了 3.6% 的改进。这些结果强调了专门的布局感知偏好建模对现实布局生成质量的实际影响。

Title: Synthetic Visual Genome 2: Extracting Large-scale Spatio-Temporal Scene Graphs from Videos

• Authors: Ziqi Gao, Jieyu Zhang, Wisdom Oluchi Ikezogwo, Jae Sung Park, Tario G. You, Daniel Ogbu, Chenhao Zheng, Weikai Huang, Yinuo Yang, Winson Han, Quan Kong, Rajat Saini, Ranjay Krishna
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.23543
• Pdf URL: https://arxiv.org/pdf/2602.23543
• Copy Paste: [[2602.23543]] Synthetic Visual Genome 2: Extracting Large-scale Spatio-Temporal Scene Graphs from Videos(https://arxiv.org/abs/2602.23543)
• Keywords: generation
• Abstract: We introduce Synthetic Visual Genome 2 (SVG2), a large-scale panoptic video scene graph dataset. SVG2 contains over 636K videos with 6.6M objects, 52.0M attributes, and 6.7M relations, providing an order-of-magnitude increase in scale and diversity over prior spatio-temporal scene graph datasets. To create SVG2, we design a fully automated pipeline that combines multi-scale panoptic segmentation, online-offline trajectory tracking with automatic new-object discovery, per-trajectory semantic parsing, and GPT-5-based spatio-temporal relation inference. Building on this resource, we train TRaSER, a video scene graph generation model. TRaSER augments VLMs with a trajectory-aligned token arrangement mechanism and new modules: an object-trajectory resampler and a temporal-window resampler to convert raw videos and panoptic trajectories into compact spatio-temporal scene graphs in a single forward pass. The temporal-window resampler binds visual tokens to short trajectory segments to preserve local motion and temporal semantics, while the object-trajectory resampler aggregates entire trajectories to maintain global context for objects. On the PVSG, VIPSeg, VidOR and SVG2 test datasets, TRaSER improves relation detection by +15 to 20%, object prediction by +30 to 40% over the strongest open-source baselines and by +13% over GPT-5, and attribute prediction by +15%. When TRaSER's generated scene graphs are sent to a VLM for video question answering, it delivers a +1.5 to 4.6% absolute accuracy gain over using video only or video augmented with Qwen2.5-VL's generated scene graphs, demonstrating the utility of explicit spatio-temporal scene graphs as an intermediate representation.
• 摘要：我们引入了 Synthetic Visual Genome 2 (SVG2)，这是一个大规模全景视频场景图数据集。 SVG2 包含超过 636K 个视频，其中包含 660 万个对象、5200 万个属性和 670 万个关系，与之前的时空场景图数据集相比，其规模和多样性增加了数量级。为了创建 SVG2，我们设计了一个全自动管道，将多尺度全景分割、在线离线轨迹跟踪与自动新对象发现、每轨迹语义解析和基于 GPT-5 的时空关系推理相结合。在此资源的基础上，我们训练了 TRaSER，一种视频场景图生成模型。 TRaSER 通过轨迹对齐标记排列机制和新模块增强了 VLM：对象轨迹重采样器和时间窗口重采样器，可在单次前向传递中将原始视频和全景轨迹转换为紧凑的时空场景图。时间窗口重采样器将视觉标记绑定到短轨迹段以保留局部运动和时间语义，而对象轨迹重采样器聚合整个轨迹以维护对象的全局上下文。在 PVSG、VIPSeg、VidOR 和 SVG2 测试数据集上，TRaSER 将关系检测提高了 15% 到 20%，将对象预测提高了 30% 到 40%，比最强的开源基线提高了 30% 到 40%，比 GPT-5 提高了 13%，将属性预测提高了 15%。当 TRaSER 生成的场景图发送到 VLM 进行视频问答时，与仅使用视频或使用 Qwen2.5-VL 生成的场景图增强的视频相比，它的绝对准确度增益提高了 +1.5 至 4.6%，这证明了显式时空场景图作为中间表示的实用性。

Title: Rudder: Steering Prefetching in Distributed GNN Training using LLM Agents

• Authors: Aishwarya Sarkar, Sayan Ghosh, Nathan Tallent, Aman Chadha, Tanya Roosta, Ali Jannesari
• Subjects: cs.LG, cs.AI, cs.DC, cs.MA, cs.PF
• Abstract URL: https://arxiv.org/abs/2602.23556
• Pdf URL: https://arxiv.org/pdf/2602.23556
• Copy Paste: [[2602.23556]] Rudder: Steering Prefetching in Distributed GNN Training using LLM Agents(https://arxiv.org/abs/2602.23556)
• Keywords: generative
• Abstract: Large-scale Graph Neural Networks (GNNs) are typically trained by sampling a vertex's neighbors to a fixed distance. Because large input graphs are distributed, training requires frequent irregular communication that stalls forward progress. Moreover, fetched data changes with graph, graph distribution, sample and batch parameters, and caching polices. Consequently, any static prefetching method will miss crucial opportunities to adapt to different dynamic conditions. In this paper, we introduce Rudder, a software module embedded in the state-of-the-art AWS DistDGL framework, to autonomously prefetch remote nodes and minimize communication. Rudder's adaptation contrasts with both standard heuristics and traditional ML classifiers. We observe that the generative AI found in contemporary Large Language Models (LLMs) exhibits emergent properties like In-Context Learning (ICL) for zero-shot tasks, with logical multi-step reasoning. We find this behavior well-suited for adaptive control even with substantial undertraining. Evaluations using standard datasets and unseen configurations on the NERSC Perlmutter supercomputer show up to 91% improvement in end-to-end training performance over baseline DistDGL (no prefetching), and an 82% improvement over static prefetching, reducing communication by over 50%. Our code is available at this https URL.
• 摘要：大规模图神经网络 (GNN) 通常通过将顶点的邻居采样到固定距离来进行训练。由于大型输入图是分布式的，因此训练需要频繁的不规则通信，从而阻碍前进。此外，获取的数据随图形、图形分布、样本和批次参数以及缓存策略而变化。因此，任何静态预取方法都会错过适应不同动态条件的关键机会。在本文中，我们介绍了 Rudder，这是一个嵌入最先进的 AWS DistDGL 框架中的软件模块，用于自动预取远程节点并最大程度地减少通信。 Rudder 的适应与标准启发式和传统的机器学习分类器形成鲜明对比。我们观察到，当代大型语言模型 (LLM) 中的生成式人工智能表现出诸如用于零样本任务的上下文学习 (ICL) 等新兴特性，并具有逻辑多步骤推理。我们发现这种行为非常适合自适应控制，即使训练不足。在 NERSC Perlmutter 超级计算机上使用标准数据集和未见过的配置进行的评估显示，与基线 DistDGL（无预取）相比，端到端训练性能提高了 91%，比静态预取提高了 82%，从而减少了 50% 以上的通信。我们的代码可以在这个 https URL 上找到。

Title: Flowette: Flow Matching with Graphette Priors for Graph Generation

• Authors: Asiri Wijesinghe, Sevvandi Kandanaarachchi, Daniel M. Steinberg, Cheng Soon Ong
• Subjects: cs.LG, cs.AI
• Abstract URL: https://arxiv.org/abs/2602.23566
• Pdf URL: https://arxiv.org/pdf/2602.23566
• Copy Paste: [[2602.23566]] Flowette: Flow Matching with Graphette Priors for Graph Generation(https://arxiv.org/abs/2602.23566)
• Keywords: generation, generative
• Abstract: We study generative modeling of graphs with recurring subgraph motifs. We propose Flowette, a continuous flow matching framework, that employs a graph neural network based transformer to learn a velocity field defined over graph representations with node and edge attributes. Our model preserves topology through optimal transport based coupling, and long-range structural dependencies through regularisation. To incorporate domain driven structural priors, we introduce graphettes, a new probabilistic family of graph structure models that generalize graphons via controlled structural edits for motifs like rings, stars and trees. We theoretically analyze the coupling, invariance, and structural properties of the proposed framework, and empirically evaluate it on synthetic and small-molecule graph generation tasks. Flowette demonstrates consistent improvements, highlighting the effectiveness of combining structural priors with flow-based training for modeling complex graph distributions.
• 摘要：我们研究具有重复子图主题的图的生成模型。我们提出 Flowette，一种连续流匹配框架，它采用基于图神经网络的变压器来学习在具有节点和边属性的图表示上定义的速度场。我们的模型通过基于最佳传输的耦合来保留拓扑，并通过正则化来保留远程结构依赖性。为了整合领域驱动的结构先验，我们引入了石墨烯，这是一种新的概率图结构模型系列，它通过对环、星形和树等图案的受控结构编辑来概括石墨子。我们从理论上分析了所提出框架的耦合性、不变性和结构特性，并在合成和小分子图生成任务上对其进行了实证评估。 Flowette 展示了持续的改进，强调了将结构先验与基于流的训练相结合来建模复杂图分布的有效性。

Title: Hyperdimensional Cross-Modal Alignment of Frozen Language and Image Models for Efficient Image Captioning

• Authors: Abhishek Dalvi, Vasant Honavar
• Subjects: cs.CV, cs.AI, cs.LG
• Abstract URL: https://arxiv.org/abs/2602.23588
• Pdf URL: https://arxiv.org/pdf/2602.23588
• Copy Paste: [[2602.23588]] Hyperdimensional Cross-Modal Alignment of Frozen Language and Image Models for Efficient Image Captioning(https://arxiv.org/abs/2602.23588)
• Keywords: generation
• Abstract: Large unimodal foundation models for vision and language encode rich semantic structures, yet aligning them typically requires computationally intensive multimodal fine-tuning. Such approaches depend on large-scale parameter updates, are resource intensive, and can perturb pretrained representations. Emerging evidence suggests, however, that independently trained foundation models may already exhibit latent semantic compatibility, reflecting shared structures in the data they model. This raises a fundamental question: can cross-modal alignment be achieved without modifying the models themselves? Here we introduce HDFLIM (HyperDimensional computing with Frozen Language and Image Models), a framework that establishes cross-modal mappings while keeping pretrained vision and language models fully frozen. HDFLIM projects unimodal embeddings into a shared hyperdimensional space and leverages lightweight symbolic operations -- binding, bundling, and similarity-based retrieval to construct associative cross-modal representations in a single pass over the data. Caption generation emerges from high-dimensional memory retrieval rather than iterative gradient-based optimization. We show that HDFLIM achieves performance comparable to end-to-end vision-language training methods and produces captions that are more semantically grounded than zero-shot baselines. By decoupling alignment from parameter tuning, our results suggest that semantic mapping across foundation models can be realized through symbolic operations on hyperdimensional encodings of the respective embeddings. More broadly, this work points toward an alternative paradigm for foundation model alignment in which frozen models are integrated through structured representational mappings rather than through large-scale retraining. The codebase for our implementation can be found at this https URL.
• 摘要：用于视觉和语言的大型单模态基础模型编码丰富的语义结构，但对齐它们通常需要计算密集型的多模态微调。此类方法依赖于大规模参数更新，是资源密集型的，并且可能会扰乱预训练的表示。然而，新出现的证据表明，独立训练的基础模型可能已经表现出潜在的语义兼容性，反映了它们建模的数据中的共享结构。这就提出了一个基本问题：可以在不修改模型本身的情况下实现跨模态对齐吗？在这里，我们介绍 HDFLIM（使用冻结语言和图像模型的超维计算），这是一个建立跨模式映射的框架，同时保持预训练的视觉和语言模型完全冻结。 HDFLIM 将单模态嵌入投影到共享的超维空间中，并利用轻量级符号操作（绑定、捆绑和基于相似性的检索）在一次数据传递中构建关联的跨模态表示。字幕生成来自高维记忆检索，而不是基于迭代梯度的优化。我们证明 HDFLIM 的性能可与端到端视觉语言训练方法相媲美，并且生成的字幕比零样本基线在语义上更加基础。通过将对齐与参数调整解耦，我们的结果表明，跨基础模型的语义映射可以通过对各个嵌入的超维编码进行符号操作来实现。更广泛地说，这项工作指出了基础模型对齐的替代范例，其中通过结构化表征映射而不是通过大规模再训练来集成冻结模型。我们的实现的代码库可以在此 https URL 中找到。

Title: FedRot-LoRA: Mitigating Rotational Misalignment in Federated LoRA

• Authors: Haoran Zhang, Dongjun Kim, Seohyeon Cha, Haris Vikalo
• Subjects: cs.LG, cs.AI
• Abstract URL: https://arxiv.org/abs/2602.23638
• Pdf URL: https://arxiv.org/pdf/2602.23638
• Copy Paste: [[2602.23638]] FedRot-LoRA: Mitigating Rotational Misalignment in Federated LoRA(https://arxiv.org/abs/2602.23638)
• Keywords: generative
• Abstract: Federated LoRA provides a communication-efficient mechanism for fine-tuning large language models on decentralized data. In practice, however, a discrepancy between the factor-wise averaging used to preserve low rank and the mathematically correct aggregation of local updates can cause significant aggregation error and unstable training. We argue that a major source of this problem is rotational misalignment, arising from the rotational invariance of low-rank factorizations -- semantically equivalent updates can be represented in different latent subspaces across clients since $(B_i R_i)(R_i^\top A_i) = B_i A_i$. When such misaligned factors are averaged directly, they interfere destructively and degrade the global update. To address this issue, we propose FedRot-LoRA, a federated LoRA framework that aligns client updates via orthogonal transformations prior to aggregation. This alignment preserves the semantic update while reducing cross-client subspace mismatch, without increasing communication cost or restricting model expressivity. We provide a convergence analysis that examines the aggregation error induced by factor-wise averaging and shows how rotational alignment yields a tighter upper bound on this error. Extensive experiments on natural language understanding and generative tasks demonstrate that FedRot-LoRA consistently outperforms existing federated LoRA baselines across a range of heterogeneity levels and LoRA ranks.
• 摘要：联合 LoRA 提供了一种高效的通信机制，用于在去中心化数据上微调大型语言模型。然而，在实践中，用于保持低秩的逐因子平均与本地更新的数学上正确的聚合之间的差异可能会导致显着的聚合错误和不稳定的训练。我们认为这个问题的一个主要根源是旋转错位，它是由低秩因式分解的旋转不变性引起的——语义上等效的更新可以在跨客户端的不同潜在子空间中表示，因为 $(B_i R_i)(R_i^\top A_i) = B_i A_i$。当直接对这些未对准的因素进行平均时，它们会产生破坏性干扰并降低全局更新的性能。为了解决这个问题，我们提出了 FedRot-LoRA，这是一种联合 LoRA 框架，可在聚合之前通过正交变换来对齐客户端更新。这种对齐保留了语义更新，同时减少了跨客户端子空间不匹配，而不会增加通信成本或限制模型表达能力。我们提供了一种收敛分析，用于检查逐因子平均引起的聚合误差，并显示旋转对齐如何产生更严格的误差上限。关于自然语言理解和生成任务的大量实验表明，FedRot-LoRA 在一系列异质性级别和 LoRA 等级上始终优于现有的联合 LoRA 基线。

Title: BuildAnyPoint: 3D Building Structured Abstraction from Diverse Point Clouds

• Authors: Tongyan Hua, Haoran Gong, Yuan Liu, Di Wang, Ying-Cong Chen, Wufan Zhao
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.23645
• Pdf URL: https://arxiv.org/pdf/2602.23645
• Copy Paste: [[2602.23645]] BuildAnyPoint: 3D Building Structured Abstraction from Diverse Point Clouds(https://arxiv.org/abs/2602.23645)
• Keywords: generation, generative
• Abstract: We introduce BuildAnyPoint, a novel generative framework for structured 3D building reconstruction from point clouds with diverse distributions, such as those captured by airborne LiDAR and Structure-from-Motion. To recover artist-created building abstraction in this highly underconstrained setting, we capitalize on the role of explicit 3D generative priors in autoregressive mesh generation. Specifically, we design a Loosely Cascaded Diffusion Transformer (Loca-DiT) that initially recovers the underlying distribution from noisy or sparse points, followed by autoregressively encapsulating them into compact meshes. We first formulate distribution recovery as a conditional generation task by training latent diffusion models conditioned on input point clouds, and then tailor a decoder-only transformer for conditional autoregressive mesh generation based on the recovered point clouds. Our method delivers substantial qualitative and quantitative improvements over prior building abstraction methods. Furthermore, the effectiveness of our approach is evidenced by the strong performance of its recovered point clouds on building point cloud completion benchmarks, which exhibit improved surface accuracy and distribution uniformity.
• 摘要：我们介绍了 BuildAnyPoint，这是一种新颖的生成框架，用于从具有不同分布的点云（例如机载 LiDAR 和 Structure-from-Motion 捕获的点云）重建结构化 3D 建筑。为了在这种高度受限的环境中恢复艺术家创建的建筑抽象，我们利用了显式 3D 生成先验在自回归网格生成中的作用。具体来说，我们设计了一个松散级联扩散变压器（Loca-DiT），它最初从噪声或稀疏点恢复底层分布，然后将它们自回归封装到紧凑的网格中。我们首先通过训练以输入点云为条件的潜在扩散模型，将分布恢复制定为条件生成任务，然后根据恢复的点云定制用于条件自回归网格生成的仅解码器变压器。我们的方法比以前的建筑抽象方法提供了实质性的定性和定量改进。此外，我们的方法的有效性通过其恢复的点云在构建点云完成基准上的强劲性能得到了证明，它表现出提高的表面精度和分布均匀性。

Title: Selective Denoising Diffusion Model for Time Series Anomaly Detection

• Authors: Kohei Obata, Zheng Chen, Yasuko Matsubara, Lingwei Zhu, Yasushi Sakurai
• Subjects: cs.LG
• Abstract URL: https://arxiv.org/abs/2602.23662
• Pdf URL: https://arxiv.org/pdf/2602.23662
• Copy Paste: [[2602.23662]] Selective Denoising Diffusion Model for Time Series Anomaly Detection(https://arxiv.org/abs/2602.23662)
• Keywords: generative
• Abstract: Time series anomaly detection (TSAD) has been an important area of research for decades, with reconstruction-based methods, mostly based on generative models, gaining popularity and demonstrating success. Diffusion models have recently attracted attention due to their advanced generative capabilities. Existing diffusion-based methods for TSAD rely on a conditional strategy, which reconstructs input instances from white noise with the aid of the conditioner. However, this poses challenges in accurately reconstructing the normal parts, resulting in suboptimal detection performance. In response, we propose a novel diffusion-based method, named AnomalyFilter, which acts as a selective filter that only denoises anomaly parts in the instance while retaining normal parts. To build such a filter, we mask Gaussian noise during the training phase and conduct the denoising process without adding noise to the instances. The synergy of the two simple components greatly enhances the performance of naive diffusion models. Extensive experiments on five datasets demonstrate that AnomalyFilter achieves notably low reconstruction error on normal parts, providing empirical support for its effectiveness in anomaly detection. AnomalyFilter represents a pioneering approach that focuses on the noise design of diffusion models specifically tailored for TSAD.
• 摘要：几十年来，时间序列异常检测（TSAD）一直是一个重要的研究领域，基于重建的方法（主要基于生成模型）越来越受欢迎并取得了成功。扩散模型最近因其先进的生成能力而引起了人们的关注。现有的基于扩散的 TSAD 方法依赖于条件策略，该策略借助调节器从白噪声中重建输入实例。然而，这给准确重建正常部分带来了挑战，导致检测性能不佳。为此，我们提出了一种新颖的基于扩散的方法，名为 AnomalyFilter，它充当选择性过滤器，仅对实例中的异常部分进行去噪，同时保留正常部分。为了构建这样的滤波器，我们在训练阶段屏蔽高斯噪声并进行去噪过程，而不向实例添加噪声。两个简单组件的协同作用极大地增强了朴素扩散模型的性能。对五个数据集的大量实验表明，AnomalyFilter 在正常部分上实现了显着较低的重建误差，为其异常检测的有效性提供了经验支持。 AnomalyFilter 代表了一种开创性的方法，专注于专为 TSAD 定制的扩散模型的噪声设计。

Title: Suppressing Prior-Comparison Hallucinations in Radiology Report Generation via Semantically Decoupled Latent Steering

• Authors: Ao Li, Rui Liu, Mingjie Li, Sheng Liu, Lei Wang, Xiaodan Liang, Lina Yao, Xiaojun Chang, Lei Xing
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.23676
• Pdf URL: https://arxiv.org/pdf/2602.23676
• Copy Paste: [[2602.23676]] Suppressing Prior-Comparison Hallucinations in Radiology Report Generation via Semantically Decoupled Latent Steering(https://arxiv.org/abs/2602.23676)
• Keywords: generation
• Abstract: Automated radiology report generation using vision-language models (VLMs) is limited by the risk of prior-comparison hallucination, where the model generates historical findings unsupported by the current study. We address this challenge with a training-free, inference-time control framework termed Semantically Decoupled Latent Steering (SDLS). Unlike generic activation steering, which often suffers from semantic entanglement, our approach constructs a semantic-free intervention vector via large language model (LLM)-driven semantic decomposition followed by $QR$-based orthogonalization. This orthogonalization step is critical. It leverages geometric constraints to filter out the clinical semantics often entangled in standard principal component analysis (PCA) directions, ensuring that the steering vector targets only the ``historical comparison" axis. We validate our method on the BiomedGPT foundation model, demonstrating that it overcomes the trade-off between hallucination suppression and clinical accuracy. Extensive experiments on MIMIC-CXR, and zero-shot transfer evaluation on CheXpert Plus and IU-Xray, demonstrate the robustness of our approach. Quantitative evaluations on MIMIC-CXR show that our approach significantly reduces the probability of historical hallucinations (FilBERT score decreases from 0.2373 to 0.1889) and improves clinical label fidelity (CheXpert macro-F1 increases from 0.2242 to 0.3208). Supplementary evaluations confirm that the structural integrity of the clinical narrative is maintained.
• 摘要：使用视觉语言模型（VLM）自动生成放射学报告受到先前比较幻觉风险的限制，该模型生成的历史结果不受当前研究的支持。我们通过称为语义解耦潜在转向（SDLS）的免训练推理时间控制框架来应对这一挑战。与经常遭受语义纠缠的通用激活控制不同，我们的方法通过大语言模型（LLM）驱动的语义分解和基于 $QR$ 的正交化构建了一个无语义的干预向量。这个正交化步骤至关重要。它利用几何约束来过滤掉经常与标准主成分分析 (PCA) 方向纠缠在一起的临床语义，确保转向向量仅针对“历史比较”轴。我们在 BiomedGPT 基础模型上验证了我们的方法，证明它克服了幻觉抑制和临床准确性之间的权衡。MIMIC-CXR 上的大量实验以及 CheXpert Plus 和 IU-Xray 上的零样本传输评估证明了我们方法的稳健性。 MIMIC-CXR 的定量评估表明，我们的方法显着降低了历史幻觉的概率（FilBERT 评分从 0.2373 下降到 0.1889），并提高了临床标签保真度（CheXpert Macro-F1 从 0.2242 增加到 0.3208）。补充评估证实，临床叙述的结构完整性得以保持。

Title: Any Model, Any Place, Any Time: Get Remote Sensing Foundation Model Embeddings On Demand

• Authors: Dingqi Ye, Daniel Kiv, Wei Hu, Jimeng Shi, Shaowen Wang
• Subjects: cs.CV, cs.LG
• Abstract URL: https://arxiv.org/abs/2602.23678
• Pdf URL: https://arxiv.org/pdf/2602.23678
• Copy Paste: [[2602.23678]] Any Model, Any Place, Any Time: Get Remote Sensing Foundation Model Embeddings On Demand(https://arxiv.org/abs/2602.23678)
• Keywords: generation
• Abstract: The remote sensing community is witnessing a rapid growth of foundation models, which provide powerful embeddings for a wide range of downstream tasks. However, practical adoption and fair comparison remain challenging due to substantial heterogeneity in model release formats, platforms and interfaces, and input data specifications. These inconsistencies significantly increase the cost of obtaining, using, and benchmarking embeddings across models. To address this issue, we propose rs-embed, a Python library that offers a unified, region of interst (ROI) centric interface: with a single line of code, users can retrieve embeddings from any supported model for any location and any time range. The library also provides efficient batch processing to enable large-scale embedding generation and evaluation. The code is available at: this https URL
• 摘要：遥感界正在见证基础模型的快速增长，这些模型为广泛的下游任务提供了强大的嵌入。然而，由于模型发布格式、平台和接口以及输入数据规范存在很大的异质性，实际采用和公平比较仍然具有挑战性。这些不一致显着增加了跨模型获取、使用和基准化嵌入的成本。为了解决这个问题，我们提出了 rs-embed，这是一个 Python 库，它提供了一个统一的、以感兴趣区域 (ROI) 为中心的界面：只需一行代码，用户就可以在任何位置和任何时间范围从任何受支持的模型中检索嵌入。该库还提供高效的批处理，以实现大规模嵌入生成和评估。该代码位于：此 https URL

Title: Can Unified Generation and Understanding Models Maintain Semantic Equivalence Across Different Output Modalities?

• Authors: Hongbo Jiang, Jie Li, Yunhang Shen, Pingyang Dai, Xing Sun, Haoyu Cao, Liujuan Cao
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.23711
• Pdf URL: https://arxiv.org/pdf/2602.23711
• Copy Paste: [[2602.23711]] Can Unified Generation and Understanding Models Maintain Semantic Equivalence Across Different Output Modalities?(https://arxiv.org/abs/2602.23711)
• Keywords: generation, generative
• Abstract: Unified Multimodal Large Language Models (U-MLLMs) integrate understanding and generation within a single architecture. However, existing evaluations typically assess these capabilities separately, overlooking semantic equivalence, i.e., the ability to manifest consistent reasoning results regardless of the output modality. In this work, we investigate whether current U-MLLMs satisfy this premise. We observe that while models demonstrate robust textual reasoning, they fail to maintain semantic equivalence when required to render the same results in the image modality. To rigorously diagnose this discrepancy, we introduce VGUBench, a framework to decouple reasoning logic from generation fidelity. VGUBench comprises three diagnostic tasks: (1)Textual Generative Understanding, establishing a baseline for reasoning accuracy in textual response; (2)Visual Generative Understanding, evaluating the ability to generate visual responses that represent the correct answer; and (3)a Visual Rendering control task, which assesses the ability to directly render explicit visual descriptions into images without complex reasoning. Our evaluation reveals a significant disparity: despite strong performance in textual understanding and visual rendering, U-MLLMs exhibit a marked performance collapse when required to generate visual answers to questions. Furthermore, we find a negligible correlation between visual answering performance and basic rendering quality. These results suggest that the failure stems not from insufficient generation fidelity, but from a breakdown in cross-modal semantic alignment. We provide diagnostic insights to address this challenge in future Unified Generation and Understanding Models.
• 摘要：统一多模态大语言模型 (U-MLLM) 将理解和生成集成在单个架构中。然而，现有的评估通常单独评估这些能力，而忽略了语义等价性，即无论输出模态如何，都能够表现出一致的推理结果。在这项工作中，我们研究了当前的 U-MLLM 是否满足这个前提。我们观察到，虽然模型展示了强大的文本推理，但当需要在图像模态中呈现相同的结果时，它们无法保持语义等价。为了严格诊断这种差异，我们引入了 VGUBench，一个将推理逻辑与生成保真度解耦的框架。 VGUBench 包括三个诊断任务：（1）文本生成理解，为文本响应中的推理准确性建立基线； (2)Visual Generative Understanding，评估生成代表正确答案的视觉反应的能力； (3)视觉渲染控制任务，评估无需复杂推理即可直接将显式视觉描述渲染为图像的能力。我们的评估揭示了一个显着的差异：尽管 U-MLLM 在文本理解和视觉渲染方面表现出色，但在需要生成问题的视觉答案时表现出明显的性能崩溃。此外，我们发现视觉应答性能和基本渲染质量之间的相关性可以忽略不计。这些结果表明，失败并非源于生成保真度不足，而是源于跨模式语义对齐的崩溃。我们提供诊断见解，以应对未来统一生成和理解模型中的这一挑战。

Title: A Difference-in-Difference Approach to Detecting AI-Generated Images

• Authors: Xinyi Qi, Kai Ye, Chengchun Shi, Ying Yang, Hongyi Zhou, Jin Zhu
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.23732
• Pdf URL: https://arxiv.org/pdf/2602.23732
• Copy Paste: [[2602.23732]] A Difference-in-Difference Approach to Detecting AI-Generated Images(https://arxiv.org/abs/2602.23732)
• Keywords: generative
• Abstract: Diffusion models are able to produce AI-generated images that are almost indistinguishable from real ones. This raises concerns about their potential misuse and poses substantial challenges for detecting them. Many existing detectors rely on reconstruction error -- the difference between the input image and its reconstructed version -- as the basis for distinguishing real from fake images. However, these detectors become less effective as modern AI-generated images become increasingly similar to real ones. To address this challenge, we propose a novel difference-in-difference method. Instead of directly using the reconstruction error (a first-order difference), we compute the difference in reconstruction error -- a second-order difference -- for variance reduction and improving detection accuracy. Extensive experiments demonstrate that our method achieves strong generalization performance, enabling reliable detection of AI-generated images in the era of generative AI.
• 摘要：扩散模型能够生成人工智能生成的图像，这些图像与真实图像几乎没有区别。这引起了人们对其潜在滥用的担忧，并给检测它们带来了巨大的挑战。许多现有的检测器依赖重建误差（输入图像与其重建版本之间的差异）作为区分真假图像的基础。然而，随着现代人工智能生成的图像变得越来越类似于真实图像，这些探测器的效率变得越来越低。为了应对这一挑战，我们提出了一种新颖的双重差分方法。我们不是直接使用重建误差（一阶差分），而是计算重建误差的差异（二阶差分），以减少方差并提高检测精度。大量实验表明，我们的方法具有很强的泛化性能，能够在生成式人工智能时代可靠地检测人工智能生成的图像。

Title: U-Mind: A Unified Framework for Real-Time Multimodal Interaction with Audiovisual Generation

• Authors: Xiang Deng, Feng Gao, Yong Zhang, Youxin Pang, Xu Xiaoming, Zhuoliang Kang, Xiaoming Wei, Yebin Liu
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.23739
• Pdf URL: https://arxiv.org/pdf/2602.23739
• Copy Paste: [[2602.23739]] U-Mind: A Unified Framework for Real-Time Multimodal Interaction with Audiovisual Generation(https://arxiv.org/abs/2602.23739)
• Keywords: generation
• Abstract: Full-stack multimodal interaction in real-time is a central goal in building intelligent embodied agents capable of natural, dynamic communication. However, existing systems are either limited to unimodal generation or suffer from degraded reasoning and poor cross-modal alignment, preventing coherent and perceptually grounded interactions. In this work, we introduce U-Mind, the first unified system for high-intelligence multimodal dialogue that supports real-time generation and jointly models language, speech, motion, and video synthesis within a single interactive loop. At its core, U-Mind implements a Unified Alignment and Reasoning Framework that addresses two key challenges: enhancing cross-modal synchronization via a segment-wise alignment strategy, and preserving reasoning abilities through Rehearsal-Driven Learning. During inference, U-Mind adopts a text-first decoding pipeline that performs internal chain-of-thought planning followed by temporally synchronized generation across modalities. To close the loop, we implement a real-time video rendering framework conditioned on pose and speech, enabling expressive and synchronized visual feedback. Extensive experiments demonstrate that U-Mind achieves state-of-the-art performance on a range of multimodal interaction tasks, including question answering, instruction following, and motion generation, paving the way toward intelligent, immersive conversational agents.
• 摘要：实时全栈多模式交互是构建能够自然、动态通信的智能实体的核心目标。然而，现有系统要么仅限于单模态生成，要么存在推理能力下降和跨模态对齐不佳的问题，从而阻碍了连贯且基于感知的交互。在这项工作中，我们介绍了 U-Mind，这是第一个用于高智能多模态对话的统一系统，它支持实时生成，并在单个交互循环中联合建模语言、语音、动作和视频合成。 U-Mind 的核心是实现统一的对齐和推理框架，该框架解决了两个关键挑战：通过分段对齐策略增强跨模式同步，并通过排练驱动学习保留推理能力。在推理过程中，U-Mind 采用文本优先解码管道，执行内部思维链规划，然后跨模态进行时间同步生成。为了闭合循环，我们实现了一个以姿势和语音为条件的实时视频渲染框架，从而实现富有表现力和同步的视觉反馈。大量实验表明，U-Mind 在一系列多模式交互任务上实现了最先进的性能，包括问答、指令跟踪和动作生成，为智能、沉浸式对话代理铺平了道路。

Title: MAGE: Multi-scale Autoregressive Generation for Offline Reinforcement Learning

• Authors: Chenxing Lin, Xinhui Gao, Haipeng Zhang, Xinran Li, Haitao Wang, Songzhu Mei, Chenglu Wen, Weiquan Liu, Siqi Shen, Cheng Wang
• Subjects: cs.LG
• Abstract URL: https://arxiv.org/abs/2602.23770
• Pdf URL: https://arxiv.org/pdf/2602.23770
• Copy Paste: [[2602.23770]] MAGE: Multi-scale Autoregressive Generation for Offline Reinforcement Learning(https://arxiv.org/abs/2602.23770)
• Keywords: generation, generative
• Abstract: Generative models have gained significant traction in offline reinforcement learning (RL) due to their ability to model complex trajectory distributions. However, existing generation-based approaches still struggle with long-horizon tasks characterized by sparse rewards. Some hierarchical generation methods have been developed to mitigate this issue by decomposing the original problem into shorter-horizon subproblems using one policy and generating detailed actions with another. While effective, these methods often overlook the multi-scale temporal structure inherent in trajectories, resulting in suboptimal performance. To overcome these limitations, we propose MAGE, a Multi-scale Autoregressive GEneration-based offline RL method. MAGE incorporates a condition-guided multi-scale autoencoder to learn hierarchical trajectory representations, along with a multi-scale transformer that autoregressively generates trajectory representations from coarse to fine temporal scales. MAGE effectively captures temporal dependencies of trajectories at multiple resolutions. Additionally, a condition-guided decoder is employed to exert precise control over short-term behaviors. Extensive experiments on five offline RL benchmarks against fifteen baseline algorithms show that MAGE successfully integrates multi-scale trajectory modeling with conditional guidance, generating coherent and controllable trajectories in long-horizon sparse-reward settings.
• 摘要：生成模型由于能够对复杂的轨迹分布进行建模，因此在离线强化学习 (RL) 领域获得了巨大的关注。然而，现有的基于生成的方法仍然难以应对奖励稀疏的长期任务。人们已经开发了一些分层生成方法来缓解这个问题，方法是使用一种策略将原始问题分解为较短范围的子问题，并使用另一种策略生成详细的操作。虽然有效，但这些方法常常忽视轨迹中固有的多尺度时间结构，导致性能不佳。为了克服这些限制，我们提出了 MAGE，一种基于多尺度自回归生成的离线强化学习方法。 MAGE 结合了一个条件引导的多尺度自动编码器来学习分层轨迹表示，以及一个多尺度变换器，可自动生成从粗到细的时间尺度的轨迹表示。 MAGE 有效地捕获多种分辨率下轨迹的时间依赖性。此外，还采用条件引导解码器来对短期行为进行精确控制。针对 15 种基线算法对 5 个离线 RL 基准进行的大量实验表明，MAGE 成功地将多尺度轨迹建模与条件指导相结合，在长视野稀疏奖励设置中生成连贯且可控的轨迹。

Title: Diffusion Probe: Generated Image Result Prediction Using CNN Probes

• Authors: Benlei Cui, Bukun Huang, Zhizeng Ye, Xuemei Dong, Tuo Chen, Hui Xue, Dingkang Yang, Longtao Huang, Jingqun Tang, Haiwen Hong
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.23783
• Pdf URL: https://arxiv.org/pdf/2602.23783
• Copy Paste: [[2602.23783]] Diffusion Probe: Generated Image Result Prediction Using CNN Probes(https://arxiv.org/abs/2602.23783)
• Keywords: generation, quality assessment
• Abstract: Text-to-image (T2I) diffusion models lack an efficient mechanism for early quality assessment, leading to costly trial-and-error in multi-generation scenarios such as prompt iteration, agent-based generation, and flow-grpo. We reveal a strong correlation between early diffusion cross-attention distributions and final image quality. Based on this finding, we introduce Diffusion Probe, a framework that leverages internal cross-attention maps as predictive signals. We design a lightweight predictor that maps statistical properties of early-stage cross-attention extracted from initial denoising steps to the final image's overall quality. This enables accurate forecasting of image quality across diverse evaluation metrics long before full synthesis is complete. We validate Diffusion Probe across a wide range of settings. On multiple T2I models, across early denoising windows, resolutions, and quality metrics, it achieves strong correlation (PCC > 0.7) and high classification performance (AUC-ROC > 0.9). Its reliability translates into practical gains. By enabling early quality-aware decisions in workflows such as prompt optimization, seed selection, and accelerated RL training, the probe supports more targeted sampling and avoids computation on low-potential generations. This reduces computational overhead while improving final output quality. Diffusion Probe is model-agnostic, efficient, and broadly applicable, offering a practical solution for improving T2I generation efficiency through early quality prediction.
• 摘要：文本到图像（T2I）扩散模型缺乏有效的早期质量评估机制，导致在多生成场景（例如提示迭代、基于代理的生成和 flow-grpo）中进行代价高昂的试错。我们揭示了早期扩散交叉注意力分布与最终图像质量之间的强相关性。基于这一发现，我们引入了 Diffusion Probe，一个利用内部交叉注意力图作为预测信号的框架。我们设计了一个轻量级预测器，将从初始去噪步骤中提取的早期交叉注意力的统计特性映射到最终图像的整体质量。这使得在完全合成完成之前就可以通过不同的评估指标准确预测图像质量。我们在各种设置下验证扩散探针。在多个 T2I 模型上，跨早期去噪窗口、分辨率和质量指标，它实现了强相关性 (PCC > 0.7) 和高分类性能 (AUC-ROC > 0.9)。其可靠性可转化为实际收益。通过在工作流程中实现早期质量感知决策，例如及时优化、种子选择和加速 RL 训练，该探针支持更有针对性的采样，并避免在低潜力世代上进行计算。这减少了计算开销，同时提高了最终输出质量。 Diffusion Probe 与模型无关、高效且适用范围广泛，为通过早期质量预测提高 T2I 生成效率提供了实用的解决方案。

Title: TradeFM: A Generative Foundation Model for Trade-flow and Market Microstructure

• Authors: Maxime Kawawa-Beaudan, Srijan Sood, Kassiani Papasotiriou, Daniel Borrajo, Manuela Veloso
• Subjects: cs.LG, cs.AI, q-fin.CP, q-fin.TR
• Abstract URL: https://arxiv.org/abs/2602.23784
• Pdf URL: https://arxiv.org/pdf/2602.23784
• Copy Paste: [[2602.23784]] TradeFM: A Generative Foundation Model for Trade-flow and Market Microstructure(https://arxiv.org/abs/2602.23784)
• Keywords: generation, generative
• Abstract: Foundation models have transformed domains from language to genomics by learning general-purpose representations from large-scale, heterogeneous data. We introduce TradeFM, a 524M-parameter generative Transformer that brings this paradigm to market microstructure, learning directly from billions of trade events across >9K equities. To enable cross-asset generalization, we develop scale-invariant features and a universal tokenization scheme that map the heterogeneous, multi-modal event stream of order flow into a unified discrete sequence -- eliminating asset-specific calibration. Integrated with a deterministic market simulator, TradeFM-generated rollouts reproduce key stylized facts of financial returns, including heavy tails, volatility clustering, and absence of return autocorrelation. Quantitatively, TradeFM achieves 2-3x lower distributional error than Compound Hawkes baselines and generalizes zero-shot to geographically out-of-distribution APAC markets with moderate perplexity degradation. Together, these results suggest that scale-invariant trade representations capture transferable structure in market microstructure, opening a path toward synthetic data generation, stress testing, and learning-based trading agents.
• 摘要：基础模型通过从大规模异构数据中学习通用表示，将领域从语言转变为基因组学。我们推出了 TradeFM，这是一个 5.24 亿参数的生成 Transformer，它将这种范式引入市场微观结构，直接从超过 9K 股票的数十亿交易事件中学习。为了实现跨资产泛化，我们开发了规模不变的特征和通用标记化方案，将订单流的异构、多模式事件流映射到统一的离散序列中，从而消除了特定于资产的校准。 TradeFM 生成的产品与确定性市场模拟器集成，可再现财务回报的关键程式化事实，包括重尾、波动性聚类和回报自相关的缺失。从数量上讲，TradeFM 的分布误差比复合霍克斯基线低 2-3 倍，并将零样本推广到地理分布外的亚太地区市场，并带来适度的困惑度下降。总之，这些结果表明，规模不变的贸易表征捕获了市场微观结构中的可转移结构，为合成数据生成、压力测试和基于学习的交易代理开辟了道路。

Title: MPU: Towards Secure and Privacy-Preserving Knowledge Unlearning for Large Language Models

• Authors: Tiantong Wang, Xinyu Yan, Tiantong Wu, Yurong Hao, Yong Jiang, Fei Huang, Wei Yang Bryan Lim
• Subjects: cs.LG, cs.AI, cs.CR, cs.DC
• Abstract URL: https://arxiv.org/abs/2602.23798
• Pdf URL: https://arxiv.org/pdf/2602.23798
• Copy Paste: [[2602.23798]] MPU: Towards Secure and Privacy-Preserving Knowledge Unlearning for Large Language Models(https://arxiv.org/abs/2602.23798)
• Keywords: generation
• Abstract: Machine unlearning for large language models often faces a privacy dilemma in which strict constraints prohibit sharing either the server's parameters or the client's forget set. To address this dual non-disclosure constraint, we propose MPU, an algorithm-agnostic privacy-preserving Multiple Perturbed Copies Unlearning framework that primarily introduces two server-side modules: Pre-Process for randomized copy generation and Post-Process for update aggregation. In Pre-Process, the server distributes multiple perturbed and reparameterized model instances, allowing the client to execute unlearning locally on its private forget set without accessing the server's exact original parameters. After local unlearning, the server performs Post-Process by inverting the reparameterization and aggregating updates with a harmonic denoising procedure to alleviate the impact of perturbation. Experiments with seven unlearning algorithms show that MPU achieves comparable unlearning performance to noise-free baselines, with most algorithms' average degradation well below 1% under 10% noise, and can even outperform the noise-free baseline for some algorithms under 1% noise. Code is available at this https URL.
• 摘要：大型语言模型的机器遗忘通常面临隐私困境，其中严格的约束禁止共享服务器的参数或客户端的遗忘集。为了解决这种双重保密约束，我们提出了 MPU，一种与算法无关的隐私保护多扰动副本学习框架，主要引入了两个服务器端模块：用于随机副本生成的预处理和用于更新聚合的后处理。在预处理中，服务器分发多个扰动和重新参数化的模型实例，允许客户端在其私有忘记集上本地执行取消学习，而无需访问服务器的确切原始参数。本地取消学习后，服务器通过反转重新参数化并使用谐波去噪程序聚合更新来执行后处理，以减轻扰动的影响。七种去学习算法的实验表明，MPU 实现了与无噪声基线相当的去学习性能，大多数算法在 10% 噪声下的平均退化远低于 1%，甚至在 1% 噪声下某些算法的性能优于无噪声基线。代码可从此 https URL 获取。

Title: Footprint-Guided Exemplar-Free Continual Histopathology Report Generation

• Authors: Pratibha Kumari, Daniel Reisenbüchler, Afshin Bozorgpour, yousef Sadegheih, Priyankar Choudhary, Dorit Merhof
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.23817
• Pdf URL: https://arxiv.org/pdf/2602.23817
• Copy Paste: [[2602.23817]] Footprint-Guided Exemplar-Free Continual Histopathology Report Generation(https://arxiv.org/abs/2602.23817)
• Keywords: generation, generative
• Abstract: Rapid progress in vision-language modeling has enabled pathology report generation from gigapixel whole-slide images, but most approaches assume static training with simultaneous access to all data. In clinical deployment, however, new organs, institutions, and reporting conventions emerge over time, and sequential fine-tuning can cause catastrophic forgetting. We introduce an exemplar-free continual learning framework for WSI-to-report generation that avoids storing raw slides or patch exemplars. The core idea is a compact domain footprint built in a frozen patch-embedding space: a small codebook of representative morphology tokens together with slide-level co-occurrence summaries and lightweight patch-count priors. These footprints support generative replay by synthesizing pseudo-WSI representations that reflect domain-specific morphological mixtures, while a teacher snapshot provides pseudo-reports to supervise the updated model without retaining past data. To address shifting reporting conventions, we distill domain-specific linguistic characteristics into a compact style descriptor and use it to steer generation. At inference, the model identifies the most compatible descriptor directly from the slide signal, enabling domain-agnostic setup without requiring explicit domain identifiers. Evaluated across multiple public continual learning benchmarks, our approach outperforms exemplar-free and limited-buffer rehearsal baselines, highlighting footprint-based generative replay as a practical solution for deployment in evolving clinical settings.
• 摘要：视觉语言建模的快速进展使得能够从十亿像素全幻灯片图像生成病理报告，但大多数方法都假设静态训练同时访问所有数据。然而，在临床部署中，随着时间的推移，新的器官、机构和报告惯例会出现，连续的微调可能会导致灾难性的遗忘。我们引入了一个用于 WSI 到报告生成的无示例持续学习框架，避免存储原始幻灯片或补丁示例。核心思想是在冻结的补丁嵌入空间中构建紧凑的域足迹：代表性形态标记的小密码本以及幻灯片级共现摘要和轻量级补丁计数先验。这些足迹通过合成反映特定领域形态混合的伪 WSI 表示来支持生成重放，而教师快照提供伪报告来监督更新的模型而不保留过去的数据。为了解决不断变化的报告惯例，我们将特定领域的语言特征提炼成紧凑的风格描述符，并用它来引导生成。在推理时，该模型直接从滑动信号中识别最兼容的描述符，从而实现与域无关的设置，而不需要显式的域标识符。经过多个公共持续学习基准的评估，我们的方法优于无范例和有限缓冲排练基线，强调基于足迹的生成重放作为在不断发展的临床环境中部署的实用解决方案。

Title: NAU-QMUL: Utilizing BERT and CLIP for Multi-modal AI-Generated Image Detection

• Authors: Xiaoyu Guo, Arkaitz Zubiaga
• Subjects: cs.CV, cs.CL
• Abstract URL: https://arxiv.org/abs/2602.23863
• Pdf URL: https://arxiv.org/pdf/2602.23863
• Copy Paste: [[2602.23863]] NAU-QMUL: Utilizing BERT and CLIP for Multi-modal AI-Generated Image Detection(https://arxiv.org/abs/2602.23863)
• Keywords: generation
• Abstract: With the aim of detecting AI-generated images and identifying the specific models responsible for their generation, we propose a multi-modal multi-task model. The model leverages pre-trained BERT and CLIP Vision encoders for text and image feature extraction, respectively, and employs cross-modal feature fusion with a tailored multi-task loss function. Additionally, a pseudo-labeling-based data augmentation strategy was utilized to expand the training dataset with high-confidence samples. The model achieved fifth place in both Tasks A and B of the `CT2: AI-Generated Image Detection' competition, with F1 scores of 83.16\% and 48.88\%, respectively. These findings highlight the effectiveness of the proposed architecture and its potential for advancing AI-generated content detection in real-world scenarios. The source code for our method is published on this https URL.
• 摘要：为了检测人工智能生成的图像并识别负责生成图像的特定模型，我们提出了一种多模态多任务模型。该模型利用预先训练的 BERT 和 CLIP Vision 编码器分别进行文本和图像特征提取，并采用跨模态特征融合和定制的多任务损失函数。此外，还利用基于伪标记的数据增强策略来扩展具有高置信度样本的训练数据集。该模型在“CT2：人工智能生成图像检测”竞赛的任务 A 和 B 中均获得第五名，F1 分数分别为 83.16\% 和 48.88\%。这些发现凸显了所提出的架构的有效性及其在现实场景中推进人工智能生成内容检测的潜力。 The source code for our method is published on this https URL.

Title: A Theory of Random Graph Shift in Truncated-Spectrum vRKHS

• Authors: Zhang Wan, Tingting Mu, Samuel Kaski
• Subjects: cs.LG
• Abstract URL: https://arxiv.org/abs/2602.23880
• Pdf URL: https://arxiv.org/pdf/2602.23880
• Copy Paste: [[2602.23880]] A Theory of Random Graph Shift in Truncated-Spectrum vRKHS(https://arxiv.org/abs/2602.23880)
• Keywords: generative
• Abstract: This paper develops a theory of graph classification under domain shift through a random-graph generative lens, where we consider intra-class graphs sharing the same random graph model (RGM) and the domain shift induced by changes in RGM components. While classic domain adaptation (DA) theories have well-underpinned existing techniques to handle graph distribution shift, the information of graph samples, which are itself structured objects, is less explored. The non-Euclidean nature of graphs and specialized architectures for graph learning further complicate a fine-grained analysis of graph distribution shifts. In this paper, we propose a theory that assumes RGM as the data generative process, exploiting its connection to hypothesis complexity in function space perspective for such fine-grained analysis. Building on a vector-valued reproducing kernel Hilbert space (vRKHS) formulation, we derive a generalization bound whose shift penalty admits a factorization into (i) a domain discrepancy term, (ii) a spectral-geometry term summarized by the accessible truncated spectrum, and (iii) an amplitude term that aggregates convergence and construction-stability effects. We empirically verify the insights on these terms in both real data and simulations.
• 摘要：本文通过随机图生成透镜发展了域转移下的图分类理论，其中我们考虑共享相同随机图模型（RGM）的类内图以及由 RGM 组件变化引起的域转移。虽然经典的域适应（DA）理论有很好的基础来处理图分布偏移的现有技术，但图样本的信息（本身就是结构化对象）却很少被探索。图的非欧几里得性质和图学习的专用架构进一步使图分布变化的细粒度分析变得复杂。在本文中，我们提出了一种理论，假设 RGM 作为数据生成过程，利用其与函数空间角度的假设复杂性的联系来进行此类细粒度分析。基于向量值再现核希尔伯特空间（vRKHS）公式，我们推导出一个泛化界，其移位罚分允许分解为（i）域差异项，（ii）由可访问的截断谱概括的光谱几何项，以及（iii）聚合收敛和构造稳定性效应的幅度项。我们在实际数据和模拟中凭经验验证了对这些术语的见解。

Title: DACESR: Degradation-Aware Conditional Embedding for Real-World Image Super-Resolution

• Authors: Xiaoyan Lei, Wenlong Zhang, Biao Luo, Hui Liang, Weifeng Cao, Qiuting Lin
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.23890
• Pdf URL: https://arxiv.org/pdf/2602.23890
• Copy Paste: [[2602.23890]] DACESR: Degradation-Aware Conditional Embedding for Real-World Image Super-Resolution(https://arxiv.org/abs/2602.23890)
• Keywords: super-resolution
• Abstract: Multimodal large models have shown excellent ability in addressing image super-resolution in real-world scenarios by leveraging language class as condition information, yet their abilities in degraded images remain limited. In this paper, we first revisit the capabilities of the Recognize Anything Model (RAM) for degraded images by calculating text similarity. We find that directly using contrastive learning to fine-tune RAM in the degraded space is difficult to achieve acceptable results. To address this issue, we employ a degradation selection strategy to propose a Real Embedding Extractor (REE), which achieves significant recognition performance gain on degraded image content through contrastive learning. Furthermore, we use a Conditional Feature Modulator (CFM) to incorporate the high-level information of REE for a powerful Mamba-based network, which can leverage effective pixel information to restore image textures and produce visually pleasing results. Extensive experiments demonstrate that the REE can effectively help image super-resolution networks balance fidelity and perceptual quality, highlighting the great potential of Mamba in real-world applications. The source code of this work will be made publicly available at: this https URL
• 摘要：多模态大型模型通过利用语言类作为条件信息，在解决现实场景中的图像超分辨率方面表现出了出色的能力，但它们在降级图像中的能力仍然有限。在本文中，我们首先通过计算文本相似度重新审视识别任何模型（RAM）针对降级图像的功能。我们发现直接使用对比学习在退化空间中微调 RAM 很难达到可接受的结果。为了解决这个问题，我们采用降级选择策略提出了真实嵌入提取器（REE），它通过对比学习在降级图像内容上实现了显着的识别性能增益。此外，我们使用条件特征调制器（CFM）将 REE 的高级信息纳入强大的基于 Mamba 的网络，该网络可以利用有效的像素信息来恢复图像纹理并产生视觉上令人愉悦的结果。大量实验表明，REE 可以有效帮助图像超分辨率网络平衡保真度和感知质量，凸显了 Mamba 在实际应用中的巨大潜力。本作品的源代码将在以下网址公开：此 https URL

Title: SwitchCraft: Training-Free Multi-Event Video Generation with Attention Controls

• Authors: Qianxun Xu, Chenxi Song, Yujun Cai, Chi Zhang
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.23956
• Pdf URL: https://arxiv.org/pdf/2602.23956
• Copy Paste: [[2602.23956]] SwitchCraft: Training-Free Multi-Event Video Generation with Attention Controls(https://arxiv.org/abs/2602.23956)
• Keywords: generation
• Abstract: Recent advances in text-to-video diffusion models have enabled high-fidelity and temporally coherent videos synthesis. However, current models are predominantly optimized for single-event generation. When handling multi-event prompts, without explicit temporal grounding, such models often produce blended or collapsed scenes that break the intended narrative. To address this limitation, we present SwitchCraft, a training-free framework for multi-event video generation. Our key insight is that uniform prompt injection across time ignores the correspondence between events and frames. To this end, we introduce Event-Aligned Query Steering (EAQS), which steers frame-level attention to align with relevant event prompts. Furthermore, we propose Auto-Balance Strength Solver (ABSS), which adaptively balances steering strength to preserve temporal consistency and visual fidelity. Extensive experiments demonstrate that SwitchCraft substantially improves prompt alignment, event clarity, and scene consistency compared with existing baselines, offering a simple yet effective solution for multi-event video generation.
• 摘要：文本到视频扩散模型的最新进展使得高保真度和时间连贯的视频合成成为可能。然而，当前的模型主要针对单事件生成进行优化。在处理多事件提示时，如果没有明确的时间基础，此类模型通常会产生混合或折叠的场景，从而破坏预期的叙述。为了解决这个限制，我们提出了 SwitchCraft，这是一种用于多事件视频生成的免训练框架。我们的主要见解是跨时间的统一提示注入忽略了事件和帧之间的对应关系。为此，我们引入了事件对齐查询引导（EAQS），它引导帧级注意力与相关事件提示保持一致。此外，我们提出了自动平衡强度求解器（ABSS），它自适应地平衡转向强度以保持时间一致性和视觉保真度。大量实验表明，与现有基线相比，SwitchCraft 显着提高了提示对齐、事件清晰度和场景一致性，为多事件视频生成提供了简单而有效的解决方案。

Title: Learning Generation Orders for Masked Discrete Diffusion Models via Variational Inference

• Authors: David Fox, Sam Bowyer, Song Liu, Laurence Aitchison, Raul Santos-Rodriguez, Mengyue Yang
• Subjects: cs.LG
• Abstract URL: https://arxiv.org/abs/2602.23968
• Pdf URL: https://arxiv.org/pdf/2602.23968
• Copy Paste: [[2602.23968]] Learning Generation Orders for Masked Discrete Diffusion Models via Variational Inference(https://arxiv.org/abs/2602.23968)
• Keywords: generation, generative
• Abstract: Masked discrete diffusion models (MDMs) are a promising new approach to generative modelling, offering the ability for parallel token generation and therefore greater efficiency than autoregressive counterparts. However, achieving an optimal balance between parallel generation and sample quality remains an open problem. Current approaches primarily address this issue through fixed, heuristic parallel sampling methods. There exist some recent learning based approaches to this problem, but its formulation from the perspective of variational inference remains underexplored. In this work, we propose a variational inference framework for learning parallel generation orders for MDMs. As part of our method, we propose a parameterisation for the approximate posterior of generation orders which facilitates parallelism and efficient sampling during training. Using this method, we conduct preliminary experiments on the GSM8K dataset, where our method performs competitively against heuristic sampling strategies in the regime of highly parallel generation. For example, our method achieves 33.1\% accuracy with an average of only only 4 generation steps, compared to 23.7-29.0\% accuracy achieved by standard competitor methods in the same number of steps. We believe further experiments and analysis of the method will yield valuable insights into the problem of parallel generation with MDMs.
• 摘要：Masked discrete diffusion models (MDMs) are a promising new approach to generative modelling, offering the ability for parallel token generation and therefore greater efficiency than autoregressive counterparts.然而，在并行生成和样本质量之间实现最佳平衡仍然是一个悬而未决的问题。当前的方法主要通过固定的启发式并行采样方法来解决这个问题。 There exist some recent learning based approaches to this problem, but its formulation from the perspective of variational inference remains underexplored.在这项工作中，我们提出了一个用于学习 MDM 并行生成顺序的变分推理框架。 As part of our method, we propose a parameterisation for the approximate posterior of generation orders which facilitates parallelism and efficient sampling during training. Using this method, we conduct preliminary experiments on the GSM8K dataset, where our method performs competitively against heuristic sampling strategies in the regime of highly parallel generation. For example, our method achieves 33.1\% accuracy with an average of only only 4 generation steps, compared to 23.7-29.0\% accuracy achieved by standard competitor methods in the same number of steps.我们相信，对该方法的进一步实验和分析将为 MDM 并行生成问题提供有价值的见解。

Title: MINT: Multimodal Imaging-to-Speech Knowledge Transfer for Early Alzheimer's Screening

• Authors: Vrushank Ahire, Yogesh Kumar, Anouck Girard, M. A. Ganaie
• Subjects: cs.LG, cs.AI, cs.CV
• Abstract URL: https://arxiv.org/abs/2602.23994
• Pdf URL: https://arxiv.org/pdf/2602.23994
• Copy Paste: [[2602.23994]] MINT: Multimodal Imaging-to-Speech Knowledge Transfer for Early Alzheimer's Screening(https://arxiv.org/abs/2602.23994)
• Keywords: generative
• Abstract: Alzheimer's disease is a progressive neurodegenerative disorder in which mild cognitive impairment (MCI) marks a critical transition between aging and dementia. Neuroimaging modalities, such as structural MRI, provide biomarkers of this transition; however, their high costs and infrastructure needs limit their deployment at a population scale. Speech analysis offers a non-invasive alternative, but speech-only classifiers are developed independently of neuroimaging, leaving decision boundaries biologically ungrounded and limiting reliability on the subtle CN-versus-MCI distinction. We propose MINT (Multimodal Imaging-to-Speech Knowledge Transfer), a three-stage cross-modal framework that transfers biomarker structure from MRI into a speech encoder at training time. An MRI teacher, trained on 1,228 subjects, defines a compact neuroimaging embedding space for CN-versus-MCI classification. A residual projection head aligns speech representations to this frozen imaging manifold via a combined geometric loss, adapting speech to the learned biomarker space while preserving imaging encoder fidelity. The frozen MRI classifier, which is never exposed to speech, is applied to aligned embeddings at inference and requires no scanner. Evaluation on ADNI-4 shows aligned speech achieves performance comparable to speech-only baselines (AUC 0.720 vs 0.711) while requiring no imaging at inference, demonstrating that MRI-derived decision boundaries can ground speech representations. Multimodal fusion improves over MRI alone (0.973 vs 0.958). Ablation studies identify dropout regularization and self-supervised pretraining as critical design decisions. To our knowledge, this is the first demonstration of MRI-to-speech knowledge transfer for early Alzheimer's screening, establishing a biologically grounded pathway for population-level cognitive triage without neuroimaging at inference.
• 摘要：阿尔茨海默病是一种进行性神经退行性疾病，其中轻度认知障碍 (MCI) 标志着衰老和痴呆之间的关键转变。神经影像学模式，例如结构 MRI，提供了这种转变的生物标志物。然而，它们的高成本和基础设施需求限制了它们在人口规模上的部署。语音分析提供了一种非侵入性的替代方案，但纯语音分类器是独立于神经影像学开发的，使得决策边界在生物学上没有根据，并限制了 CN 与 MCI 微妙区别的可靠性。我们提出了 MINT（多模态成像到语音知识转移），这是一种三阶段跨模态框架，可在训练时将生物标志物结构从 MRI 转移到语音编码器中。一位接受过 1,228 名受试者培训的 MRI 教师为 CN 与 MCI 分类定义了一个紧凑的神经影像嵌入空间。残余投影头通过组合几何损失将语音表示与该冻结成像流形对齐，使语音适应学习的生物标记空间，同时保持成像编码器保真度。冻结的 MRI 分类器从不暴露于语音，适用于推理时的对齐嵌入，并且不需要扫描仪。对 ADNI-4 的评估显示，对齐语音的性能与纯语音基线相当（AUC 0.720 与 0.711），同时在推理时不需要成像，这表明 MRI 导出的决策边界可以为语音表示奠定基础。多模态融合比单独的 MRI 有所改善（0.973 vs 0.958）。消融研究将退出正则化和自我监督预训练视为关键的设计决策。据我们所知，这是用于早期阿尔茨海默病筛查的 MRI 到语音知识转移的首次演示，为人群水平的认知分类建立了一个生物学基础的途径，而无需进行神经影像推理。

Title: Accelerating Masked Image Generation by Learning Latent Controlled Dynamics

• Authors: Kaiwen Zhu, Quansheng Zeng, Yuandong Pu, Shuo Cao, Xiaohui Li, Yi Xin, Qi Qin, Jiayang Li, Yu Qiao, Jinjin Gu, Yihao Liu
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.23996
• Pdf URL: https://arxiv.org/pdf/2602.23996
• Copy Paste: [[2602.23996]] Accelerating Masked Image Generation by Learning Latent Controlled Dynamics(https://arxiv.org/abs/2602.23996)
• Keywords: generation
• Abstract: Masked Image Generation Models (MIGMs) have achieved great success, yet their efficiency is hampered by the multiple steps of bi-directional attention. In fact, there exists notable redundancy in their computation: when sampling discrete tokens, the rich semantics contained in the continuous features are lost. Some existing works attempt to cache the features to approximate future features. However, they exhibit considerable approximation error under aggressive acceleration rates. We attribute this to their limited expressivity and the failure to account for sampling information. To fill this gap, we propose to learn a lightweight model that incorporates both previous features and sampled tokens, and regresses the average velocity field of feature evolution. The model has moderate complexity that suffices to capture the subtle dynamics while keeping lightweight compared to the original base model. We apply our method, MIGM-Shortcut, to two representative MIGM architectures and tasks. In particular, on the state-of-the-art Lumina-DiMOO, it achieves over 4x acceleration of text-to-image generation while maintaining quality, significantly pushing the Pareto frontier of masked image generation. The code and model weights are available at this https URL.
• 摘要：掩模图像生成模型（MIGM）取得了巨大的成功，但其效率受到双向注意力的多个步骤的阻碍。事实上，它们的计算存在显着的冗余：当对离散标记进行采样时，连续特征中包含的丰富语义会丢失。一些现有的工作尝试缓存特征以近似未来的特征。然而，它们在激进的加速度下表现出相当大的近似误差。我们将此归因于它们的表达能力有限以及未能考虑采样信息。为了填补这一空白，我们建议学习一个轻量级模型，该模型结合了先前的特征和采样的标记，并对特征演化的平均速度场进行回归。该模型具有适度的复杂性，足以捕捉微妙的动态，同时与原始基础模型相比保持轻量级。我们将我们的方法 MIGM-Shortcut 应用于两个代表性的 MIGM 架构和任务。特别是，在最先进的 Lumina-DiMOO 上，它在保持质量的同时实现了超过 4 倍的文本到图像生成加速，显着推动了蒙版图像生成的帕累托前沿。代码和模型权重可从此 https URL 获取。

Title: Foundation World Models for Agents that Learn, Verify, and Adapt Reliably Beyond Static Environments

• Authors: Florent Delgrange
• Subjects: cs.LG, cs.AI
• Abstract URL: https://arxiv.org/abs/2602.23997
• Pdf URL: https://arxiv.org/pdf/2602.23997
• Copy Paste: [[2602.23997]] Foundation World Models for Agents that Learn, Verify, and Adapt Reliably Beyond Static Environments(https://arxiv.org/abs/2602.23997)
• Keywords: generation
• Abstract: The next generation of autonomous agents must not only learn efficiently but also act reliably and adapt their behavior in open worlds. Standard approaches typically assume fixed tasks and environments with little or no novelty, which limits world models' ability to support agents that must evolve their policies as conditions change. This paper outlines a vision for foundation world models: persistent, compositional representations that unify reinforcement learning, reactive/program synthesis, and abstraction mechanisms. We propose an agenda built around four components: (i) learnable reward models from specifications to support optimization with clear objectives; (ii) adaptive formal verification integrated throughout learning; (iii) online abstraction calibration to quantify the reliability of the model's predictions; and (iv) test-time synthesis and world-model generation guided by verifiers. Together, these components enable agents to synthesize verifiable programs, derive new policies from a small number of interactions, and maintain correctness while adapting to novelty. The resulting framework positions foundation world models as a substrate for learning, reasoning, and adaptation, laying the groundwork for agents that not only act well but can explain and justify the behavior they adopt.
• 摘要：下一代自主智能体不仅必须高效学习，而且必须可靠地行动并在开放世界中调整自己的行为。标准方法通常假设固定的任务和环境，很少或没有新颖性，这限制了世界模型支持代理的能力，代理必须随着条件的变化而发展其策略。本文概述了基础世界模型的愿景：统一强化学习、反应/程序合成和抽象机制的持久组合表示。我们提出了一个围绕四个组成部分构建的议程：（i）来自规范的可学习奖励模型，以支持具有明确目标的优化； (ii) 将自适应形式验证融入整个学习过程； (iii) 在线抽象校准，以量化模型预测的可靠性； (iv) 由验证者指导的测试时综合和世界模型生成。这些组件共同使代理能够综合可验证的程序，从少量的交互中得出新的策略，并在适应新颖性的同时保持正确性。由此产生的框架将基础世界模型定位为学习、推理和适应的基础，为智能体奠定了基础，这些智能体不仅表现良好，而且可以解释和证明他们所采取的行为。

Title: Ordinal Diffusion Models for Color Fundus Images

• Authors: Gustav Schmidt, Philipp Berens, Sarah Müller
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.24013
• Pdf URL: https://arxiv.org/pdf/2602.24013
• Copy Paste: [[2602.24013]] Ordinal Diffusion Models for Color Fundus Images(https://arxiv.org/abs/2602.24013)
• Keywords: generation, generative
• Abstract: It has been suggested that generative image models such as diffusion models can improve performance on clinically relevant tasks by offering deep learning models supplementary training data. However, most conditional diffusion models treat disease stages as independent classes, ignoring the continuous nature of disease progression. This mismatch is problematic in medical imaging because continuous pathological processes are typically only observed through coarse, discrete but ordered labels as in ophthalmology for diabetic retinopathy (DR). We propose an ordinal latent diffusion model for generating color fundus images that explicitly incorporates the ordered structure of DR severity into the generation process. Instead of categorical conditioning, we used a scalar disease representation, enabling a smooth transition between adjacent stages. We evaluated our approach using visual realism metrics and classification-based clinical consistency analysis on the EyePACS dataset. Compared to a standard conditional diffusion model, our model reduced the Fréchet inception distance for four of the five DR stages and increased the quadratic weighted $\kappa$ from 0.79 to 0.87. Furthermore, interpolation experiments showed that the model captured a continuous spectrum of disease progression learned from ordered, coarse class labels.
• 摘要：有人建议，诸如扩散模型之类的生成图像模型可以通过提供深度学习模型补充训练数据来提高临床相关任务的性能。然而，大多数条件扩散模型将疾病阶段视为独立的类别，忽略了疾病进展的连续性。这种不匹配在医学成像中是有问题的，因为连续的病理过程通常只能通过粗糙、离散但有序的标签来观察，就像眼科中的糖尿病视网膜病变 (DR) 一样。我们提出了一种用于生成彩色眼底图像的序数潜在扩散模型，该模型明确地将 DR 严重程度的有序结构纳入生成过程中。我们没有使用分类条件，而是使用标量疾病表示，从而实现相邻阶段之间的平滑过渡。我们使用视觉真实感指标和基于 EyePACS 数据集的基于分类的临床一致性分析来评估我们的方法。 Compared to a standard conditional diffusion model, our model reduced the Fréchet inception distance for four of the five DR stages and increased the quadratic weighted $\kappa$ from 0.79 to 0.87.此外，插值实验表明，该模型捕获了从有序的粗类标签中学习到的疾病进展的连续谱。

Title: SR3R: Rethinking Super-Resolution 3D Reconstruction With Feed-Forward Gaussian Splatting

• Authors: Xiang Feng, Xiangbo Wang, Tieshi Zhong, Chengkai Wang, Yiting Zhao, Tianxiang Xu, Zhenzhong Kuang, Feiwei Qin, Xuefei Yin, Yanming Zhu
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.24020
• Pdf URL: https://arxiv.org/pdf/2602.24020
• Copy Paste: [[2602.24020]] SR3R: Rethinking Super-Resolution 3D Reconstruction With Feed-Forward Gaussian Splatting(https://arxiv.org/abs/2602.24020)
• Keywords: super-resolution
• Abstract: 3D super-resolution (3DSR) aims to reconstruct high-resolution (HR) 3D scenes from low-resolution (LR) multi-view images. Existing methods rely on dense LR inputs and per-scene optimization, which restricts the high-frequency priors for constructing HR 3D Gaussian Splatting (3DGS) to those inherited from pretrained 2D super-resolution (2DSR) models. This severely limits reconstruction fidelity, cross-scene generalization, and real-time usability. We propose to reformulate 3DSR as a direct feed-forward mapping from sparse LR views to HR 3DGS representations, enabling the model to autonomously learn 3D-specific high-frequency geometry and appearance from large-scale, multi-scene data. This fundamentally changes how 3DSR acquires high-frequency knowledge and enables robust generalization to unseen scenes. Specifically, we introduce SR3R, a feed-forward framework that directly predicts HR 3DGS representations from sparse LR views via the learned mapping network. To further enhance reconstruction fidelity, we introduce Gaussian offset learning and feature refinement, which stabilize reconstruction and sharpen high-frequency details. SR3R is plug-and-play and can be paired with any feed-forward 3DGS reconstruction backbone: the backbone provides an LR 3DGS scaffold, and SR3R upscales it to an HR 3DGS. Extensive experiments across three 3D benchmarks demonstrate that SR3R surpasses state-of-the-art (SOTA) 3DSR methods and achieves strong zero-shot generalization, even outperforming SOTA per-scene optimization methods on unseen scenes.
• 摘要：3D 超分辨率 (3DSR) 旨在从低分辨率 (LR) 多视图图像重建高分辨率 (HR) 3D 场景。现有方法依赖于密集 LR 输入和按场景优化，这将构建 HR 3D 高斯分布 (3DGS) 的高频先验限制为从预训练的 2D 超分辨率 (2DSR) 模型继承的高频先验。这严重限制了重建保真度、跨场景泛化和实时可用性。我们建议将 3DSR 重新表述为从稀疏 LR 视图到 HR 3DGS 表示的直接前馈映射，使模型能够从大规模多场景数据中自主学习 3D 特定的高频几何形状和外观。这从根本上改变了 3DSR 获取高频知识的方式，并能够对未见过的场景进行稳健的泛化。具体来说，我们引入了 SR3R，这是一种前馈框架，可通过学习的映射网络直接从稀疏 LR 视图预测 HR 3DGS 表示。为了进一步提高重建保真度，我们引入了高斯偏移学习和特征细化，可以稳定重建并锐化高频细节。 SR3R 是即插即用的，可以与任何前馈 3DGS 重建骨干网配对：骨干网提供 LR 3DGS 支架，SR3R 将其升级为 HR 3DGS。跨越三个 3D 基准的大量实验表明，SR3R 超越了最先进的 (SOTA) 3DSR 方法，并实现了强大的零样本泛化，甚至在未见过的场景上优于 SOTA 每场景优化方法。

Title: GuardAlign: Test-time Safety Alignment in Multimodal Large Language Models

• Authors: Xingyu Zhu, Beier Zhu, Junfeng Fang, Shuo Wang, Yin Zhang, Xiang Wang, Xiangnan He
• Subjects: cs.CV, cs.MM
• Abstract URL: https://arxiv.org/abs/2602.24027
• Pdf URL: https://arxiv.org/pdf/2602.24027
• Copy Paste: [[2602.24027]] GuardAlign: Test-time Safety Alignment in Multimodal Large Language Models(https://arxiv.org/abs/2602.24027)
• Keywords: generation
• Abstract: Large vision-language models (LVLMs) have achieved remarkable progress in vision-language reasoning tasks, yet ensuring their safety remains a critical challenge. Recent input-side defenses detect unsafe images with CLIP and prepend safety prefixes to prompts, but they still suffer from inaccurate detection in complex scenes and unstable safety signals during decoding. To address these issues, we propose GuardAlign, a training-free defense framework that integrates two strategies. First, OT-enhanced safety detection leverages optimal transport to measure distribution distances between image patches and unsafe semantics, enabling accurate identification of malicious regions without additional computational cost. Second, cross-modal attentive calibration strengthens the influence of safety prefixes by adaptively reallocating attention across layers, ensuring that safety signals remain consistently activated throughout generation. Extensive evaluations on six representative MLLMs demonstrate that GuardAlign reduces unsafe response rates by up to 39% on SPA-VL, while preserving utility, achieving an improvement on VQAv2 from 78.51% to 79.21%.
• 摘要：大型视觉语言模型（LVLM）在视觉语言推理任务中取得了显着的进步，但确保其安全性仍然是一个严峻的挑战。最近的输入端防御通过 CLIP 检测不安全图像，并在提示前添加安全前缀，但仍然存在复杂场景中检测不准确以及解码过程中安全信号不稳定的问题。为了解决这些问题，我们提出了 GuardAlign，这是一种集成了两种策略的免训练防御框架。首先，OT增强的安全检测利用最佳传输来测量图像补丁和不安全语义之间的分布距离，从而能够准确识别恶意区域，而无需额外的计算成本。其次，跨模式注意力校准通过自适应地跨层重新分配注意力来增强安全前缀的影响，确保安全信号在整个生成过程中保持一致激活。对六个代表性 MLLM 的广泛评估表明，GuardAlign 将 SPA-VL 上的不安全响应率降低高达 39%，同时保留实用性，将 VQAv2 从 78.51% 提高到 79.21%。

Title: Spatio-Temporal Garment Reconstruction Using Diffusion Mapping via Pattern Coordinates

• Authors: Yingxuan You, Ren Li, Corentin Dumery, Cong Cao, Hao Li, Pascal Fua
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.24043
• Pdf URL: https://arxiv.org/pdf/2602.24043
• Copy Paste: [[2602.24043]] Spatio-Temporal Garment Reconstruction Using Diffusion Mapping via Pattern Coordinates(https://arxiv.org/abs/2602.24043)
• Keywords: generative
• Abstract: Reconstructing 3D clothed humans from monocular images and videos is a fundamental problem with applications in virtual try-on, avatar creation, and mixed reality. Despite significant progress in human body recovery, accurately reconstructing garment geometry, particularly for loose-fitting clothing, remains an open challenge. We propose a unified framework for high-fidelity 3D garment reconstruction from both single images and video sequences. Our approach combines Implicit Sewing Patterns (ISP) with a generative diffusion model to learn expressive garment shape priors in 2D UV space. Leveraging these priors, we introduce a mapping model that establishes correspondences between image pixels, UV pattern coordinates, and 3D geometry, enabling accurate and detailed garment reconstruction from single images. We further extend this formulation to dynamic reconstruction by introducing a spatio-temporal diffusion scheme with test-time guidance to enforce long-range temporal consistency. We also develop analytic projection-based constraints that preserve image-aligned geometry in visible regions while enforcing coherent completion in occluded areas over time. Although trained exclusively on synthetically simulated cloth data, our method generalizes well to real-world imagery and consistently outperforms existing approaches on both tight- and loose-fitting garments. The reconstructed garments preserve fine geometric detail while exhibiting realistic dynamic motion, supporting downstream applications such as texture editing, garment retargeting, and animation.
• 摘要：从单眼图像和视频重建 3D 服装人类是虚拟试穿、头像创建和混合现实应用中的一个基本问题。尽管在人体恢复方面取得了重大进展，但准确重建服装几何形状，特别是宽松的服装，仍然是一个公开的挑战。我们提出了一个统一的框架，用于从单个图像和视频序列进行高保真 3D 服装重建。我们的方法将隐式缝纫图案 (ISP) 与生成扩散模型相结合，以学习 2D UV 空间中富有表现力的服装形状先验。利用这些先验知识，我们引入了一种映射模型，该模型在图像像素、UV 图案坐标和 3D 几何形状之间建立对应关系，从而能够从单个图像进行准确而详细的服装重建。我们通过引入具有测试时间指导的时空扩散方案来进一步将此公式扩展到动态重建，以强制执行远程时间一致性。我们还开发了基于分析投影的约束，在可见区域中保留图像对齐的几何形状，同时随着时间的推移在遮挡区域中强制执行相干补全。尽管专门针对合成模拟布料数据进行训练，但我们的方法可以很好地推广到现实世界的图像，并且在紧身和宽松服装上始终优于现有方法。重建的服装保留了精细的几何细节，同时展示了逼真的动态运动，支持纹理编辑、服装重定向和动画等下游应用。

Title: DiffusionHarmonizer: Bridging Neural Reconstruction and Photorealistic Simulation with Online Diffusion Enhancer

• Authors: Yuxuan Zhang, Katarína Tóthová, Zian Wang, Kangxue Yin, Haithem Turki, Riccardo de Lutio, Yen-Yu Chang, Or Litany, Sanja Fidler, Zan Gojcic
• Subjects: cs.CV, cs.AI, cs.LG
• Abstract URL: https://arxiv.org/abs/2602.24096
• Pdf URL: https://arxiv.org/pdf/2602.24096
• Copy Paste: [[2602.24096]] DiffusionHarmonizer: Bridging Neural Reconstruction and Photorealistic Simulation with Online Diffusion Enhancer(https://arxiv.org/abs/2602.24096)
• Keywords: generative
• Abstract: Simulation is essential to the development and evaluation of autonomous robots such as self-driving vehicles. Neural reconstruction is emerging as a promising solution as it enables simulating a wide variety of scenarios from real-world data alone in an automated and scalable way. However, while methods such as NeRF and 3D Gaussian Splatting can produce visually compelling results, they often exhibit artifacts particularly when rendering novel views, and fail to realistically integrate inserted dynamic objects, especially when they were captured from different scenes. To overcome these limitations, we introduce DiffusionHarmonizer, an online generative enhancement framework that transforms renderings from such imperfect scenes into temporally consistent outputs while improving their realism. At its core is a single-step temporally-conditioned enhancer that is converted from a pretrained multi-step image diffusion model, capable of running in online simulators on a single GPU. The key to training it effectively is a custom data curation pipeline that constructs synthetic-real pairs emphasizing appearance harmonization, artifact correction, and lighting realism. The result is a scalable system that significantly elevates simulation fidelity in both research and production environments.
• 摘要：仿真对于自动驾驶汽车等自主机器人的开发和评估至关重要。神经重建正在成为一种有前途的解决方案，因为它能够以自动化和可扩展的方式仅根据真实世界的数据模拟各种场景。然而，虽然 NeRF 和 3D Gaussian Splatting 等方法可以产生视觉上引人注目的结果，但它们经常会出现伪影，特别是在渲染新视图时，并且无法真实地集成插入的动态对象，特别是当它们是从不同场景捕获时。为了克服这些限制，我们引入了 DiffusionHarmonizer，这是一种在线生成增强框架，可将此类不完美场景的渲染转换为时间一致的输出，同时提高其真实感。其核心是一个单步时间条件增强器，它是从预训练的多步图像扩散模型转换而来的，能够在单个 GPU 上的在线模拟器中运行。有效训练它的关键是定制数据管理管道，该管道构建强调外观协调、伪像校正和光照真实感的合成真实对。其结果是一个可扩展的系统，显着提高了研究和生产环境中的模拟保真度。

Title: Toward Guarantees for Clinical Reasoning in Vision Language Models via Formal Verification

• Authors: Vikash Singh, Debargha Ganguly, Haotian Yu, Chengwei Zhou, Prerna Singh, Brandon Lee, Vipin Chaudhary, Gourav Datta
• Subjects: cs.CV, cs.AI, cs.CL, cs.LO
• Abstract URL: https://arxiv.org/abs/2602.24111
• Pdf URL: https://arxiv.org/pdf/2602.24111
• Copy Paste: [[2602.24111]] Toward Guarantees for Clinical Reasoning in Vision Language Models via Formal Verification(https://arxiv.org/abs/2602.24111)
• Keywords: generative
• Abstract: Vision-language models (VLMs) show promise in drafting radiology reports, yet they frequently suffer from logical inconsistencies, generating diagnostic impressions unsupported by their own perceptual findings or missing logically entailed conclusions. Standard lexical metrics heavily penalize clinical paraphrasing and fail to capture these deductive failures in reference-free settings. Toward guarantees for clinical reasoning, we introduce a neurosymbolic verification framework that deterministically audits the internal consistency of VLM-generated reports. Our pipeline autoformalizes free-text radiographic findings into structured propositional evidence, utilizing an SMT solver (Z3) and a clinical knowledge base to verify whether each diagnostic claim is mathematically entailed, hallucinated, or omitted. Evaluating seven VLMs across five chest X-ray benchmarks, our verifier exposes distinct reasoning failure modes, such as conservative observation and stochastic hallucination, that remain invisible to traditional metrics. On labeled datasets, enforcing solver-backed entailment acts as a rigorous post-hoc guarantee, systematically eliminating unsupported hallucinations to significantly increase diagnostic soundness and precision in generative clinical assistants.
• 摘要：视觉语言模型（VLM）在起草放射学报告方面显示出良好的前景，但它们经常出现逻辑不一致的情况，产生不受自身感知结果支持的诊断印象，或者缺少逻辑上必然得出的结论。标准词汇度量严重惩罚临床释义，并且无法在无参考设置中捕获这些演绎失败。为了保证临床推理，我们引入了一个神经符号验证框架，该框架可以确定性地审核 VLM 生成的报告的内部一致性。我们的流程将自由文本射线照相结果自动形式化为结构化命题证据，利用 SMT 求解器 (Z3) 和临床知识库来验证每个诊断声明是否在数学上是必然的、幻觉的或遗漏的。我们的验证器通过五个胸部 X 射线基准评估七个 VLM，揭示了传统指标中看不见的独特推理失败模式，例如保守观察和随机幻觉。在标记数据集上，强制执行求解器支持的蕴涵作为严格的事后保证，系统地消除不受支持的幻觉，以显着提高生成临床助理的诊断可靠性和精确度。

Title: AgenticOCR: Parsing Only What You Need for Efficient Retrieval-Augmented Generation

• Authors: Zhengren Wang, Dongsheng Ma, Huaping Zhong, Jiayu Li, Wentao Zhang, Bin Wang, Conghui He
• Subjects: cs.CV, cs.CL
• Abstract URL: https://arxiv.org/abs/2602.24134
• Pdf URL: https://arxiv.org/pdf/2602.24134
• Copy Paste: [[2602.24134]] AgenticOCR: Parsing Only What You Need for Efficient Retrieval-Augmented Generation(https://arxiv.org/abs/2602.24134)
• Keywords: generation
• Abstract: The expansion of retrieval-augmented generation (RAG) into multimodal domains has intensified the challenge for processing complex visual documents, such as financial reports. While page-level chunking and retrieval is a natural starting point, it creates a critical bottleneck: delivering entire pages to the generator introduces excessive extraneous context. This not only overloads the generator's attention mechanism but also dilutes the most salient evidence. Moreover, compressing these information-rich pages into a limited visual token budget further increases the risk of hallucinations. To address this, we introduce AgenticOCR, a dynamic parsing paradigm that transforms optical character recognition (OCR) from a static, full-text process into a query-driven, on-demand extraction system. By autonomously analyzing document layout in a "thinking with images" manner, AgenticOCR identifies and selectively recognizes regions of interest. This approach performs on-demand decompression of visual tokens precisely where needed, effectively decoupling retrieval granularity from rigid page-level chunking. AgenticOCR has the potential to serve as the "third building block" of the visual document RAG stack, operating alongside and enhancing standard Embedding and Reranking modules. Experimental results demonstrate that AgenticOCR improves both the efficiency and accuracy of visual RAG systems, achieving expert-level performance in long document understanding. Code and models are available at this https URL.
• 摘要：检索增强生成（RAG）扩展到多模态领域加剧了处理复杂视觉文档（例如财务报告）的挑战。虽然页面级分块和检索是一个自然的起点，但它产生了一个关键瓶颈：将整个页面传递给生成器会引入过多的无关上下文。这不仅使生成器的注意力机制超载，而且还淡化了最显着的证据。此外，将这些信息丰富的页面压缩到有限的视觉令牌预算中进一步增加了产生幻觉的风险。为了解决这个问题，我们引入了 AgenticOCR，这是一种动态解析范例，可将光学字符识别 (OCR) 从静态全文处理转变为查询驱动的按需提取系统。通过以“图像思考”的方式自主分析文档布局，AgenticOCR 识别并选择性地识别感兴趣的区域。这种方法在需要时精确地执行视觉标记的按需解压缩，有效地将检索粒度与严格的页面级分块解耦。 AgenticOCR 有潜力充当视觉文档 RAG 堆栈的“第三个构建块”，与标准嵌入和重新排名模块一起运行并增强标准嵌入和重新排名模块。实验结果表明，AgenticOCR 提高了视觉 RAG 系统的效率和准确性，在长文档理解方面实现了专家级的性能。代码和模型可从此 https URL 获取。

Title: HumanOrbit: 3D Human Reconstruction as 360° Orbit Generation

• Authors: Keito Suzuki, Kunyao Chen, Lei Wang, Bang Du, Runfa Blark Li, Peng Liu, Ning Bi, Truong Nguyen
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.24148
• Pdf URL: https://arxiv.org/pdf/2602.24148
• Copy Paste: [[2602.24148]] HumanOrbit: 3D Human Reconstruction as 360° Orbit Generation(https://arxiv.org/abs/2602.24148)
• Keywords: generation
• Abstract: We present a method for generating a full 360° orbit video around a person from a single input image. Existing methods typically adapt image-based diffusion models for multi-view synthesis, but yield inconsistent results across views and with the original identity. In contrast, recent video diffusion models have demonstrated their ability in generating photorealistic results that align well with the given prompts. Inspired by these results, we propose HumanOrbit, a video diffusion model for multi-view human image generation. Our approach enables the model to synthesize continuous camera rotations around the subject, producing geometrically consistent novel views while preserving the appearance and identity of the person. Using the generated multi-view frames, we further propose a reconstruction pipeline that recovers a textured mesh of the subject. Experimental results validate the effectiveness of HumanOrbit for multi-view image generation and that the reconstructed 3D models exhibit superior completeness and fidelity compared to those from state-of-the-art baselines.
• 摘要：我们提出了一种从单个输入图像生成围绕人的完整 360° 轨道视频的方法。现有方法通常采用基于图像的扩散模型来进行多视图合成，但会在视图之间和原始身份上产生不一致的结果。相比之下，最近的视频扩散模型已经证明了它们生成与给定提示非常一致的逼真结果的能力。受这些结果的启发，我们提出了 HumanOrbit，一种用于多视图人体图像生成的视频扩散模型。我们的方法使模型能够合成围绕主题的连续相机旋转，产生几何一致的新颖视图，同时保留人的外观和身份。使用生成的多视图帧，我们进一步提出了一种重建管道，可以恢复主体的纹理网格。实验结果验证了 HumanOrbit 在多视图图像生成方面的有效性，并且与最先进的基线相比，重建的 3D 模型表现出卓越的完整性和保真度。

Title: GeoDiff4D: Geometry-Aware Diffusion for 4D Head Avatar Reconstruction

• Authors: Chao Xu, Xiaochen Zhao, Xiang Deng, Jingxiang Sun, Zhuo Su, Donglin Di, Yebin Liu
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.24161
• Pdf URL: https://arxiv.org/pdf/2602.24161
• Copy Paste: [[2602.24161]] GeoDiff4D: Geometry-Aware Diffusion for 4D Head Avatar Reconstruction(https://arxiv.org/abs/2602.24161)
• Keywords: generation
• Abstract: Reconstructing photorealistic and animatable 4D head avatars from a single portrait image remains a fundamental challenge in computer vision. While diffusion models have enabled remarkable progress in image and video generation for avatar reconstruction, existing methods primarily rely on 2D priors and struggle to achieve consistent 3D geometry. We propose a novel framework that leverages geometry-aware diffusion to learn strong geometry priors for high-fidelity head avatar reconstruction. Our approach jointly synthesizes portrait images and corresponding surface normals, while a pose-free expression encoder captures implicit expression representations. Both synthesized images and expression latents are incorporated into 3D Gaussian-based avatars, enabling photorealistic rendering with accurate geometry. Extensive experiments demonstrate that our method substantially outperforms state-of-the-art approaches in visual quality, expression fidelity, and cross-identity generalization, while supporting real-time rendering.
• 摘要：从单个肖像图像重建逼真且可动画的 4D 头部头像仍然是计算机视觉领域的一项基本挑战。虽然扩散模型在头像重建的图像和视频生成方面取得了显着进展，但现有方法主要依赖于 2D 先验，很难实现一致的 3D 几何形状。我们提出了一种新颖的框架，利用几何感知扩散来学习强大的几何先验，以进行高保真头部头像重建。我们的方法联合合成肖像图像和相应的表面法线，而无姿势表达编码器捕获隐式表达表示。合成图像和潜在表达都被纳入基于高斯的 3D 化身中，从而实现具有精确几何形状的逼真渲染。大量的实验表明，我们的方法在视觉质量、表达保真度和跨身份泛化方面远远优于最先进的方法，同时支持实时渲染。

Title: A multimodal slice discovery framework for systematic failure detection and explanation in medical image classification

• Authors: Yixuan Liu, Kanwal K. Bhatia, Ahmed E. Fetit
• Subjects: cs.CV, cs.LG
• Abstract URL: https://arxiv.org/abs/2602.24183
• Pdf URL: https://arxiv.org/pdf/2602.24183
• Copy Paste: [[2602.24183]] A multimodal slice discovery framework for systematic failure detection and explanation in medical image classification(https://arxiv.org/abs/2602.24183)
• Keywords: generation
• Abstract: Despite advances in machine learning-based medical image classifiers, the safety and reliability of these systems remain major concerns in practical settings. Existing auditing approaches mainly rely on unimodal features or metadata-based subgroup analyses, which are limited in interpretability and often fail to capture hidden systematic failures. To address these limitations, we introduce the first automated auditing framework that extends slice discovery methods to multimodal representations specifically for medical applications. Comprehensive experiments were conducted under common failure scenarios using the MIMIC-CXR-JPG dataset, demonstrating the framework's strong capability in both failure discovery and explanation generation. Our results also show that multimodal information generally allows more comprehensive and effective auditing of classifiers, while unimodal variants beyond image-only inputs exhibit strong potential in scenarios where resources are constrained.
• 摘要：尽管基于机器学习的医学图像分类器取得了进步，但这些系统的安全性和可靠性仍然是实际环境中的主要问题。现有的审计方法主要依赖于单峰特征或基于元数据的子组分析，其可解释性有限，并且往往无法捕获隐藏的系统故障。为了解决这些限制，我们引入了第一个自动审核框架，该框架将切片发现方法扩展到专门针对医疗应用的多模态表示。使用MIMIC-CXR-JPG数据集在常见故障场景下进行了全面的实验，展示了该框架在故障发现和解释生成方面的强大能力。我们的结果还表明，多模态信息通常允许对分类器进行更全面、更有效的审核，而超出仅图像输入的单模态变体在资源受限的情况下表现出强大的潜力。

Title: Flow-Based Density Ratio Estimation for Intractable Distributions with Applications in Genomics

• Authors: Egor Antipov, Alessandro Palma, Lorenzo Consoli, Stephan Günnemann, Andrea Dittadi, Fabian J. Theis
• Subjects: cs.LG
• Abstract URL: https://arxiv.org/abs/2602.24201
• Pdf URL: https://arxiv.org/pdf/2602.24201
• Copy Paste: [[2602.24201]] Flow-Based Density Ratio Estimation for Intractable Distributions with Applications in Genomics(https://arxiv.org/abs/2602.24201)
• Keywords: generative
• Abstract: Estimating density ratios between pairs of intractable data distributions is a core problem in probabilistic modeling, enabling principled comparisons of sample likelihoods under different data-generating processes across conditions and covariates. While exact-likelihood models such as normalizing flows offer a promising approach to density ratio estimation, naive flow-based evaluations are computationally expensive, as they require simulating costly likelihood integrals for each distribution separately. In this work, we leverage condition-aware flow matching to derive a single dynamical formulation for tracking density ratios along generative trajectories. We demonstrate competitive performance on simulated benchmarks for closed-form ratio estimation, and show that our method supports versatile tasks in single-cell genomics data analysis, where likelihood-based comparisons of cellular states across experimental conditions enable treatment effect estimation and batch correction evaluation.
• 摘要：估计难以处理的数据分布对之间的密度比是概率建模的核心问题，可以对跨条件和协变量的不同数据生成过程下的样本可能性进行原则性比较。虽然归一化流等精确似然模型为密度比估计提供了一种有前途的方法，但基于流的简单评估在计算上是昂贵的，因为它们需要分别模拟每个分布的昂贵的似然积分。在这项工作中，我们利用条件感知流匹配来导出单个动力学公式，用于沿生成轨迹跟踪密度比。我们在封闭式比率估计的模拟基准上展示了竞争性能，并表明我们的方法支持单细胞基因组数据分析中的多功能任务，其中基于可能性的跨实验条件的细胞状态比较可以实现治疗效果估计和批量校正评估。

Title: SenCache: Accelerating Diffusion Model Inference via Sensitivity-Aware Caching

• Authors: Yasaman Haghighi, Alexandre Alahi
• Subjects: cs.CV, cs.LG
• Abstract URL: https://arxiv.org/abs/2602.24208
• Pdf URL: https://arxiv.org/pdf/2602.24208
• Copy Paste: [[2602.24208]] SenCache: Accelerating Diffusion Model Inference via Sensitivity-Aware Caching(https://arxiv.org/abs/2602.24208)
• Keywords: generation
• Abstract: Diffusion models achieve state-of-the-art video generation quality, but their inference remains expensive due to the large number of sequential denoising steps. This has motivated a growing line of research on accelerating diffusion inference. Among training-free acceleration methods, caching reduces computation by reusing previously computed model outputs across timesteps. Existing caching methods rely on heuristic criteria to choose cache/reuse timesteps and require extensive tuning. We address this limitation with a principled sensitivity-aware caching framework. Specifically, we formalize the caching error through an analysis of the model output sensitivity to perturbations in the denoising inputs, i.e., the noisy latent and the timestep, and show that this sensitivity is a key predictor of caching error. Based on this analysis, we propose Sensitivity-Aware Caching (SenCache), a dynamic caching policy that adaptively selects caching timesteps on a per-sample basis. Our framework provides a theoretical basis for adaptive caching, explains why prior empirical heuristics can be partially effective, and extends them to a dynamic, sample-specific approach. Experiments on Wan 2.1, CogVideoX, and LTX-Video show that SenCache achieves better visual quality than existing caching methods under similar computational budgets.
• 摘要：扩散模型实现了最先进的视频生成质量，但由于大量的连续去噪步骤，其推理仍然昂贵。这推动了越来越多关于加速扩散推理的研究。在免训练加速方法中，缓存通过跨时间步重用先前计算的模型输出来减少计算量。现有的缓存方法依赖于启发式标准来选择缓存/重用时间步长，并且需要大量的调整。我们通过原则性的敏感度感知缓存框架来解决这一限制。具体来说，我们通过分析模型输出对去噪输入中的扰动（即噪声潜伏和时间步长）的敏感性来形式化缓存误差，并表明这种敏感性是缓存误差的关键预测因子。基于此分析，我们提出了灵敏度感知缓存（SenCache），这是一种动态缓存策略，可以根据每个样本自适应地选择缓存时间步长。我们的框架为自适应缓存提供了理论基础，解释了为什么先前的经验启发法可以部分有效，并将其扩展到动态的、特定于样本的方法。在 Wan 2.1、CogVideoX 和 LTX-Video 上的实验表明，在类似的计算预算下，SenCache 比现有的缓存方法实现了更好的视觉质量。

Title: Enhancing Spatial Understanding in Image Generation via Reward Modeling

• Authors: Zhenyu Tang, Chaoran Feng, Yufan Deng, Jie Wu, Xiaojie Li, Rui Wang, Yunpeng Chen, Daquan Zhou
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.24233
• Pdf URL: https://arxiv.org/pdf/2602.24233
• Copy Paste: [[2602.24233]] Enhancing Spatial Understanding in Image Generation via Reward Modeling(https://arxiv.org/abs/2602.24233)
• Keywords: generation
• Abstract: Recent progress in text-to-image generation has greatly advanced visual fidelity and creativity, but it has also imposed higher demands on prompt complexity-particularly in encoding intricate spatial relationships. In such cases, achieving satisfactory results often requires multiple sampling attempts. To address this challenge, we introduce a novel method that strengthens the spatial understanding of current image generation models. We first construct the SpatialReward-Dataset with over 80k preference pairs. Building on this dataset, we build SpatialScore, a reward model designed to evaluate the accuracy of spatial relationships in text-to-image generation, achieving performance that even surpasses leading proprietary models on spatial evaluation. We further demonstrate that this reward model effectively enables online reinforcement learning for the complex spatial generation. Extensive experiments across multiple benchmarks show that our specialized reward model yields significant and consistent gains in spatial understanding for image generation.
• 摘要：文本到图像生成的最新进展极大地提高了视觉保真度和创造力，但它也对即时复杂性提出了更高的要求，特别是在编码复杂的空间关系方面。在这种情况下，获得满意的结果通常需要多次采样尝试。为了应对这一挑战，我们引入了一种新方法，可以加强对当前图像生成模型的空间理解。我们首先构建具有超过 80k 偏好对的 SpatialReward 数据集。在此数据集的基础上，我们构建了 SpatialScore，这是一种奖励模型，旨在评估文本到图像生成中空间关系的准确性，其性能甚至超越了领先的空间评估专有模型。我们进一步证明，这种奖励模型有效地实现了复杂空间生成的在线强化学习。跨多个基准的广泛实验表明，我们的专门奖励模型在图像生成的空间理解方面产生了显着且一致的收益。

Title: Joint Geometric and Trajectory Consistency Learning for One-Step Real-World Super-Resolution

• Authors: Chengyan Deng, Zhangquan Chen, Li Yu, Kai Zhang, Xue Zhou, Wang Zhang
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.24240
• Pdf URL: https://arxiv.org/pdf/2602.24240
• Copy Paste: [[2602.24240]] Joint Geometric and Trajectory Consistency Learning for One-Step Real-World Super-Resolution(https://arxiv.org/abs/2602.24240)
• Keywords: super-resolution, generation, generative
• Abstract: Diffusion-based Real-World Image Super-Resolution (Real-ISR) achieves impressive perceptual quality but suffers from high computational costs due to iterative sampling. While recent distillation approaches leveraging large-scale Text-to-Image (T2I) priors have enabled one-step generation, they are typically hindered by prohibitive parameter counts and the inherent capability bounds imposed by teacher models. As a lightweight alternative, Consistency Models offer efficient inference but struggle with two critical limitations: the accumulation of consistency drift inherent to transitive training, and a phenomenon we term "Geometric Decoupling" - where the generative trajectory achieves pixel-wise alignment yet fails to preserve structural coherence. To address these challenges, we propose GTASR (Geometric Trajectory Alignment Super-Resolution), a simple yet effective consistency training paradigm for Real-ISR. Specifically, we introduce a Trajectory Alignment (TA) strategy to rectify the tangent vector field via full-path projection, and a Dual-Reference Structural Rectification (DRSR) mechanism to enforce strict structural constraints. Extensive experiments verify that GTASR delivers superior performance over representative baselines while maintaining minimal latency. The code and model will be released at this https URL.
• 摘要：基于扩散的真实世界图像超分辨率 (Real-ISR) 实现了令人印象深刻的感知质量，但由于迭代采样而导致计算成本较高。虽然最近利用大规模文本到图像（T2I）先验的蒸馏方法已经实现了一步生成，但它们通常受到令人望而却步的参数计数和教师模型强加的固有能力限制的阻碍。作为一种轻量级替代方案，一致性模型提供了高效的推理，但面临两个关键限制：传递训练固有的一致性漂移的积累，以及我们称之为“几何解耦”的现象——生成轨迹实现了像素级对齐，但无法保持结构一致性。为了应对这些挑战，我们提出了 GTASR（几何轨迹对齐超分辨率），这是一种简单而有效的 Real-ISR 一致性训练范例。具体来说，我们引入了轨迹对齐（TA）策略来通过全路径投影来校正切向量场，以及双参考结构校正（DRSR）机制来强制执行严格的结构约束。大量实验验证了 GTASR 提供​​了优于代表性基线的性能，同时保持了最小的延迟。代码和模型将在此 https URL 发布。

Title: Hierarchical Action Learning for Weakly-Supervised Action Segmentation

• Authors: Junxian Huang, Ruichu Cai, Hao Zhu, Juntao Fang, Boyan Xu, Weilin Chen, Zijian Li, Shenghua Gao
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.24275
• Pdf URL: https://arxiv.org/pdf/2602.24275
• Copy Paste: [[2602.24275]] Hierarchical Action Learning for Weakly-Supervised Action Segmentation(https://arxiv.org/abs/2602.24275)
• Keywords: generation
• Abstract: Humans perceive actions through key transitions that structure actions across multiple abstraction levels, whereas machines, relying on visual features, tend to over-segment. This highlights the difficulty of enabling hierarchical reasoning in video understanding. Interestingly, we observe that lower-level visual and high-level action latent variables evolve at different rates, with low-level visual variables changing rapidly, while high-level action variables evolve more slowly, making them easier to identify. Building on this insight, we propose the Hierarchical Action Learning (\textbf{HAL}) model for weakly-supervised action segmentation. Our approach introduces a hierarchical causal data generation process, where high-level latent action governs the dynamics of low-level visual features. To model these varying timescales effectively, we introduce deterministic processes to align these latent variables over time. The \textbf{HAL} model employs a hierarchical pyramid transformer to capture both visual features and latent variables, and a sparse transition constraint is applied to enforce the slower dynamics of high-level action variables. This mechanism enhances the identification of these latent variables over time. Under mild assumptions, we prove that these latent action variables are strictly identifiable. Experimental results on several benchmarks show that the \textbf{HAL} model significantly outperforms existing methods for weakly-supervised action segmentation, confirming its practical effectiveness in real-world applications.
• 摘要：人类通过跨多个抽象级别构建动作的关键转换来感知动作，而依赖视觉特征的机器往往会过度分段。这凸显了在视频理解中实现分层推理的难度。有趣的是，我们观察到较低级别的视觉和高级动作潜在变量以不同的速率演化，低级视觉变量变化很快，而高级动作变量演化得更慢，使它们更容易识别。基于这一见解，我们提出了用于弱监督动作分割的分层动作学习（\textbf{HAL}）模型。我们的方法引入了分层因果数据生成过程，其中高级潜在动作控制低级视觉特征的动态。为了有效地对这些变化的时间尺度进行建模，我们引入了确定性过程来随着时间的推移调整这些潜在变量。 \textbf{HAL} 模型采用分层金字塔变换器来捕获视觉特征和潜在变量，并应用稀疏转换约束来强制高级动作变量的较慢动态。随着时间的推移，这种机制增强了对这些潜在变量的识别。在温和的假设下，我们证明这些潜在的行动变量是严格可识别的。多个基准测试的实验结果表明，\textbf{HAL} 模型显着优于现有的弱监督动作分割方法，证实了其在实际应用中的实际有效性。

Title: CUDA Agent: Large-Scale Agentic RL for High-Performance CUDA Kernel Generation

• Authors: Weinan Dai, Hanlin Wu, Qiying Yu, Huan-ang Gao, Jiahao Li, Chengquan Jiang, Weiqiang Lou, Yufan Song, Hongli Yu, Jiaze Chen, Wei-Ying Ma, Ya-Qin Zhang, Jingjing Liu, Mingxuan Wang, Xin Liu, Hao Zhou
• Subjects: cs.LG, cs.AI
• Abstract URL: https://arxiv.org/abs/2602.24286
• Pdf URL: https://arxiv.org/pdf/2602.24286
• Copy Paste: [[2602.24286]] CUDA Agent: Large-Scale Agentic RL for High-Performance CUDA Kernel Generation(https://arxiv.org/abs/2602.24286)
• Keywords: generation
• Abstract: GPU kernel optimization is fundamental to modern deep learning but remains a highly specialized task requiring deep hardware expertise. Despite strong performance in general programming, large language models (LLMs) remain uncompetitive with compiler-based systems such as this http URL for CUDA kernel generation. Existing CUDA code generation approaches either rely on training-free refinement or fine-tune models within fixed multi-turn execution-feedback loops, but both paradigms fail to fundamentally improve the model's intrinsic CUDA optimization ability, resulting in limited performance gains. We present CUDA Agent, a large-scale agentic reinforcement learning system that develops CUDA kernel expertise through three components: a scalable data synthesis pipeline, a skill-augmented CUDA development environment with automated verification and profiling to provide reliable reward signals, and reinforcement learning algorithmic techniques enabling stable training. CUDA Agent achieves state-of-the-art results on KernelBench, delivering 100\%, 100\%, and 92\% faster rate over this http URL on KernelBench Level-1, Level-2, and Level-3 splits, outperforming the strongest proprietary models such as Claude Opus 4.5 and Gemini 3 Pro by about 40\% on the hardest Level-3 setting.
• 摘要：GPU 内核优化是现代深度学习的基础，但仍然是一项高度专业化的任务，需要深厚的硬件专业知识。尽管在一般编程方面具有强大的性能，但大型语言模型 (LLM) 与基于编译器的系统（例如用于 CUDA 内核生成的 http URL）相比仍然没有竞争力。现有的 CUDA 代码生成方法要么依赖于免训练细化，要么依赖于固定多轮执行反馈循环内的微调模型，但这两种范式都无法从根本上提高模型内在的 CUDA 优化能力，导致性能提升有限。我们推出了 CUDA Agent，这是一个大规模代理强化学习系统，它通过三个组件开发 CUDA 内核专业知识：可扩展的数据合成管道、具有自动验证和分析功能的技能增强 CUDA 开发环境，以提供可靠的奖励信号，以及支持稳定训练的强化学习算法技术。 CUDA Agent 在 KernelBench 上实现了最先进的结果，在 KernelBench Level-1、Level-2 和 Level-3 分割上比此 http URL 提供了 100\%、100\% 和 92\% 的更快速度，在最难的 Level-3 设置上比 Claude Opus 4.5 和 Gemini 3 Pro 等最强的专有模型高出约 40\%。

Title: Mode Seeking meets Mean Seeking for Fast Long Video Generation

• Authors: Shengqu Cai, Weili Nie, Chao Liu, Julius Berner, Lvmin Zhang, Nanye Ma, Hansheng Chen, Maneesh Agrawala, Leonidas Guibas, Gordon Wetzstein, Arash Vahdat
• Subjects: cs.CV, cs.LG
• Abstract URL: https://arxiv.org/abs/2602.24289
• Pdf URL: https://arxiv.org/pdf/2602.24289
• Copy Paste: [[2602.24289]] Mode Seeking meets Mean Seeking for Fast Long Video Generation(https://arxiv.org/abs/2602.24289)
• Keywords: generation
• Abstract: Scaling video generation from seconds to minutes faces a critical bottleneck: while short-video data is abundant and high-fidelity, coherent long-form data is scarce and limited to narrow domains. To address this, we propose a training paradigm where Mode Seeking meets Mean Seeking, decoupling local fidelity from long-term coherence based on a unified representation via a Decoupled Diffusion Transformer. Our approach utilizes a global Flow Matching head trained via supervised learning on long videos to capture narrative structure, while simultaneously employing a local Distribution Matching head that aligns sliding windows to a frozen short-video teacher via a mode-seeking reverse-KL divergence. This strategy enables the synthesis of minute-scale videos that learns long-range coherence and motions from limited long videos via supervised flow matching, while inheriting local realism by aligning every sliding-window segment of the student to a frozen short-video teacher, resulting in a few-step fast long video generator. Evaluations show that our method effectively closes the fidelity-horizon gap by jointly improving local sharpness, motion and long-range consistency. Project website: this https URL.
• 摘要：将视频生成从几秒扩展到几分钟面临着一个关键瓶颈：虽然短视频数据丰富且高保真，但连贯的长格式数据却稀缺且仅限于狭窄的领域。为了解决这个问题，我们提出了一种训练范式，其中模式搜索满足均值搜索，通过解耦扩散变压器基于统一表示将局部保真度与长期一致性解耦。我们的方法利用通过长视频监督学习训练的全局流匹配头来捕获叙事结构，同时采用局部分布匹配头，通过模式搜索反向 KL 散度将滑动窗口与冻结的短视频教师对齐。该策略能够合成分钟尺度的视频，通过监督流匹配从有限的长视频中学习远程连贯性和运动，同时通过将学生的每个滑动窗口片段与冻结的短视频教师对齐来继承局部现实主义，从而产生几步快速的长视频生成器。评估表明，我们的方法通过共同提高局部清晰度、运动和远程一致性，有效地缩小了保真度与视野的差距。项目网站：这个 https URL。