2026-03-12

Title: Explainable LLM Unlearning Through Reasoning

• Authors: Junfeng Liao, Qizhou Wang, Shanshan Ye, Xin Yu, Ling Chen, Zhen Fang
• Subjects: cs.LG, cs.AI, cs.CL
• Abstract URL: https://arxiv.org/abs/2603.09980
• Pdf URL: https://arxiv.org/pdf/2603.09980
• Copy Paste: [[2603.09980]] Explainable LLM Unlearning Through Reasoning(https://arxiv.org/abs/2603.09980)
• Keywords: generation
• Abstract: LLM unlearning is essential for mitigating safety, copyright, and privacy concerns in pre-trained large language models (LLMs). Compared to preference alignment, it offers a more explicit way by removing undesirable knowledge characterized by specific unlearning datasets. In previous works, gradient ascent (GA) and its variants have shown promise for implementing unlearning, yet their untargeted nature results in unintended degradation of general capabilities, incomplete removal of knowledge, and the generation of incoherent responses, among many others. We argue that these issues stem from the absence of explicit guidance on what and how models should unlearn. To fill this gap, we introduce a novel unlearning target, reasoning-based unlearning target, which satisfies both the specified unlearning scope and the specified post-unlearning response. Building on this, we propose targeted reasoning unlearning (TRU), which leverages reasoning-based unlearning target as guidance. We employ the target using a cross-entropy supervised loss combined with a GA-based loss, enabling the model to learn reasoning ability for precise knowledge removal while preserving unrelated abilities. We evaluate TRU against strong baselines across multiple benchmarks and LLM backbones, and find that it achieves more reliable unlearning while preserving general capabilities. Moreover, TRU exhibits superior robustness under diverse attack scenarios, stemming from the reasoning ability learned through reasoning-based targets. Overall, our study establishes reasoning-augmented unlearning as a practical paradigm for reliable and explainable LLM unlearning.
• 摘要：LLM 忘却对于减轻预训练大型语言模型 (LLM) 中的安全、版权和隐私问题至关重要。与偏好对齐相比，它提供了一种更明确的方式，通过删除以特定的未学习数据集为特征的不需要的知识。在之前的工作中，梯度上升（GA）及其变体已显示出实现去学习的希望，但其无针对性的性质会导致一般能力的意外退化、知识的不完全删除以及产生不连贯的响应等。我们认为，这些问题源于缺乏关于模型应该忘记什么以及如何忘记的明确指导。为了填补这一空白，我们引入了一种新颖的遗忘目标，即基于推理的遗忘目标，它满足指定的遗忘范围和指定的遗忘后响应。在此基础上，我们提出了有针对性的推理遗忘（TRU），它利用基于推理的遗忘目标作为指导。我们使用交叉熵监督损失与基于遗传算法的损失相结合的目标，使模型能够学习推理能力以精确去除知识，同时保留不相关的能力。我们根据跨多个基准和 LLM 主干的强大基线对 TRU 进行评估，发现它在保留一般能力的同时实现了更可靠的忘却。此外，TRU 在不同的攻击场景下表现出卓越的鲁棒性，这源于通过基于推理的目标学习的推理能力。总体而言，我们的研究将推理增强遗忘作为可靠且可解释的法学硕士遗忘的实用范例。

Title: Personalized Group Relative Policy Optimization for Heterogenous Preference Alignment

• Authors: Jialu Wang, Heinrich Peters, Asad A. Butt, Navid Hashemi, Alireza Hashemi, Pouya M. Ghari, Joseph Hoover, James Rae, Morteza Dehghani
• Subjects: cs.LG, cs.AI, cs.CL
• Abstract URL: https://arxiv.org/abs/2603.10009
• Pdf URL: https://arxiv.org/pdf/2603.10009
• Copy Paste: [[2603.10009]] Personalized Group Relative Policy Optimization for Heterogenous Preference Alignment(https://arxiv.org/abs/2603.10009)
• Keywords: generation
• Abstract: Despite their sophisticated general-purpose capabilities, Large Language Models (LLMs) often fail to align with diverse individual preferences because standard post-training methods, like Reinforcement Learning with Human Feedback (RLHF), optimize for a single, global objective. While Group Relative Policy Optimization (GRPO) is a widely adopted on-policy reinforcement learning framework, its group-based normalization implicitly assumes that all samples are exchangeable, inheriting this limitation in personalized settings. This assumption conflates distinct user reward distributions and systematically biases learning toward dominant preferences while suppressing minority signals. To address this, we introduce Personalized GRPO (P-GRPO), a novel alignment framework that decouples advantage estimation from immediate batch statistics. By normalizing advantages against preference-group-specific reward histories rather than the concurrent generation group, P-GRPO preserves the contrastive signal necessary for learning distinct preferences. We evaluate P-GRPO across diverse tasks and find that it consistently achieves faster convergence and higher rewards than standard GRPO, thereby enhancing its ability to recover and align with heterogeneous preference signals. Our results demonstrate that accounting for reward heterogeneity at the optimization level is essential for building models that faithfully align with diverse human preferences without sacrificing general capabilities.
• 摘要：尽管大型语言模型 (LLM) 具有复杂的通用功能，但它通常无法满足不同的个人偏好，因为标准的训练后方法（例如带有人类反馈的强化学习 (RLHF)）会针对单一的全局目标进行优化。虽然组相对策略优化（GRPO）是一种广泛采用的同策略强化学习框架，但其基于组的归一化隐式假设所有样本都是可交换的，从而在个性化设置中继承了这一限制。这种假设将不同的用户奖励分布混为一谈，并系统地使学习偏向主导偏好，同时抑制少数信号。为了解决这个问题，我们引入了个性化 GRPO (P-GRPO)，这是一种新颖的对齐框架，可将优势估计与即时批量统计数据解耦。通过针对特定偏好组的奖励历史而不是同时生成组的优势进行标准化，P-GRPO 保留了学习不同偏好所需的对比信号。我们在不同的任务中评估 P-GRPO，发现它始终比标准 GRPO 实现更快的收敛和更高的奖励，从而增强其恢复和与异构偏好信号保持一致的能力。我们的结果表明，在优化级别考虑奖励异质性对于构建忠实地符合不同人类偏好而不牺牲一般能力的模型至关重要。

Title: Gated Adaptation for Continual Learning in Human Activity Recognition

• Authors: Reza Rahimi Azghan, Gautham Krishna Gudur, Mohit Malu, Edison Thomaz, Giulia Pedrielli, Pavan Turaga, Hassan Ghasemzadeh
• Subjects: cs.LG, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.10046
• Pdf URL: https://arxiv.org/pdf/2603.10046
• Copy Paste: [[2603.10046]] Gated Adaptation for Continual Learning in Human Activity Recognition(https://arxiv.org/abs/2603.10046)
• Keywords: generation
• Abstract: Wearable sensors in Internet of Things (IoT) ecosystems increasingly support applications such as remote health monitoring, elderly care, and smart home automation, all of which rely on robust human activity recognition (HAR). Continual learning systems must balance plasticity (learning new tasks) with stability (retaining prior knowledge), yet AI models often exhibit catastrophic forgetting, where learning new tasks degrades performance on earlier ones. This challenge is especially acute in domain-incremental HAR, where on-device models must adapt to new subjects with distinct movement patterns while maintaining accuracy on prior subjects without transmitting sensitive data to the cloud. We propose a parameter-efficient continual learning framework based on channel-wise gated modulation of frozen pretrained representations. Our key insight is that adaptation should operate through feature selection rather than feature generation: by restricting learned transformations to diagonal scaling of existing features, we preserve the geometry of pretrained representations while enabling subject-specific modulation. We provide a theoretical analysis showing that gating implements a bounded diagonal operator that limits representational drift compared to unconstrained linear transformations. Empirically, freezing the backbone substantially reduces forgetting, and lightweight gates restore lost adaptation capacity, achieving stability and plasticity simultaneously. On PAMAP2 with 8 sequential subjects, our approach reduces forgetting from 39.7% to 16.2% and improves final accuracy from 56.7% to 77.7%, while training less than 2% of parameters. Our method matches or exceeds standard continual learning baselines without replay buffers or task-specific regularization, confirming that structured diagonal operators are effective and efficient under distribution shift.
• 摘要：物联网 (IoT) 生态系统中的可穿戴传感器越来越多地支持远程健康监测、老年护理和智能家居自动化等应用，所有这些都依赖于强大的人类活动识别 (HAR)。持续学习系统必须平衡可塑性（学习新任务）和稳定性（保留先验知识），但人工智能模型经常表现出灾难性遗忘，学习新任务会降低早期任务的性能。这一挑战在域增量 HAR 中尤其严峻，其中设备上的模型必须适应具有不同运动模式的新对象，同时保持先前对象的准确性，而不将敏感数据传输到云端。我们提出了一种基于冻结预训练表示的通道门控调制的参数高效持续学习框架。我们的主要见解是，适应应该通过特征选择而不是特征生成来进行：通过将学习到的变换限制为现有特征的对角缩放，我们保留了预训练表示的几何形状，同时实现了特定于主题的调制。我们提供的理论分析表明，门控实现了有界对角线运算符，与无约束的线性变换相比，该运算符限制了表征漂移。根据经验，冻结主干可以大大减少遗忘，而轻量级门可以恢复失去的适应能力，同时实现稳定性和可塑性。在具有 8 个连续受试者的 PAMAP2 上，我们的方法将遗忘从 39.7% 减少到 16.2%，并将最终准确率从 56.7% 提高到 77.7%，同时训练不到 2% 的参数。我们的方法匹配或超过标准持续学习基线，无需重播缓冲区或特定于任务的正则化，确认结构化对角线运算符在分布转移下是有效且高效的。

Title: KernelSkill: A Multi-Agent Framework for GPU Kernel Optimization

• Authors: Qitong Sun, Jun Han, Tianlin Li, Zhe Tang, Sheng Chen, Fei Yang, Aishan Liu, Xianglong Liu, Yang Liu
• Subjects: cs.LG, cs.AI, cs.MA
• Abstract URL: https://arxiv.org/abs/2603.10085
• Pdf URL: https://arxiv.org/pdf/2603.10085
• Copy Paste: [[2603.10085]] KernelSkill: A Multi-Agent Framework for GPU Kernel Optimization(https://arxiv.org/abs/2603.10085)
• Keywords: generation
• Abstract: Improving GPU kernel efficiency is crucial for advancing AI systems. Recent work has explored leveraging large language models (LLMs) for GPU kernel generation and optimization. However, existing LLM-based kernel optimization pipelines typically rely on opaque, implicitly learned heuristics within the LLMs to determine optimization strategies. This leads to inefficient trial-and-error and weakly interpretable optimizations. Our key insight is to replace implicit heuristics with expert optimization skills that are knowledge-driven and aware of task trajectories. Specifically, we present KernelSkill, a multi-agent framework with a dual-level memory architecture. KernelSkill operates by coordinating agents with long-term memory of reusable expert skills and short-term memory to prevent repetitive backtracking. On KernelBench Levels 1-3, KernelSkill achieves a 100% success rate and average speedups of 5.44x, 2.82x, and 1.92x over Torch Eager on Levels 1, 2, and 3, respectively, outperforming prior baselines. Code is available at this https URL.
• 摘要：提高 GPU 内核效率对于推进 AI 系统至关重要。最近的工作探索了利用大型语言模型 (LLM) 进行 GPU 内核生成和优化。然而，现有的基于 LLM 的内核优化流程通常依赖于 LLM 中不透明的、隐式学习的启发式方法来确定优化策略。这会导致低效的试错和难以解释的优化。我们的主要见解是用知识驱动且了解任务轨迹的专家优化技能取代隐式启发法。具体来说，我们提出了 KernelSkill，一个具有双层内存架构的多代理框架。 KernelSkill 通过协调具有可重用专家技能的长期记忆和短期记忆的代理来运行，以防止重复回溯。在 KernelBench 级别 1-3 上，KernelSkill 实现了 100% 的成功率，并且在级别 1、2 和 3 上比 Torch Eager 平均加速分别为 5.44 倍、2.82 倍和 1.92 倍，优于之前的基线。代码可从此 https URL 获取。

Title: ES-dLLM: Efficient Inference for Diffusion Large Language Models by Early-Skipping

• Authors: Zijian Zhu, Fei Ren, Zhanhong Tan, Kaisheng Ma
• Subjects: cs.LG, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.10088
• Pdf URL: https://arxiv.org/pdf/2603.10088
• Copy Paste: [[2603.10088]] ES-dLLM: Efficient Inference for Diffusion Large Language Models by Early-Skipping(https://arxiv.org/abs/2603.10088)
• Keywords: generation
• Abstract: Diffusion large language models (dLLMs) are emerging as a promising alternative to autoregressive models (ARMs) due to their ability to capture bidirectional context and the potential for parallel generation. Despite the advantages, dLLM inference remains computationally expensive as the full input context is processed at every iteration. In this work, we analyze the generation dynamics of dLLMs and find that intermediate representations, including key, value, and hidden states, change only subtly across successive iterations. Leveraging this insight, we propose \textbf{ES-dLLM}, a training-free inference acceleration framework for dLLM that reduces computation by skipping tokens in early layers based on the estimated importance. Token importance is computed with intermediate tensor variation and confidence scores of previous iterations. Experiments on LLaDA-8B and Dream-7B demonstrate that ES-dLLM achieves throughput of up to 226.57 and 308.51 tokens per second (TPS), respectively, on an NVIDIA H200 GPU, delivering 5.6$\times$ to 16.8$\times$ speedup over the vanilla implementation and up to 1.85$\times$ over the state-of-the-art caching method, while preserving generation quality.
• 摘要：扩散大语言模型 (dLLM) 因其捕获双向上下文的能力和并行生成的潜力而成为自回归模型 (ARM) 的有前景的替代方案。尽管有这些优点，dLLM 推理的计算成本仍然很高，因为每次迭代都会处理完整的输入上下文。在这项工作中，我们分析了 dLLM 的生成动态，发现中间表示（包括键、值和隐藏状态）在连续迭代中仅发生微妙的变化。利用这一见解，我们提出了 \textbf{ES-dLLM}，这是一种无需训练的 dLLM 推理加速框架，可根据估计的重要性跳过早期层中的标记来减少计算量。令牌重要性是通过中间张量变化和先前迭代的置信度得分来计算的。 LLaDA-8B 和 Dream-7B 上的实验表明，ES-dLLM 在 NVIDIA H200 GPU 上分别实现了高达 226.57 和 308.51 个令牌每秒 (TPS) 的吞吐量，比普通实现实现了 5.6$\times$ 到 16.8$\times$ 加速，比最先进的缓存实现了高达 1.85$\times$方法，同时保持生成质量。

Title: A Survey of Weight Space Learning: Understanding, Representation, and Generation

• Authors: Xiaolong Han, Zehong Wang, Bo Zhao, Binchi Zhang, Jundong Li, Damian Borth, Rose Yu, Haggai Maron, Yanfang Ye, Lu Yin, Ferrante Neri
• Subjects: cs.LG
• Abstract URL: https://arxiv.org/abs/2603.10090
• Pdf URL: https://arxiv.org/pdf/2603.10090
• Copy Paste: [[2603.10090]] A Survey of Weight Space Learning: Understanding, Representation, and Generation(https://arxiv.org/abs/2603.10090)
• Keywords: generation, generative
• Abstract: Neural network weights are typically viewed as the end product of training, while most deep learning research focuses on data, features, and architectures. However, recent advances show that the set of all possible weight values (weight space) itself contains rich structure: pretrained models form organized distributions, exhibit symmetries, and can be embedded, compared, or even generated. Understanding such structures has tremendous impact on how neural networks are analyzed and compared, and on how knowledge is transferred across models, beyond individual training instances. This emerging research direction, which we refer to as Weight Space Learning (WSL), treats neural weights as a meaningful domain for analysis and modeling. This survey provides the first unified taxonomy of WSL. We categorize existing methods into three core dimensions: Weight Space Understanding (WSU), which studies the geometry and symmetries of weights; Weight Space Representation (WSR), which learns embeddings over model weights; and Weight Space Generation (WSG), which synthesizes new weights through hypernetworks or generative models. We further show how these developments enable practical applications, including model retrieval, continual and federated learning, neural architecture search, and data-free reconstruction. By consolidating fragmented progress under a coherent framework, this survey highlights weight space as a learnable, structured domain with growing impact across model analysis, transferring, and weight generation. We release an accompanying resource at this https URL.
• 摘要：神经网络权重通常被视为训练的最终产品，而大多数深度学习研究都集中在数据、特征和架构上。然而，最近的进展表明，所有可能的权重值（权重空间）的集合本身包含丰富的结构：预训练的模型形成有组织的分布，表现出对称性，并且可以嵌入、比较甚至生成。理解此类结构对于如何分析和比较神经网络以及如何跨模型传输知识（超越单个训练实例）具有巨大影响。这个新兴的研究方向，我们称之为权重空间学习（WSL），将神经权重视为一个有意义的分析和建模领域。这项调查提供了第一个统一的 WSL 分类法。我们将现有方法分为三个核心维度：权重空间理解（WSU），研究权重的几何和对称性；权重空间表示（WSR），学习模型权重的嵌入；权重空间生成（WSG），它通过超网络或生成模型合成新的权重。我们进一步展示了这些发展如何实现实际应用，包括模型检索、持续和联邦学习、神经架构搜索和无数据重建。通过将分散的进展整合到一个连贯的框架下，这项调查强调权重空间是一个可学习的、结构化的领域，在模型分析、传输和权重生成方面的影响力越来越大。我们在此 https URL 发布了随附的资源。

Title: Equivariant Asynchronous Diffusion: An Adaptive Denoising Schedule for Accelerated Molecular Conformation Generation

• Authors: Junyi An, Chao Qu, Yun-Fei Shi, Zhijian Zhou, Fenglei Cao, Yuan Qi
• Subjects: cs.LG, cs.AI, q-bio.QM
• Abstract URL: https://arxiv.org/abs/2603.10093
• Pdf URL: https://arxiv.org/pdf/2603.10093
• Copy Paste: [[2603.10093]] Equivariant Asynchronous Diffusion: An Adaptive Denoising Schedule for Accelerated Molecular Conformation Generation(https://arxiv.org/abs/2603.10093)
• Keywords: generation
• Abstract: Recent 3D molecular generation methods primarily use asynchronous auto-regressive or synchronous diffusion models. While auto-regressive models build molecules sequentially, they're limited by a short horizon and a discrepancy between training and inference. Conversely, synchronous diffusion models denoise all atoms at once, offering a molecule-level horizon but failing to capture the causal relationships inherent in hierarchical molecular structures. We introduce Equivariant Asynchronous Diffusion (EAD) to overcome these limitations. EAD is a novel diffusion model that combines the strengths of both approaches: it uses an asynchronous denoising schedule to better capture molecular hierarchy while maintaining a molecule-level horizon. Since these relationships are often complex, we propose a dynamic scheduling mechanism to adaptively determine the denoising timestep. Experimental results show that EAD achieves state-of-the-art performance in 3D molecular generation.
• 摘要：最近的 3D 分子生成方法主要使用异步自回归或同步扩散模型。虽然自回归模型按顺序构建分子，但它们受到短期以及训练和推理之间差异的限制。相反，同步扩散模型同时对所有原子进行去噪，提供了分子水平的视野，但无法捕捉分层分子结构中固有的因果关系。我们引入等变异步扩散（EAD）来克服这些限制。 EAD 是一种新颖的扩散模型，结合了两种方法的优点：它使用异步去噪计划来更好地捕获分子层次结构，同时保持分子水平范围。由于这些关系通常很复杂，我们提出了一种动态调度机制来自适应地确定去噪时间步长。实验结果表明，EAD 在 3D 分子生成方面实现了最先进的性能。

Title: HG-Lane: High-Fidelity Generation of Lane Scenes under Adverse Weather and Lighting Conditions without Re-annotation

• Authors: Daichao Zhao, Qiupu Chen, Feng He, Xin Ning, Qiankun Li
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.10128
• Pdf URL: https://arxiv.org/pdf/2603.10128
• Copy Paste: [[2603.10128]] HG-Lane: High-Fidelity Generation of Lane Scenes under Adverse Weather and Lighting Conditions without Re-annotation(https://arxiv.org/abs/2603.10128)
• Keywords: generation
• Abstract: Lane detection is a crucial task in autonomous driving, as it helps ensure the safe operation of vehicles. However, existing datasets such as CULane and TuSimple contain relatively limited data under extreme weather conditions, including rain, snow, and fog. As a result, detection models trained on these datasets often become unreliable in such environments, which may lead to serious safety-critical failures on the road. To address this issue, we propose HG-Lane, a High-fidelity Generation framework for Lane Scenes under adverse weather and lighting conditions without requiring re-annotation. Based on this framework, we further construct a benchmark that includes adverse weather and lighting scenarios, containing 30,000 images. Experimental results demonstrate that our method consistently and significantly improves the performance of existing lane detection networks. For example, using the state-of-the-art CLRNet, the overall mF1 score on our benchmark increases by 20.87 percent. The F1@50 score for the overall, normal, snow, rain, fog, night, and dusk categories increases by 19.75 percent, 8.63 percent, 38.8 percent, 14.96 percent, 26.84 percent, 21.5 percent, and 12.04 percent, respectively. The code and dataset are available at: this https URL.
• 摘要：车道检测是自动驾驶中的一项关键任务，因为它有助于确保车辆的安全运行。然而，现有的数据集（例如CULane和TuSimple）在雨、雪和雾等极端天气条件下包含的数据相对有限。因此，在这些数据集上训练的检测模型在此类环境中通常变得不可靠，这可能会导致道路上出现严重的安全关键故障。为了解决这个问题，我们提出了 HG-Lane，一种用于恶劣天气和照明条件下车道场景的高保真生成框架，无需重新注释。基于这个框架，我们进一步构建了一个包含恶劣天气和光照场景的基准，包含 30,000 张图像。实验结果表明，我们的方法持续且显着地提高了现有车道检测网络的性能。例如，使用最先进的 CLRNet，我们基准测试的总体 mF1 分数提高了 20.87%。总体、正常、雪、雨、雾、夜间、黄昏类别的F1@50得分分别提高了19.75%、8.63%、38.8%、14.96%、26.84%、21.5%和12.04%。代码和数据集可在以下位置获取：此 https URL。

Title: Delta-K: Boosting Multi-Instance Generation via Cross-Attention Augmentation

• Authors: Zitong Wang, Zijun Shen, Haohao Xu, Zhengjie Luo, Weibin Wu
• Subjects: cs.CV, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.10210
• Pdf URL: https://arxiv.org/pdf/2603.10210
• Copy Paste: [[2603.10210]] Delta-K: Boosting Multi-Instance Generation via Cross-Attention Augmentation(https://arxiv.org/abs/2603.10210)
• Keywords: generation
• Abstract: While Diffusion Models excel in text-to-image synthesis, they often suffer from concept omission when synthesizing complex multi-instance scenes. Existing training-free methods attempt to resolve this by rescaling attention maps, which merely exacerbates unstructured noise without establishing coherent semantic representations. To address this, we propose Delta-K, a backbone-agnostic and plug-and-play inference framework that tackles omission by operating directly in the shared cross-attention Key space. Specifically, with Vision-language model, we extract a differential key $\Delta K$ that encodes the semantic signature of missing concepts. This signal is then injected during the early semantic planning stage of the diffusion process. Governed by a dynamically optimized scheduling mechanism, Delta-K grounds diffuse noise into stable structural anchors while preserving existing concepts. Extensive experiments demonstrate the generality of our approach: Delta-K consistently improves compositional alignment across both modern DiT models and classical U-Net architectures, without requiring spatial masks, additional training, or architectural modifications.
• 摘要：虽然扩散模型在文本到图像的合成方面表现出色，但在合成复杂的多实例场景时，它们经常会出现概念遗漏的情况。现有的免训练方法试图通过重新调整注意力图来解决这个问题，但这只会加剧非结构化噪声，而不会建立连贯的语义表示。为了解决这个问题，我们提出了 Delta-K，这是一种与主干无关、即插即用的推理框架，通过直接在共享的交叉注意力密钥空间中操作来解决遗漏问题。具体来说，通过视觉语言模型，我们提取了一个差分键 $\Delta K$，它对缺失概念的语义签名进行编码。然后在扩散过程的早期语义规划阶段注入该信号。在动态优化调度机制的控制下，Delta-K 将噪声扩散到稳定的结构锚点中，同时保留现有概念。大量实验证明了我们方法的通用性：Delta-K 持续改进了现代 DiT 模型和经典 U-Net 架构的组合对齐，而不需要空间掩模、额外的训练或架构修改。

Title: Improving TabPFN's Synthetic Data Generation by Integrating Causal Structure

• Authors: Davide Tugnoli, Andrea De Lorenzo, Marco Virgolin, Giovanni Cinà
• Subjects: cs.LG
• Abstract URL: https://arxiv.org/abs/2603.10254
• Pdf URL: https://arxiv.org/pdf/2603.10254
• Copy Paste: [[2603.10254]] Improving TabPFN's Synthetic Data Generation by Integrating Causal Structure(https://arxiv.org/abs/2603.10254)
• Keywords: generation
• Abstract: Synthetic tabular data generation addresses data scarcity and privacy constraints in a variety of domains. Tabular Prior-Data Fitted Network (TabPFN), a recent foundation model for tabular data, has been shown capable of generating high-quality synthetic tabular data. However, TabPFN is autoregressive: features are generated sequentially by conditioning on the previous ones, depending on the order in which they appear in the input data. We demonstrate that when the feature order conflicts with causal structure, the model produces spurious correlations that impair its ability to generate synthetic data and preserve causal effects. We address this limitation by integrating causal structure into TabPFN's generation process through two complementary approaches: Directed Acyclic Graph (DAG)-aware conditioning, which samples each variable given its causal parents, and a Completed Partially Directed Acyclic Graph (CPDAG)-based strategy for scenarios with partial causal knowledge. We evaluate these approaches on controlled benchmarks and six CSuite datasets, assessing structural fidelity, distributional alignment, privacy preservation, and Average Treatment Effect (ATE) preservation. Across most settings, DAG-aware conditioning improves the quality and stability of synthetic data relative to vanilla TabPFN. The CPDAG-based strategy shows moderate improvements, with effectiveness depending on the number of oriented edges. These results indicate that injecting causal structure into autoregressive generation enhances the reliability of synthetic tabular data.
• 摘要：合成表格数据生成解决了各个领域的数据稀缺和隐私限制问题。表格先验数据拟合网络（TabPFN）是最近的表格数据基础模型，已被证明能够生成高质量的合成表格数据。然而，TabPFN 是自回归的：特征是通过对先前特征进行调节来顺序生成的，具体取决于它们在输入数据中出现的顺序。我们证明，当特征顺序与因果结构冲突时，模型会产生虚假相关性，从而损害其生成合成数据和保留因果效应的能力。我们通过两种互补的方法将因果结构集成到 TabPFN 的生成过程中来解决这一限制：有向无环图 (DAG) 感知调节，在给定其因果父级的情况下对每个变量进行采样，以及基于完整部分有向无环图 (CPDAG) 的策略，用于具有部分因果知识的场景。我们在受控基准和六个 CSuite 数据集上评估这些方法，评估结构保真度、分布对齐、隐私保护和平均治疗效果 (ATE) 保留。在大多数设置中，与普通 TabPFN 相比，DAG 感知调节可提高合成数据的质量和稳定性。基于 CPDAG 的策略显示出适度的改进，其有效性取决于定向边的数量。这些结果表明，将因果结构注入自回归生成中可以增强合成表格数据的可靠性。

Title: A Robust Deep Learning Framework for Bangla License Plate Recognition Using YOLO and Vision-Language OCR

• Authors: Nayeb Hasin, Md. Arafath Rahman Nishat, Mainul Islam, Khandakar Shakib Al Hasan, Asif Newaz
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.10267
• Pdf URL: https://arxiv.org/pdf/2603.10267
• Copy Paste: [[2603.10267]] A Robust Deep Learning Framework for Bangla License Plate Recognition Using YOLO and Vision-Language OCR(https://arxiv.org/abs/2603.10267)
• Keywords: generation
• Abstract: An Automatic License Plate Recognition (ALPR) system constitutes a crucial element in an intelligent traffic management system. However, the detection of Bangla license plates remains challenging because of the complicated character scheme and uneven layouts. This paper presents a robust Bangla License Plate Recognition system that integrates a deep learning-based object detection model for license plate localization with Optical Character Recognition for text extraction. Multiple object detection architectures, including U-Net and several YOLO (You Only Look Once) variants, are compared for license plate localization. This study proposes a novel two-stage adaptive training strategy built upon the YOLOv8 architecture to improve localization performance. The proposed approach outperforms the established models, achieving an accuracy of 97.83% and an Intersection over Union (IoU) of 91.3%. The text recognition problem is phrased as a sequence generation problem with a VisionEncoderDecoder architecture, with a combination of encoder-decoders evaluated. It was demonstrated that the ViT + BanglaBERT model gives better results at the character level, with a Character Error Rate of 0.1323 and Word Error Rate of 0.1068. The proposed system also shows a consistent performance when tested on an external dataset that has been curated for this study purpose. The dataset offers completely different environment and lighting conditions compared to the training sample, indicating the robustness of the proposed framework. Overall, our proposed system provides a robust and reliable solution for Bangla license plate recognition and performs effectively across diverse real-world scenarios, including variations in lighting, noise, and plate styles. These strengths make it well suited for deployment in intelligent transportation applications such as automated law enforcement and access control.
• 摘要：自动车牌识别（ALPR）系统是智能交通管理系统的关键要素。然而，由于复杂的字符方案和不均匀的布局，孟加拉车牌的检测仍然具有挑战性。本文提出了一个强大的孟加拉车牌识别系统，该系统集成了用于车牌定位的基于深度学习的对象检测模型和用于文本提取的光学字符识别。比较了多种对象检测架构，包括 U-Net 和几个 YOLO（只看一次）变体，以进行车牌定位。本研究提出了一种基于 YOLOv8 架构的新型两阶段自适应训练策略，以提高定位性能。所提出的方法优于已建立的模型，达到 97.83% 的准确率和 91.3% 的交集（IoU）。文本识别问题被表述为具有 VisionEncoderDecoder 架构的序列生成问题，并评估编码器-解码器的组合。事实证明，ViT + BanglaBERT 模型在字符级别给出了更好的结果，字符错误率为 0.1323，单词错误率为 0.1068。在为此研究目的而策划的外部数据集上进行测试时，所提出的系统还显示出一致的性能。与训练样本相比，数据集提供了完全不同的环境和照明条件，表明所提出的框架的鲁棒性。总的来说，我们提出的系统为孟加拉车牌识别提供了一个强大而可靠的解决方案，并在不同的现实场景中有效地执行，包括照明、噪声和车牌样式的变化。这些优势使其非常适合部署在智能交通应用中，例如自动执法和访问控制。

Title: Robust Post-Training for Generative Recommenders: Why Exponential Reward-Weighted SFT Outperforms RLHF

• Authors: Keertana Chidambaram, Sanath Kumar Krishnamurthy, Qiuling Xu, Ko-Jen Hsiao, Moumita Bhattacharya
• Subjects: cs.LG
• Abstract URL: https://arxiv.org/abs/2603.10279
• Pdf URL: https://arxiv.org/pdf/2603.10279
• Copy Paste: [[2603.10279]] Robust Post-Training for Generative Recommenders: Why Exponential Reward-Weighted SFT Outperforms RLHF(https://arxiv.org/abs/2603.10279)
• Keywords: generative
• Abstract: Aligning generative recommender systems to user preferences via post-training is critical for closing the gap between next-item prediction and actual recommendation quality. Existing post-training methods are ill-suited for production-scale systems: RLHF methods reward hack due to noisy user feedback and unreliable reward models, offline RL alternatives require propensity scores that are unavailable, and online interaction is infeasible. We identify exponential reward-weighted SFT with weights $w = \exp(r/\lambda)$ as uniquely suited to this setting, and provide the theoretical and empirical foundations that explain why. By optimizing directly on observed rewards without querying a learned reward model, the method is immune to reward hacking, requires no propensity scores, and is fully offline. We prove the first policy improvement guarantees for this setting under noisy rewards, showing that the gap scales only logarithmically with catalog size and remains informative even for large item catalogs. Crucially, we show that temperature $\lambda$ explicitly and quantifiably controls the robustness-improvement tradeoff, providing practitioners with a single interpretable regularization hyperparameter with theoretical grounding. Experiments on three open-source and one proprietary dataset against four baselines confirm that exponential reward weighting is simple, scalable, and consistently outperforms RLHF-based alternatives.
• 摘要：通过后期训练使生成推荐系统与用户偏好保持一致对于缩小下一项预测与实际推荐质量之间的差距至关重要。现有的训练后方法不适合生产规模的系统：RLHF 方法由于嘈杂的用户反馈和不可靠的奖励模型而奖励黑客，离线 RL 替代方案需要不可用的倾向分数，并且在线交互是不可行的。我们确定权重 $w = \exp(r/\lambda)$ 的指数奖励加权 SFT 特别适合这种设置，并提供了解释原因的理论和经验基础。通过直接优化观察到的奖励而不查询学习的奖励模型，该方法不受奖励黑客攻击，不需要倾向分数，并且完全离线。我们证明了在嘈杂的奖励下这种设置的第一个政策改进保证，表明差距仅与目录大小成对数缩放，并且即使对于大型项目目录也仍然提供信息。至关重要的是，我们表明温度 $\lambda$ 明确且可量化地控制鲁棒性与改进的权衡，为实践者提供具有理论基础的单一可解释的正则化超参数。针对四个基线对三个开源数据集和一个专有数据集进行的实验证实，指数奖励权重简单、可扩展，并且始终优于基于 RLHF 的替代方案。

Title: Taming Score-Based Denoisers in ADMM: A Convergent Plug-and-Play Framework

• Authors: Rajesh Shrestha, Xiao Fu
• Subjects: cs.LG, cs.AI, cs.CV
• Abstract URL: https://arxiv.org/abs/2603.10281
• Pdf URL: https://arxiv.org/pdf/2603.10281
• Copy Paste: [[2603.10281]] Taming Score-Based Denoisers in ADMM: A Convergent Plug-and-Play Framework(https://arxiv.org/abs/2603.10281)
• Keywords: generative
• Abstract: While score-based generative models have emerged as powerful priors for solving inverse problems, directly integrating them into optimization algorithms such as ADMM remains nontrivial. Two central challenges arise: i) the mismatch between the noisy data manifolds used to train the score functions and the geometry of ADMM iterates, especially due to the influence of dual variables, and ii) the lack of convergence understanding when ADMM is equipped with score-based denoisers. To address the manifold mismatch issue, we propose ADMM plug-and-play (ADMM-PnP) with the AC-DC denoiser, a new framework that embeds a three-stage denoiser into ADMM: (1) auto-correction (AC) via additive Gaussian noise, (2) directional correction (DC) using conditional Langevin dynamics, and (3) score-based denoising. In terms of convergence, we establish two results: first, under proper denoiser parameters, each ADMM iteration is a weakly nonexpansive operator, ensuring high-probability fixed-point $\textit{ball convergence}$ using a constant step size; second, under more relaxed conditions, the AC-DC denoiser is a bounded denoiser, which leads to convergence under an adaptive step size schedule. Experiments on a range of inverse problems demonstrate that our method consistently improves solution quality over a variety of baselines.
• 摘要：虽然基于分数的生成模型已成为解决逆问题的强大先验，但将它们直接集成到 ADMM 等优化算法中仍然很重要。出现了两个核心挑战：i）用于训练得分函数的噪声数据流形与 ADMM 迭代的几何形状之间的不匹配，特别是由于双变量的影响，以及 ii）当 ADMM 配备基于得分的降噪器时缺乏收敛理解。为了解决流形不匹配问题，我们提出了带有 AC-DC 降噪器的 ADMM 即插即用 (ADMM-PnP)，这是一种将三级降噪器嵌入到 ADMM 中的新框架：(1) 通过加性高斯噪声进行自动校正 (AC)，(2) 使用条件 Langevin 动力学进行方向校正 (DC)，以及 (3) 基于分数的降噪。在收敛性方面，我们建立了两个结果：首先，在适当的降噪器参数下，每次ADMM迭代都是一个弱非扩张算子，使用恒定步长确保高概率的定点$\textit{ball收敛}$；其次，在更宽松的条件下，AC-DC 降噪器是有界降噪器，这会导致在自适应步长方案下收敛。对一系列反问题的实验表明，我们的方法在各种基线上持续提高了解决方案的质量。

Title: How to make the most of your masked language model for protein engineering

• Authors: Calvin McCarter, Nick Bhattacharya, Sebastian W. Ober, Hunter Elliott
• Subjects: cs.LG, q-bio.QM
• Abstract URL: https://arxiv.org/abs/2603.10302
• Pdf URL: https://arxiv.org/pdf/2603.10302
• Copy Paste: [[2603.10302]] How to make the most of your masked language model for protein engineering(https://arxiv.org/abs/2603.10302)
• Keywords: generation
• Abstract: A plethora of protein language models have been released in recent years. Yet comparatively little work has addressed how to best sample from them to optimize desired biological properties. We fill this gap by proposing a flexible, effective sampling method for masked language models (MLMs), and by systematically evaluating models and methods both in silico and in vitro on actual antibody therapeutics campaigns. Firstly, we propose sampling with stochastic beam search, exploiting the fact that MLMs are remarkably efficient at evaluating the pseudo-perplexity of the entire 1-edit neighborhood of a sequence. Reframing generation in terms of entire-sequence evaluation enables flexible guidance with multiple optimization objectives. Secondly, we report results from our extensive in vitro head-to-head evaluation for the antibody engineering setting. This reveals that choice of sampling method is at least as impactful as the model used, motivating future research into this under-explored area.
• 摘要：近年来已经发布了大量的蛋白质语言模型。然而，相对较少的工作涉及如何最好地从它们中取样以优化所需的生物特性。我们通过提出一种灵活、有效的掩码语言模型（MLM）抽样方法，并在实际抗体治疗活动中系统地评估计算机和体外模型和方法来填补这一空白。首先，我们提出使用随机波束搜索进行采样，利用 MLM 在评估序列的整个 1 编辑邻域的伪困惑度方面非常有效的事实。根据整个序列评估重构生成可以实现具有多个优化目标的灵活指导。其次，我们报告了对抗体工程环境进行广泛的体外头对头评估的结果。这表明采样方法的选择至少与所使用的模型一样有影响力，从而激发了未来对这一尚未探索的领域的研究。

Title: EmoStory: Emotion-Aware Story Generation

• Authors: Jingyuan Yang, Rucong Chen, Hui Huang
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.10349
• Pdf URL: https://arxiv.org/pdf/2603.10349
• Copy Paste: [[2603.10349]] EmoStory: Emotion-Aware Story Generation(https://arxiv.org/abs/2603.10349)
• Keywords: generation
• Abstract: Story generation aims to produce image sequences that depict coherent narratives while maintaining subject consistency across frames. Although existing methods have excelled in producing coherent and expressive stories, they remain largely emotion-neutral, focusing on what subject appears in a story while overlooking how emotions shape narrative interpretation and visual presentation. As stories are intended to engage audiences emotionally, we introduce emotion-aware story generation, a new task that aims to generate subject-consistent visual stories with explicit emotional directions. This task is challenging due to the abstract nature of emotions, which must be grounded in concrete visual elements and consistently expressed across a narrative through visual composition. To address these challenges, we propose EmoStory, a two-stage framework that integrates agent-based story planning and region-aware story generation. The planning stage transforms target emotions into coherent story prompts with emotion agent and writer agent, while the generation stage preserves subject consistency and injects emotion-related elements through region-aware composition. We evaluate EmoStory on a newly constructed dataset covering 25 subjects and 600 emotional stories. Extensive quantitative and qualitative results, along with user studies, show that EmoStory outperforms state-of-the-art story generation methods in emotion accuracy, prompt alignment, and subject consistency.
• 摘要：故事生成旨在生成描绘连贯叙述的图像序列，同时保持跨框架的主题一致性。尽管现有的方法在制作连贯且富有表现力的故事方面表现出色，但它们在很大程度上仍然是情感中立的，专注于故事中出现的主题，而忽视了情感如何塑造叙事解释和视觉呈现。由于故事的目的是在情感上吸引观众，因此我们引入了情感感知故事生成，这是一项新任务，旨在生成具有明确情感方向的主题一致的视觉故事。由于情感的抽象性质，这项任务具有挑战性，它必须以具体的视觉元素为基础，并通过视觉构成在整个叙事中一致地表达。为了应对这些挑战，我们提出了 EmoStory，这是一个两阶段框架，集成了基于代理的故事规划和区域感知的故事生成。规划阶段通过情感代理和作家代理将目标情感转化为连贯的故事提示，而生成阶段则保持主题一致性并通过区域感知的构图注入情感相关元素。我们在一个新构建的数据集上评估 EmoStory，该数据集涵盖 25 个主题和 600 个情感故事。广泛的定量和定性结果以及用户研究表明，EmoStory 在情感准确性、及时一致性和主题一致性方面优于最先进的故事生成方法。

Title: Geometric Autoencoder for Diffusion Models

• Authors: Hangyu Liu, Jianyong Wang, Yutao Sun
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.10365
• Pdf URL: https://arxiv.org/pdf/2603.10365
• Copy Paste: [[2603.10365]] Geometric Autoencoder for Diffusion Models(https://arxiv.org/abs/2603.10365)
• Keywords: generation, generative
• Abstract: Latent diffusion models have established a new state-of-the-art in high-resolution visual generation. Integrating Vision Foundation Model priors improves generative efficiency, yet existing latent designs remain largely heuristic. These approaches often struggle to unify semantic discriminability, reconstruction fidelity, and latent compactness. In this paper, we propose Geometric Autoencoder (GAE), a principled framework that systematically addresses these challenges. By analyzing various alignment paradigms, GAE constructs an optimized low-dimensional semantic supervision target from VFMs to provide guidance for the autoencoder. Furthermore, we leverage latent normalization that replaces the restrictive KL-divergence of standard VAEs, enabling a more stable latent manifold specifically optimized for diffusion learning. To ensure robust reconstruction under high-intensity noise, GAE incorporates a dynamic noise sampling mechanism. Empirically, GAE achieves compelling performance on the ImageNet-1K $256 \times 256$ benchmark, reaching a gFID of 1.82 at only 80 epochs and 1.31 at 800 epochs without Classifier-Free Guidance, significantly surpassing existing state-of-the-art methods. Beyond generative quality, GAE establishes a superior equilibrium between compression, semantic depth and robust reconstruction stability. These results validate our design considerations, offering a promising paradigm for latent diffusion modeling. Code and models are publicly available at this https URL.
• 摘要：潜在扩散模型在高分辨率视觉生成方面建立了新的最先进技术。集成视觉基础模型先验可以提高生成效率，但现有的潜在设计在很大程度上仍然是启发式的。这些方法通常很难统一语义辨别性、重建保真度和潜在紧凑性。在本文中，我们提出了几何自动编码器（GAE），这是一个系统地解决这些挑战的原则框架。通过分析各种对齐范式，GAE 从 VFM 构建优化的低维语义监督目标，为自动编码器提供指导。此外，我们利用潜在标准化来取代标准 VAE 的限制性 KL 散度，从而实现更稳定的潜在流形，专门针对扩散学习进行了优化。为了确保高强度噪声下的稳健重建，GAE 采用了动态噪声采样机制。根据经验，GAE 在 ImageNet-1K $256 × 256$ 基准上实现了引人注目的性能，在没有无分类器指导的情况下，仅 80 个时期的 gFID 达到 1.82，在 800 个时期达到 1.31，显着超越了现有的最先进方法。除了生成质量之外，GAE 在压缩、语义深度和鲁棒重建稳定性之间建立了卓越的平衡。这些结果验证了我们的设计考虑，为潜在扩散建模提供了一个有前途的范例。代码和模型可通过此 https URL 公开获取。

Title: Variance-Aware Adaptive Weighting for Diffusion Model Training

• Authors: Nanlong Sun, Lei Shi
• Subjects: cs.LG, cs.CV
• Abstract URL: https://arxiv.org/abs/2603.10391
• Pdf URL: https://arxiv.org/pdf/2603.10391
• Copy Paste: [[2603.10391]] Variance-Aware Adaptive Weighting for Diffusion Model Training(https://arxiv.org/abs/2603.10391)
• Keywords: generative
• Abstract: Diffusion models have recently achieved remarkable success in generative modeling, yet their training dynamics across different noise levels remain highly imbalanced, which can lead to inefficient optimization and unstable learning behavior. In this work, we investigate this imbalance from the perspective of loss variance across log-SNR levels and propose a variance-aware adaptive weighting strategy to address it. The proposed approach dynamically adjusts training weights based on the observed variance distribution, encouraging a more balanced optimization process across noise levels. Extensive experiments on CIFAR-10 and CIFAR-100 demonstrate that the proposed method consistently improves generative performance over standard training schemes, achieving lower Fréchet Inception Distance (FID) while also reducing performance variance across random seeds. Additional analysis, including loss-log-SNR visualization, variance heatmaps, and ablation studies, further reveal that the adaptive weighting effectively stabilizes training dynamics. These results highlight the potential of variance-aware training strategies for improving diffusion model optimization.
• 摘要：扩散模型最近在生成建模方面取得了显着的成功，但它们在不同噪声水平下的训练动态仍然高度不平衡，这可能导致低效的优化和不稳定的学习行为。在这项工作中，我们从跨对数 SNR 水平的损失方差的角度研究了这种不平衡，并提出了一种方差感知自适应加权策略来解决它。所提出的方法根据观察到的方差分布动态调整训练权重，鼓励跨噪声水平的更平衡的优化过程。 CIFAR-10 和 CIFAR-100 上的大量实验表明，所提出的方法比标准训练方案持续提高了生成性能，实现了更低的 Fréchet 起始距离 (FID)，同时还减少了随机种子之间的性能差异。其他分析，包括损失对数信噪比可视化、方差热图和消融研究，进一步揭示了自适应加权有效地稳定了训练动态。这些结果凸显了方差感知训练策略在改进扩散模型优化方面的潜力。

Title: Graph-GRPO: Training Graph Flow Models with Reinforcement Learning

• Authors: Baoheng Zhu, Deyu Bo, Delvin Ce Zhang, Xiao Wang
• Subjects: cs.LG
• Abstract URL: https://arxiv.org/abs/2603.10395
• Pdf URL: https://arxiv.org/pdf/2603.10395
• Copy Paste: [[2603.10395]] Graph-GRPO: Training Graph Flow Models with Reinforcement Learning(https://arxiv.org/abs/2603.10395)
• Keywords: generation
• Abstract: Graph generation is a fundamental task with broad applications, such as drug discovery. Recently, discrete flow matching-based graph generation, \aka, graph flow model (GFM), has emerged due to its superior performance and flexible sampling. However, effectively aligning GFMs with complex human preferences or task-specific objectives remains a significant challenge. In this paper, we propose Graph-GRPO, an online reinforcement learning (RL) framework for training GFMs under verifiable rewards. Our method makes two key contributions: (1) We derive an analytical expression for the transition probability of GFMs, replacing the Monte Carlo sampling and enabling fully differentiable rollouts for RL training; (2) We propose a refinement strategy that randomly perturbs specific nodes and edges in a graph, and regenerates them, allowing for localized exploration and self-improvement of generation quality. Extensive experiments on both synthetic and real datasets demonstrate the effectiveness of Graph-GRPO. With only 50 denoising steps, our method achieves 95.0\% and 97.5\% Valid-Unique-Novelty scores on the planar and tree datasets, respectively. Moreover, Graph-GRPO achieves state-of-the-art performance on the molecular optimization tasks, outperforming graph-based and fragment-based RL methods as well as classic genetic algorithms.
• 摘要：图生成是一项具有广泛应用的基本任务，例如药物发现。最近，基于离散流匹配的图生成，又名图流模型（GFM），由于其优越的性能和灵活的采样而出现。然而，有效地将 GFM 与复杂的人类偏好或特定任务目标保持一致仍然是一个重大挑战。在本文中，我们提出了 Graph-GRPO，这是一种在线强化学习（RL）框架，用于在可验证的奖励下训练 GFM。我们的方法有两个关键贡献：（1）我们推导了 GFM 转移概率的解析表达式，取代了蒙特卡洛采样，并为 RL 训练实现了完全可微分的推出； （2）我们提出了一种细化策略，随机扰动图中的特定节点和边并重新生成它们，从而允许局部探索和生成质量的自我改进。对合成数据集和真实数据集的大量实验证明了 Graph-GRPO 的有效性。仅通过 50 个去噪步骤，我们的方法就在平面和树数据集上分别实现了 95.0% 和 97.5% 的有效独特新颖性分数。此外，Graph-GRPO 在分子优化任务上实现了最先进的性能，优于基于图和基于片段的 RL 方法以及经典遗传算法。

Title: Motion Forcing: A Decoupled Framework for Robust Video Generation in Motion Dynamics

• Authors: Tianshuo Xu, Zhifei Chen, Leyi Wu, Hao Lu, Ying-cong Chen
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.10408
• Pdf URL: https://arxiv.org/pdf/2603.10408
• Copy Paste: [[2603.10408]] Motion Forcing: A Decoupled Framework for Robust Video Generation in Motion Dynamics(https://arxiv.org/abs/2603.10408)
• Keywords: generation, generative
• Abstract: The ultimate goal of video generation is to satisfy a fundamental trilemma: achieving high visual quality, maintaining rigorous physical consistency, and enabling precise controllability. While recent models can maintain this balance in simple, isolated scenarios, we observe that this equilibrium is fragile and often breaks down as scene complexity increases (e.g., involving collisions or dense traffic). To address this, we introduce \textbf{Motion Forcing}, a framework designed to stabilize this trilemma even in complex generative tasks. Our key insight is to explicitly decouple physical reasoning from visual synthesis via a hierarchical \textbf{``Point-Shape-Appearance''} paradigm. This approach decomposes generation into verifiable stages: modeling complex dynamics as sparse geometric anchors (\textbf{Point}), expanding them into dynamic depth maps that explicitly resolve 3D geometry (\textbf{Shape}), and finally rendering high-fidelity textures (\textbf{Appearance}). Furthermore, to foster robust physical understanding, we employ a \textbf{Masked Point Recovery} strategy. By randomly masking input anchors during training and enforcing the reconstruction of complete dynamic depth, the model is compelled to move beyond passive pattern matching and learn latent physical laws (e.g., inertia) to infer missing trajectories. Extensive experiments on autonomous driving benchmarks show that Motion Forcing significantly outperforms state-of-the-art baselines, maintaining trilemma stability across complex scenes. Evaluations on physics and robotics further confirm our framework's generality.
• 摘要：视频生成的最终目标是满足一个基本的三难困境：实现高视觉质量、保持严格的物理一致性以及实现精确的可控性。虽然最近的模型可以在简单、孤立的场景中保持这种平衡，但我们观察到这种平衡是脆弱的，并且随着场景复杂性的增加（例如，涉及碰撞或密集的交通）而经常被打破。为了解决这个问题，我们引入了 \textbf{Motion Forcing}，这是一个旨在稳定这种三难困境的框架，即使在复杂的生成任务中也是如此。我们的主要见解是通过分层 \textbf{``Point-Shape-Appearance''} 范式将物理推理与视觉合成明确分离。这种方法将生成分解为可验证的阶段：将复杂的动态建模为稀疏几何锚点（\textbf{Point}），将其扩展为显式解析 3D 几何的动态深度图（\textbf{Shape}），最后渲染高保真纹理（\textbf{Appearance}）。此外，为了促进强大的物理理解，我们采用了 \textbf{Masked Point Recovery} 策略。通过在训练期间随机屏蔽输入锚点并强制重建完整的动态深度，该模型被迫超越被动模式匹配并学习潜在的物理定律（例如惯性）以推断丢失的轨迹。自动驾驶基准的大量实验表明，运动强迫显着优于最先进的基线，在复杂场景中保持三难稳定性。对物理学和机器人技术的评估进一步证实了我们框架的通用性。

Title: World2Act: Latent Action Post-Training via Skill-Compositional World Models

• Authors: An Dinh Vuong, Tuan Van Vo, Abdullah Sohail, Haoran Ding, Liang Ma, Xiaodan Liang, Anqing Duan, Ivan Laptev, Ian Reid
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.10422
• Pdf URL: https://arxiv.org/pdf/2603.10422
• Copy Paste: [[2603.10422]] World2Act: Latent Action Post-Training via Skill-Compositional World Models(https://arxiv.org/abs/2603.10422)
• Keywords: generation
• Abstract: World Models (WMs) have emerged as a promising approach for post-training Vision-Language-Action (VLA) policies to improve robustness and generalization under environmental changes. However, most WM-based post-training methods rely on pixel-space supervision, making policies sensitive to pixel-level artifacts and hallucination from imperfect WM rollouts. We introduce World2Act, a post-training framework that aligns VLA actions directly with WM video-dynamics latents using a contrastive matching objective, reducing dependence on pixels. Post-training performance is tied to rollout quality, yet current WMs struggle with arbitrary-length video generation as they are mostly trained on fixed-length clips while robotic execution durations vary widely. To address this, we propose an automatic LLM-based skill-decomposition pipeline that segments high-level instructions into low-level prompts. Our pipeline produces RoboCasa-Skill and LIBERO-Skill, supporting skill-compositional WMs that remain temporally consistent across diverse task horizons. Empirically, applying World2Act to VLAs like GR00T-N1.6 and Cosmos Policy achieves state-of-the-art results on RoboCasa and LIBERO, and improves real-world performance by 6.7%, enhancing embodied agent generalization.
• 摘要：世界模型（WM）已成为训练后视觉-语言-行动（VLA）政策的一种有前景的方法，可提高环境变化下的鲁棒性和泛化性。然而，大多数基于 WM 的后训练方法依赖于像素空间监督，使得策略对像素级伪影和不完美的 WM 推出产生的幻觉敏感。我们引入了 World2Act，这是一个后训练框架，它使用对比匹配目标将 VLA 动作直接与 WM 视频动态潜伏对齐，从而减少对像素的依赖。训练后性能与推出质量相关，但当前的 WM 难以生成任意长度的视频，因为它们主要是在固定长度的剪辑上进行训练，而机器人执行持续时间差异很大。为了解决这个问题，我们提出了一种基于 LLM 的自动技能分解管道，将高级指令分割成低级提示。我们的管道生产 RoboCasa-Skill 和 LIBERO-Skill，支持在不同任务范围内保持时间一致的技能组合 WM。根据经验，将 World2Act 应用于 GR00T-N1.6 和 Cosmos Policy 等 VLA 在 RoboCasa 和 LIBERO 上取得了最先进的结果，并将现实世界的性能提高了 6.7%，增强了体现代理的泛化能力。

Title: Unlearning the Unpromptable: Prompt-free Instance Unlearning in Diffusion Models

• Authors: Kyungryeol Lee, Kyeonghyun Lee, Seongmin Hong, Byung Hyun Lee, Se Young Chun
• Subjects: cs.LG, cs.CV
• Abstract URL: https://arxiv.org/abs/2603.10445
• Pdf URL: https://arxiv.org/pdf/2603.10445
• Copy Paste: [[2603.10445]] Unlearning the Unpromptable: Prompt-free Instance Unlearning in Diffusion Models(https://arxiv.org/abs/2603.10445)
• Keywords: generation
• Abstract: Machine unlearning aims to remove specific outputs from trained models, often at the concept level, such as forgetting all occurrences of a particular celebrity or filtering content via text prompts. However, many undesired outputs, such as an individual's face or generations culturally or factually misinterpreted, cannot often be specified by text prompts. We address this underexplored setting of instance unlearning for outputs that are undesired but unpromptable, where the goal is to forget target outputs selectively while preserving the rest. To this end, we introduce an effective surrogate-based unlearning method that leverages image editing, timestep-aware weighting, and gradient surgery to guide trained diffusion models toward forgetting specific outputs. Experiments on conditional (Stable Diffusion 3) and unconditional (DDPM-CelebA) diffusion models demonstrate that our prompt-free method uniquely unlearns unpromptable outputs, such as faces and culturally inaccurate depictions, with preserved integrity, unlike prompt-based and prompt-free baselines. Our proposed method would serve as a practical hotfix for diffusion model providers to ensure privacy protection and ethical compliance.
• 摘要：机器遗忘的目的是从经过训练的模型中删除特定的输出，通常是在概念层面，例如忘记特定名人的所有出现或通过文本提示过滤内容。然而，许多不需要的输出，例如个人的面孔或代际文化或事实上的误解，通常无法通过文本提示来指定。我们解决了这种未经充分探索的实例取消学习设置，即不期望但不可提示的输出，其目标是有选择地忘记目标输出，同时保留其余输出。为此，我们引入了一种有效的基于代理的忘却方法，该方法利用图像编辑、时间步感知加权和梯度手术来指导经过训练的扩散模型忘记特定的输出。对条件（稳定扩散 3）和无条件（DDPM-CelebA）扩散模型的实验表明，我们的无提示方法独特地消除了无提示输出，例如面孔和文化上不准确的描述，并保留了完整性，这与基于提示和无提示基线不同。我们提出的方法将作为扩散模型提供商的实用修补程序，以确保隐私保护和道德合规性。

Title: SignSparK: Efficient Multilingual Sign Language Production via Sparse Keyframe Learning

• Authors: Jianhe Low, Alexandre Symeonidis-Herzig, Maksym Ivashechkin, Ozge Mercanoglu Sincan, Richard Bowden
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.10446
• Pdf URL: https://arxiv.org/pdf/2603.10446
• Copy Paste: [[2603.10446]] SignSparK: Efficient Multilingual Sign Language Production via Sparse Keyframe Learning(https://arxiv.org/abs/2603.10446)
• Keywords: generation
• Abstract: Generating natural and linguistically accurate sign language avatars remains a formidable challenge. Current Sign Language Production (SLP) frameworks face a stark trade-off: direct text-to-pose models suffer from regression-to-the-mean effects, while dictionary-retrieval methods produce robotic, disjointed transitions. To resolve this, we propose a novel training paradigm that leverages sparse keyframes to capture the true underlying kinematic distribution of human signing. By predicting dense motion from these discrete anchors, our approach mitigates regression-to-the-mean while ensuring fluid articulation. To realize this paradigm at scale, we first introduce FAST, an ultra-efficient sign segmentation model that automatically mines precise temporal boundaries. We then present SignSparK, a large-scale Conditional Flow Matching (CFM) framework that utilizes these extracted anchors to synthesize 3D signing sequences in SMPL-X and MANO spaces. This keyframe-driven formulation also uniquely unlocks Keyframe-to-Pose (KF2P) generation, making precise spatiotemporal editing of signing sequences possible. Furthermore, our adopted reconstruction-based CFM objective also enables high-fidelity synthesis in fewer than ten sampling steps; this allows SignSparK to scale across four distinct sign languages, establishing the largest multilingual SLP framework to date. Finally, by integrating 3D Gaussian Splatting for photorealistic rendering, we demonstrate through extensive evaluation that SignSparK establishes a new state-of-the-art across diverse SLP tasks and multilingual benchmarks.
• 摘要：生成自然且语言准确的手语化身仍然是一项艰巨的挑战。当前的手语生成（SLP）框架面临着一个严峻的权衡：直接的文本到姿势模型受到均值回归效应的影响，而字典检索方法则产生机器人、脱节的转换。为了解决这个问题，我们提出了一种新颖的训练范例，它利用稀疏关键帧来捕获人类手语的真实底层运动学分布。通过预测这些离散锚点的密集运动，我们的方法减轻了均值回归，同时确保了流畅的清晰度。为了大规模实现这一范例，我们首先引入 FAST，这是一种超高效的符号分割模型，可以自动挖掘精确的时间边界。然后，我们提出了 SignSparK，这是一个大规模条件流匹配 (CFM) 框架，它利用这些提取的锚点在 SMPL-X 和 MANO 空间中合成 3D 签名序列。这种关键帧驱动的公式还独特地解锁了关键帧到姿势（KF2P）的生成，使得精确的时空编辑签名序列成为可能。此外，我们采用的基于重建的 CFM 物镜还可以在不到 10 个采样步骤内实现高保真合成；这使得 SignSparK 能够跨越四种不同的手语，建立迄今为止最大的多语言 SLP 框架。最后，通过集成 3D 高斯泼溅进行真实感渲染，我们通过广泛的评估证明 SignSparK 在不同的 SLP 任务和多语言基准上建立了新的最先进技术。

Title: UHD Image Deblurring via Autoregressive Flow with Ill-conditioned Constraints

• Authors: Yucheng Xin, Dawei Zhao, Xiang Chen, Chen Wu, Pu Wang, Dianjie Lu, Guijuan Zhang, Xiuyi Jia, Zhuoran Zheng
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.10517
• Pdf URL: https://arxiv.org/pdf/2603.10517
• Copy Paste: [[2603.10517]] UHD Image Deblurring via Autoregressive Flow with Ill-conditioned Constraints(https://arxiv.org/abs/2603.10517)
• Keywords: restoration, generation, generative
• Abstract: Ultra-high-definition (UHD) image deblurring poses significant challenges for UHD restoration methods, which must balance fine-grained detail recovery and practical inference efficiency. Although prominent discriminative and generative methods have achieved remarkable results, a trade-off persists between computational cost and the ability to generate fine-grained detail for UHD image deblurring tasks. To further alleviate these issues, we propose a novel autoregressive flow method for UHD image deblurring with an ill-conditioned constraint. Our core idea is to decompose UHD restoration into a progressive, coarse-to-fine process: at each scale, the sharp estimate is formed by upsampling the previous-scale result and adding a current-scale residual, enabling stable, stage-wise refinement from low to high resolution. We further introduce Flow Matching to model residual generation as a conditional vector field and perform few-step ODE sampling with efficient Euler/Heun solvers, enriching details while keeping inference affordable. Since multi-step generation at UHD can be numerically unstable, we propose an ill-conditioning suppression scheme by imposing condition-number regularization on a feature-induced attention matrix, improving convergence and cross-scale consistency. Our method demonstrates promising performance on blurred images at 4K (3840$\times$2160) or higher resolutions.
• 摘要：超高清（UHD）图像去模糊对超高清恢复方法提出了重大挑战，必须平衡细粒度细节恢复和实际推理效率。尽管突出的判别和生成方法取得了显着的成果，但计算成本和为超高清图像去模糊任务生成细粒度细节的能力之间仍然存在权衡。为了进一步缓解这些问题，我们提出了一种新颖的自回归流方法，用于具有病态约束的超高清图像去模糊。我们的核心思想是将超高清恢复分解为渐进的、从粗到细的过程：在每个尺度上，通过对前一个尺度的结果进行上采样并添加当前尺度的残差来形成锐估计，从而实现从低分辨率到高分辨率的稳定、分阶段细化。我们进一步引入流匹配，将残差生成建模为条件向量场，并使用高效的 Euler/Heun 求解器执行几步 ODE 采样，丰富细节，同时保持推理负担得起。由于 UHD 的多步生成可能在数值上不稳定，因此我们提出了一种病态抑制方案，通过对特征引起的注意矩阵施加条件数正则化，提高收敛性和跨尺度一致性。我们的方法在 4K（3840$\times$2160）或更高分辨率的模糊图像上展示了良好的性能。

Title: Visually-Guided Controllable Medical Image Generation via Fine-Grained Semantic Disentanglement

• Authors: Xin Huang, Junjie Liang, Qingshan Hou, Peng Cao, Jinzhu Yang, Xiaoli Liu, Osmar R. Zaiane
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.10519
• Pdf URL: https://arxiv.org/pdf/2603.10519
• Copy Paste: [[2603.10519]] Visually-Guided Controllable Medical Image Generation via Fine-Grained Semantic Disentanglement(https://arxiv.org/abs/2603.10519)
• Keywords: generation
• Abstract: Medical image synthesis is crucial for alleviating data scarcity and privacy constraints. However, fine-tuning general text-to-image (T2I) models remains challenging, mainly due to the significant modality gap between complex visual details and abstract clinical text. In addition, semantic entanglement persists, where coarse-grained text embeddings blur the boundary between anatomical structures and imaging styles, thus weakening controllability during generation. To address this, we propose a Visually-Guided Text Disentanglement framework. We introduce a cross-modal latent alignment mechanism that leverages visual priors to explicitly disentangle unstructured text into independent semantic representations. Subsequently, a Hybrid Feature Fusion Module (HFFM) injects these features into a Diffusion Transformer (DiT) through separated channels, enabling fine-grained structural control. Experimental results in three datasets demonstrate that our method outperforms existing approaches in terms of generation quality and significantly improves performance on downstream classification tasks. The source code is available at this https URL.
• 摘要：医学图像合成对于缓解数据稀缺和隐私限制至关重要。然而，微调一般文本到图像（T2I）模型仍然具有挑战性，这主要是由于复杂的视觉细节和抽象的临床文本之间存在显着的模态差距。此外，语义纠缠仍然存在，粗粒度的文本嵌入模糊了解剖结构和成像风格之间的界限，从而削弱了生成过程中的可控性。为了解决这个问题，我们提出了一个视觉引导的文本解缠框架。我们引入了一种跨模式潜在对齐机制，该机制利用视觉先验将非结构化文本明确地分解为独立的语义表示。随后，混合特征融合模块（HFFM）通过分离的通道将这些特征注入扩散变压器（DiT），从而实现细粒度的结构控制。三个数据集的实验结果表明，我们的方法在生成质量方面优于现有方法，并显着提高了下游分类任务的性能。源代码可从此 https URL 获取。

Title: DSFlash: Comprehensive Panoptic Scene Graph Generation in Realtime

• Authors: Julian Lorenz, Vladyslav Kovganko, Elias Kohout, Mrunmai Phatak, Daniel Kienzle, Rainer Lienhart
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.10538
• Pdf URL: https://arxiv.org/pdf/2603.10538
• Copy Paste: [[2603.10538]] DSFlash: Comprehensive Panoptic Scene Graph Generation in Realtime(https://arxiv.org/abs/2603.10538)
• Keywords: generation
• Abstract: Scene Graph Generation (SGG) aims to extract a detailed graph structure from an image, a representation that holds significant promise as a robust intermediate step for complex downstream tasks like reasoning for embodied agents. However, practical deployment in real-world applications - especially on resource constrained edge devices - requires speed and resource efficiency, challenges that have received limited attention in existing research. To bridge this gap, we introduce DSFlash, a low-latency model for panoptic scene graph generation designed to overcome these limitations. DSFlash can process a video stream at 56 frames per second on a standard RTX 3090 GPU, without compromising performance against existing state-of-the-art methods. Crucially, unlike prior approaches that often restrict themselves to salient relationships, DSFlash computes comprehensive scene graphs, offering richer contextual information while maintaining its superior latency. Furthermore, DSFlash is light on resources, requiring less than 24 hours to train on a single, nine-year-old GTX 1080 GPU. This accessibility makes DSFlash particularly well-suited for researchers and practitioners operating with limited computational resources, empowering them to adapt and fine-tune SGG models for specialized applications.
• 摘要：场景图生成（SGG）旨在从图像中提取详细的图结构，这种表示形式有望成为复杂下游任务（例如实体代理推理）的稳健中间步骤。然而，实际应用中的实际部署（尤其是在资源受限的边缘设备上）需要速度和资源效率，而这些挑战在现有研究中受到的关注有限。为了弥补这一差距，我们引入了 DSFlash，这是一种用于全景场景图生成的低延迟模型，旨在克服这些限制。 DSFlash 可以在标准 RTX 3090 GPU 上以每秒 56 帧的速度处理视频流，而不会影响现有最先进方法的性能。至关重要的是，与通常将自身限制于显着关系的先前方法不同，DSFlash 计算全面的场景图，提供更丰富的上下文信息，同时保持其卓越的延迟。此外，DSFlash 资源匮乏，在单个已使用 9 年的 GTX 1080 GPU 上训练只需不到 24 小时。这种可访问性使 DSFlash 特别适合计算资源有限的研究人员和从业人员，使他们能够针对专门应用程序调整和微调 SGG 模型。

Title: Towards Cognitive Defect Analysis in Active Infrared Thermography with Vision-Text Cues

• Authors: Mohammed Salah, Eman Ouda, Giuseppe Dell'Avvocato, Fabrizio Sarasini, Ester D'Accardi, Jorge Dias, Davor Svetinovic, Stefano Sfarra, Yusra Abdulrahman
• Subjects: cs.CV, cs.AI, eess.SP
• Abstract URL: https://arxiv.org/abs/2603.10549
• Pdf URL: https://arxiv.org/pdf/2603.10549
• Copy Paste: [[2603.10549]] Towards Cognitive Defect Analysis in Active Infrared Thermography with Vision-Text Cues(https://arxiv.org/abs/2603.10549)
• Keywords: generative
• Abstract: Active infrared thermography (AIRT) is currently witnessing a surge of artificial intelligence (AI) methodologies being deployed for automated subsurface defect analysis of high performance carbon fiber-reinforced polymers (CFRP). Deploying AI-based AIRT methodologies for inspecting CFRPs requires the creation of time consuming and expensive datasets of CFRP inspection sequences to train neural networks. To address this challenge, this work introduces a novel language-guided framework for cognitive defect analysis in CFRPs using AIRT and vision-language models (VLMs). Unlike conventional learning-based approaches, the proposed framework does not require developing training datasets for extensive training of defect detectors, instead it relies solely on pretrained multimodal VLM encoders coupled with a lightweight adapter to enable generative zero-shot understanding and localization of subsurface defects. By leveraging pretrained multimodal encoders, the proposed system enables generative zero-shot understanding of thermographic patterns and automatic detection of subsurface defects. Given the domain gap between thermographic data and natural images used to train VLMs, an AIRT-VLM Adapter is proposed to enhance the visibility of defects while aligning the thermographic domain with the learned representations of VLMs. The proposed framework is validated using three representative VLMs; specifically, GroundingDINO, Qwen-VL-Chat, and CogVLM. Validation is performed on 25 CFRP inspection sequences with impacts introduced at different energy levels, reflecting realistic defects encountered in industrial scenarios. Experimental results demonstrate that the AIRT-VLM adapter achieves signal-to-noise ratio (SNR) gains exceeding 10 dB compared with conventional thermographic dimensionality-reduction methods, while enabling zero-shot defect detection with intersection-over-union values reaching 70%.
• 摘要：目前，主动红外热成像 (AIRT) 正在见证人工智能 (AI) 方法的激增，这些方法被用于高性能碳纤维增强聚合物 (CFRP) 的自动地下缺陷分析。部署基于人工智能的 AIRT 方法来检查 CFRP 需要创建耗时且昂贵的 CFRP 检查序列数据集来训练神经网络。为了应对这一挑战，这项工作引入了一种新颖的语言引导框架，使用 AIRT 和视觉语言模型 (VLM) 对 CFRP 进行认知缺陷分析。与传统的基于学习的方法不同，所提出的框架不需要开发训练数据集来广泛训练缺陷检测器，而是仅依赖于预训练的多模态 VLM 编码器和轻量级适配器来实现生成式零样本理解和地下缺陷的定位。通过利用预训练的多模态编码器，所提出的系统能够对热成像图案进行生成式零样本理解并自动检测地下缺陷。考虑到热成像数据和用于训练 VLM 的自然图像之间的域差距，提出了一种 AIRT-VLM 适配器来增强缺陷的可见性，同时将热成像域与学习到的 VLM 表示对齐。所提出的框架使用三个代表性的 VLM 进行了验证；具体来说，GroundingDINO、Qwen-VL-Chat 和 CogVLM。对 25 个 CFRP 检查序列进行了验证，这些序列在不同能量级别产生影响，反映了工业场景中遇到的实际缺陷。实验结果表明，与传统热成像降维方法相比，AIRT-VLM适配器实现了超过10 dB的信噪比（SNR）增益，同时实现了零样本缺陷检测，交并比值达到70%。

Title: PET-F2I: A Comprehensive Benchmark and Parameter-Efficient Fine-Tuning of LLMs for PET/CT Report Impression Generation

• Authors: Yuchen Liu, Wenbo Zhang, Liling Peng, Yichi Zhang, Yu Fu, Xin Guo, Chao Qu, Yuan Qi, Le Xue
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.10560
• Pdf URL: https://arxiv.org/pdf/2603.10560
• Copy Paste: [[2603.10560]] PET-F2I: A Comprehensive Benchmark and Parameter-Efficient Fine-Tuning of LLMs for PET/CT Report Impression Generation(https://arxiv.org/abs/2603.10560)
• Keywords: generation
• Abstract: PET/CT imaging is pivotal in oncology and nuclear medicine, yet summarizing complex findings into precise diagnostic impressions is labor-intensive. While LLMs have shown promise in medical text generation, their capability in the highly specialized domain of PET/CT remains underexplored. We introduce PET-F2I-41K (PET Findings-to-Impression Benchmark), a large-scale benchmark for PET/CT impression generation using LLMs, constructed from over 41k real-world reports. Using PET-F2I-41K, we conduct a comprehensive evaluation of 27 models across proprietary frontier LLMs, open-source generalist models, and medical-domain LLMs, and we develop a domain-adapted 7B model (PET-F2I-7B) fine-tuned from Qwen2.5-7B-Instruct via LoRA. Beyond standard NLG metrics (e.g., BLEU-4, ROUGE-L, BERTScore), we propose three clinically grounded metrics - Entity Coverage Rate (ECR), Uncovered Entity Rate (UER), and Factual Consistency Rate (FCR) - to assess diagnostic completeness and factual reliability. Experiments reveal that neither frontier nor medical-domain LLMs perform adequately in zero-shot settings. In contrast, PET-F2I-7B achieves substantial gains (e.g., 0.708 BLEU-4) and a 3.0x improvement in entity coverage over the strongest baseline, while offering advantages in cost, latency, and privacy. Beyond this modeling contribution, PET-F2I-41K establishes a standardized evaluation framework to accelerate the development of reliable and clinically deployable reporting systems for PET/CT.
• 摘要：PET/CT 成像在肿瘤学和核医学中至关重要，但将复杂的发现总结为精确的诊断印象是一项劳动密集型工作。虽然法学硕士在医学文本生成方面表现出了希望，但他们在高度专业化的 PET/CT 领域的能力仍未得到充分开发。我们推出 PET-F2I-41K（PET 发现到印象基准），这是使用法学硕士的 PET/CT 印象生成的大型基准，由超过 41,000 份真实报告构建而成。使用 PET-F2I-41K，我们对跨专有前沿法学硕士、开源通才模型和医学领域法学硕士的 27 个模型进行了全面评估，并开发了一个通过 LoRA 从 Qwen2.5-7B-Instruct 进行微调的领域适应 7B 模型 (PET-F2I-7B)。除了标准 NLG 指标（例如 BLEU-4、ROUGE-L、BERTScore）之外，我们提出了三个基于临床的指标 - 实体覆盖率 (ECR)、未覆盖实体率 (UER) 和事实一致性率 (FCR) - 来评估诊断完整性和事实可靠性。实验表明，前沿法学硕士和医学领域法学硕士在零样本设置中都表现不佳。相比之下，PET-F2I-7B 实现了显着的增益（例如 0.708 BLEU-4），实体覆盖范围比最强基线提高了 3.0 倍，同时在成本、延迟和隐私方面具有优势。除了这一建模贡献之外，PET-F2I-41K 还建立了标准化评估框架，以加速开发可靠且可临床部署的 PET/CT 报告系统。

Title: Riemannian Geometry-Preserving Variational Autoencoder for MI-BCI Data Augmentation

• Authors: Viktorija Poļaka, Ivo Pascal de Jong, Andreea Ioana Sburlea
• Subjects: cs.LG
• Abstract URL: https://arxiv.org/abs/2603.10563
• Pdf URL: https://arxiv.org/pdf/2603.10563
• Copy Paste: [[2603.10563]] Riemannian Geometry-Preserving Variational Autoencoder for MI-BCI Data Augmentation(https://arxiv.org/abs/2603.10563)
• Keywords: generative
• Abstract: This paper addresses the challenge of generating synthetic electroencephalogram (EEG) covariance matrices for motor imagery brain-computer interface (MI-BCI) applications. Objective: We aim to develop a generative model capable of producing high-fidelity synthetic covariance matrices while preserving their symmetric positive-definite nature. Approach: We propose a Riemannian geometry-preserving variational autoencoder (RGP-VAE) integrating geometric mappings with a composite loss function combining Riemannian distance, tangent space reconstruction accuracy and generative diversity. Results: The model generates valid, representative EEG covariance matrices, while learning a subject-invariant latent space. Synthetic data proves practically useful for MI-BCI, with its impact depending on the paired classifier. Contribution: This work introduces and validates the RGP-VAE as a geometry-preserving generative model for EEG covariance matrices, highlighting its potential for signal privacy, scalability and data augmentation.
• 摘要：本文解决了为运动想象脑机接口 (MI-BCI) 应用生成合成脑电图 (EEG) 协方差矩阵的挑战。目标：我们的目标是开发一种生成模型，能够生成高保真合成协方差矩阵，同时保留其对称正定性质。方法：我们提出了一种黎曼几何保持变分自动编码器（RGP-VAE），它将几何映射与复合损失函数相结合，结合了黎曼距离、切线空间重建精度和生成多样性。结果：该模型生成有效的、有代表性的脑电图协方差矩阵，同时学习主体不变的潜在空间。事实证明，合成数据对于 MI-BCI 非常有用，其影响取决于配对的分类器。贡献：这项工作介绍并验证了 RGP-VAE 作为 EEG 协方差矩阵的几何保留生成模型，突出了其在信号隐私、可扩展性和数据增强方面的潜力。

Title: R4-CGQA: Retrieval-based Vision Language Models for Computer Graphics Image Quality Assessment

• Authors: Zhuangzi Li, Jian Jin, Shilv Cai, Weisi Lin
• Subjects: cs.CV, cs.DB
• Abstract URL: https://arxiv.org/abs/2603.10578
• Pdf URL: https://arxiv.org/pdf/2603.10578
• Copy Paste: [[2603.10578]] R4-CGQA: Retrieval-based Vision Language Models for Computer Graphics Image Quality Assessment(https://arxiv.org/abs/2603.10578)
• Keywords: generation, quality assessment
• Abstract: Immersive Computer Graphics (CGs) rendering has become ubiquitous in modern daily life. However, comprehensively evaluating CG quality remains challenging for two reasons: First, existing CG datasets lack systematic descriptions of rendering quality; and second existing CG quality assessment methods cannot provide reasonable text-based explanations. To address these issues, we first identify six key perceptual dimensions of CG quality from the user perspective and construct a dataset of 3500 CG images with corresponding quality descriptions. Each description covers CG style, content, and perceived quality along the selected dimensions. Furthermore, we use a subset of the dataset to build several question-answer benchmarks based on the descriptions in order to evaluate the responses of existing Vision Language Models (VLMs). We find that current VLMs are not sufficiently accurate in judging fine-grained CG quality, but that descriptions of visually similar images can significantly improve a VLM's understanding of a given CG image. Motivated by this observation, we adopt retrieval-augmented generation and propose a two-stream retrieval framework that effectively enhances the CG quality assessment capabilities of VLMs. Experiments on several representative VLMs demonstrate that our method substantially improves their performance on CG quality assessment.
• 摘要：沉浸式计算机图形 (CG) 渲染在现代日常生活中已经无处不在。然而，全面评估 CG 质量仍然具有挑战性，原因有两个：首先，现有的 CG 数据集缺乏对渲染质量的系统描述；其次现有的CG质量评估方法无法提供合理的基于文本的解释。为了解决这些问题，我们首先从用户角度确定了 CG 质量的六个关键感知维度，并构建了包含 3500 张 CG 图像以及相应质量描述的数据集。每个描述都涵盖了 CG 风格、内容和所选维度的感知质量。此外，我们使用数据集的子集根据描述构建几个问答基准，以评估现有视觉语言模型（VLM）的响应。我们发现当前的 VLM 在判断细粒度 CG 质量方面不够准确，但视觉上相似图像的描述可以显着提高 VLM 对给定 CG 图像的理解。受这一观察的启发，我们采用检索增强生成，并提出了一个双流检索框架，有效增强了 VLM 的 CG 质量评估能力。对几个代表性 VLM 的实验表明，我们的方法大大提高了它们在 CG 质量评估方面的性能。

Title: Attribution as Retrieval: Model-Agnostic AI-Generated Image Attribution

• Authors: Hongsong Wang, Renxi Cheng, Chaolei Han, Jie Gui
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.10583
• Pdf URL: https://arxiv.org/pdf/2603.10583
• Copy Paste: [[2603.10583]] Attribution as Retrieval: Model-Agnostic AI-Generated Image Attribution(https://arxiv.org/abs/2603.10583)
• Keywords: generation, generative
• Abstract: With the rapid advancement of AIGC technologies, image forensics will encounter unprecedented challenges. Traditional methods are incapable of dealing with increasingly realistic images generated by rapidly evolving image generation techniques. To facilitate the identification of AI-generated images and the attribution of their source models, generative image watermarking and AI-generated image attribution have emerged as key research focuses in recent years. However, existing methods are model-dependent, requiring access to the generative models and lacking generality and scalability to new and unseen generators. To address these limitations, this work presents a new paradigm for AI-generated image attribution by formulating it as an instance retrieval problem instead of a conventional image classification problem. We propose an efficient model-agnostic framework, called Low-bIt-plane-based Deepfake Attribution (LIDA). The input to LIDA is produced by Low-Bit Fingerprint Generation module, while the training involves Unsupervised Pre-Training followed by subsequent Few-Shot Attribution Adaptation. Comprehensive experiments demonstrate that LIDA achieves state-of-the-art performance for both Deepfake detection and image attribution under zero- and few-shot settings. The code is at this https URL
• 摘要：随着AIGC技术的快速进步，图像取证将遇到前所未有的挑战。传统方法无法处理由快速发展的图像生成技术生成的日益逼真的图像。为了促进人工智能生成图像的识别及其源模型的归属，生成图像水印和人工智能生成图像归属已成为近年来的重点研究热点。然而，现有的方法是模型相关的，需要访问生成模型，并且缺乏对新的和看不见的生成器的通用性和可扩展性。为了解决这些限制，这项工作提出了一种新的人工智能生成图像归因范例，将其表述为实例检索问题而不是传统的图像分类问题。我们提出了一种高效的模型无关框架，称为基于低位平面的 Deepfake 归因（LIDA）。 LIDA 的输入由低位指纹生成模块生成，而训练涉及无监督预训练，然后是后续的少样本归因适应。综合实验表明，LIDA 在零镜头和少镜头设置下的 Deepfake 检测和图像归因方面实现了最先进的性能。代码位于此 https URL

Title: Gradient Flow Drifting: Generative Modeling via Wasserstein Gradient Flows of KDE-Approximated Divergences

• Authors: Jiarui Cao, Zixuan Wei, Yuxin Liu
• Subjects: cs.LG, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.10592
• Pdf URL: https://arxiv.org/pdf/2603.10592
• Copy Paste: [[2603.10592]] Gradient Flow Drifting: Generative Modeling via Wasserstein Gradient Flows of KDE-Approximated Divergences(https://arxiv.org/abs/2603.10592)
• Keywords: generative
• Abstract: We reveal a precise mathematical framework about a new family of generative models which we call Gradient Flow Drifting. With this framework, we prove an equivalence between the recently proposed Drifting Model and the Wasserstein gradient flow of the forward KL divergence under kernel density estimation (KDE) approximation. Specifically, we prove that the drifting field of drifting model (arXiv:2602.04770) equals, up to a bandwidth-squared scaling factor, the difference of KDE log-density gradients $\nabla \log p_{\mathrm{kde}} - \nabla \log q_{\mathrm{kde}}$, which is exactly the particle velocity field of the Wasserstein-2 gradient flow of $KL(q\|p)$ with KDE-approximated densities. Besides that, this broad family of generative models can also include MMD-based generators, which arises as special cases of Wasserstein gradient flows of different divergences under KDE approximation. We provide a concise identifiability proof, and a theoretically grounded mixed-divergence strategy. We combine reverse KL and $\chi^2$ divergence gradient flows to simultaneously avoid mode collapse and mode blurring, and extend this method onto Riemannian manifold which loosens the constraints on the kernel function, and makes this method more suitable for the semantic space. Preliminary experiments on synthetic benchmarks validate the framework.
• 摘要：我们揭示了一个关于一系列新的生成模型的精确数学框架，我们称之为梯度流漂移。通过这个框架，我们证明了最近提出的漂移模型和核密度估计（KDE）近似下前向 KL 散度的 Wasserstein 梯度流之间的等价性。具体来说，我们证明了漂移模型 (arXiv:2602.04770) 的漂移场在带宽平方缩放因子范围内等于 KDE 对数密度梯度 $\nabla \log p_{\mathrm{kde}} - \nabla \log q_{\mathrm{kde}}$ 之差，这正是 $KL(q\|p)$ 的 Wasserstein-2 梯度流的粒子速度场具有 KDE 近似密度。除此之外，这一广泛的生成模型家族还可以包括基于 MMD 的生成器，它是 KDE 近似下不同散度的 Wasserstein 梯度流的特例。我们提供了一个简洁的可识别性证明，以及一个有理论依据的混合发散策略。我们结合反向KL和$\chi^2$散度梯度流来同时避免模式崩溃和模式模糊，并将该方法扩展到黎曼流形，放松了对核函数的约束，并使该方法更适合语义空间。综合基准​​的初步实验验证了该框架。

Title: Layer Consistency Matters: Elegant Latent Transition Discrepancy for Generalizable Synthetic Image Detection

• Authors: Yawen Yang, Feng Li, Shuqi Kong, Yunfeng Diao, Xinjian Gao, Zenglin Shi, Meng Wang
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.10598
• Pdf URL: https://arxiv.org/pdf/2603.10598
• Copy Paste: [[2603.10598]] Layer Consistency Matters: Elegant Latent Transition Discrepancy for Generalizable Synthetic Image Detection(https://arxiv.org/abs/2603.10598)
• Keywords: generative
• Abstract: Recent rapid advancement of generative models has significantly improved the fidelity and accessibility of AI-generated synthetic images. While enabling various innovative applications, the unprecedented realism of these synthetics makes them increasingly indistinguishable from authentic photographs, posing serious security risks, such as media credibility and content manipulation. Although extensive efforts have been dedicated to detecting synthetic images, most existing approaches suffer from poor generalization to unseen data due to their reliance on model-specific artifacts or low-level statistical cues. In this work, we identify a previously unexplored distinction that real images maintain consistent semantic attention and structural coherence in their latent representations, exhibiting more stable feature transitions across network layers, whereas synthetic ones present discernible distinct patterns. Therefore, we propose a novel approach termed latent transition discrepancy (LTD), which captures the inter-layer consistency differences of real and synthetic images. LTD adaptively identifies the most discriminative layers and assesses the transition discrepancies across layers. Benefiting from the proposed inter-layer discriminative modeling, our approach exceeds the base model by 14.35\% in mean Acc across three datasets containing diverse GANs and DMs. Extensive experiments demonstrate that LTD outperforms recent state-of-the-art methods, achieving superior detection accuracy, generalizability, and robustness. The code is available at this https URL
• 摘要：最近生成模型的快速发展显着提高了人工智能生成的合成图像的保真度和可访问性。在实现各种创新应用的同时，这些合成物前所未有的真实感使它们与真实照片越来越难以区分，从而带来严重的安全风险，例如媒体可信度和内容操纵。尽管人们在检测合成图像方面付出了巨大的努力，但大多数现有方法由于依赖于特定于模型的伪影或低水平的统计线索，因此对未见数据的泛化能力较差。在这项工作中，我们发现了一个以前未探索过的区别，即真实图像在其潜在表示中保持一致的语义注意力和结构连贯性，在网络层上表现出更稳定的特征转换，而合成图像则呈现出可辨别的不同模式。因此，我们提出了一种称为潜在转换差异（LTD）的新方法，它捕获真实图像和合成图像的层间一致性差异。 LTD 自适应地识别最具辨别力的层并评估跨层的转换差异。受益于所提出的层间判别模型，我们的方法在包含不同 GAN 和 DM 的三个数据集中的平均 Acc 比基本模型高出 14.35%。大量实验表明，LTD 的性能优于最新的最先进方法，实现了卓越的检测精度、通用性和鲁棒性。该代码可在此 https URL 获取

Title: HyPER-GAN: Hybrid Patch-Based Image-to-Image Translation for Real-Time Photorealism Enhancement

• Authors: Stefanos Pasios, Nikos Nikolaidis
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.10604
• Pdf URL: https://arxiv.org/pdf/2603.10604
• Copy Paste: [[2603.10604]] HyPER-GAN: Hybrid Patch-Based Image-to-Image Translation for Real-Time Photorealism Enhancement(https://arxiv.org/abs/2603.10604)
• Keywords: generative
• Abstract: Generative models are widely employed to enhance the photorealism of synthetic data for training computer vision algorithms. However, they often introduce visual artifacts that degrade the accuracy of these algorithms and require high computational resources, limiting their applicability in real-time training or evaluation scenarios. In this paper, we propose Hybrid Patch Enhanced Realism Generative Adversarial Network (HyPER-GAN), a lightweight image-to-image translation method based on a U-Net-style generator designed for real-time inference. The model is trained using paired synthetic and photorealism-enhanced images, complemented by a hybrid training strategy that incorporates matched patches from real-world data to improve visual realism and semantic consistency. Experimental results demonstrate that HyPER-GAN outperforms state-of-the-art paired image-to-image translation methods in terms of inference latency, visual realism, and semantic robustness. Moreover, it is illustrated that the proposed hybrid training strategy indeed improves visual quality and semantic consistency compared to training the model solely with paired synthetic and photorealism-enhanced images. Code and pretrained models are publicly available for download at: this https URL
• 摘要：生成模型被广泛用于增强训练计算机视觉算法的合成数据的真实感。然而，它们经常引入视觉伪影，从而降低这些算法的准确性并需要大量计算资源，从而限制了它们在实时训练或评估场景中的适用性。在本文中，我们提出了混合补丁增强现实生成对抗网络（HyPER-GAN），这是一种基于 U-Net 式生成器的轻量级图像到图像转换方法，专为实时推理而设计。该模型使用配对的合成图像和真实感增强图像进行训练，并辅以混合训练策略，该策略结合了来自真实世界数据的匹配补丁，以提高视觉真实感和语义一致性。实验结果表明，HyPER-GAN 在推理延迟、视觉真实感和语义鲁棒性方面优于最先进的配对图像到图像翻译方法。此外，结果表明，与仅使用配对的合成图像和真实感增强图像训练模型相比，所提出的混合训练策略确实提高了视觉质量和语义一致性。代码和预训练模型可公开下载：此 https URL

Title: UniCom: Unified Multimodal Modeling via Compressed Continuous Semantic Representations

• Authors: Yaqi Zhao, Wang Lin, Zijian Zhang, Miles Yang, Jingyuan Chen, Wentao Zhang, Zhao Zhong, Liefeng Bo
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.10702
• Pdf URL: https://arxiv.org/pdf/2603.10702
• Copy Paste: [[2603.10702]] UniCom: Unified Multimodal Modeling via Compressed Continuous Semantic Representations(https://arxiv.org/abs/2603.10702)
• Keywords: generation, generative
• Abstract: Current unified multimodal models typically rely on discrete visual tokenizers to bridge the modality gap. However, discretization inevitably discards fine-grained semantic information, leading to suboptimal performance in visual understanding tasks. Conversely, directly modeling continuous semantic representations (e.g., CLIP, SigLIP) poses significant challenges in high-dimensional generative modeling, resulting in slow convergence and training instability. To resolve this dilemma, we introduce UniCom, a unified framework that harmonizes multimodal understanding and generation via compressed continuous representation. We empirically demonstrate that reducing channel dimension is significantly more effective than spatial downsampling for both reconstruction and generation. Accordingly, we design an attention-based semantic compressor to distill dense features into a compact unified representation. Furthermore, we validate that the transfusion architecture surpasses query-based designs in convergence and consistency. Experiments demonstrate that UniCom achieves state-of-the-art generation performance among unified models. Notably, by preserving rich semantic priors, it delivers exceptional controllability in image editing and maintains image consistency even without relying on VAE.
• 摘要：当前的统一多模态模型通常依赖于离散视觉标记器来弥合模态差距。然而，离散化不可避免地会丢弃细粒度的语义信息，导致视觉理解任务中的性能不佳。相反，直接建模连续语义表示（例如 CLIP、SigLIP）对高维生成建模提出了重大挑战，导致收敛缓慢和训练不稳定。为了解决这个困境，我们引入了 UniCom，这是一个统一的框架，通过压缩连续表示来协调多模态理解和生成。我们凭经验证明，对于重建和生成来说，减少通道维度比空间下采样更有效。因此，我们设计了一种基于注意力的语义压缩器，将密集特征提炼成紧凑的统一表示。此外，我们验证了输血架构在收敛性和一致性方面优于基于查询的设计。实验表明，联通在统一模型中实现了最先进的发电性能。值得注意的是，通过保留丰富的语义先验，即使不依赖 VAE，它也能在图像编辑中提供出色的可控性并保持图像的一致性。

Title: Riemannian MeanFlow for One-Step Generation on Manifolds

• Authors: Zichen Zhong, Haoliang Sun, Yukun Zhao, Yongshun Gong, Yilong Yin
• Subjects: cs.LG
• Abstract URL: https://arxiv.org/abs/2603.10718
• Pdf URL: https://arxiv.org/pdf/2603.10718
• Copy Paste: [[2603.10718]] Riemannian MeanFlow for One-Step Generation on Manifolds(https://arxiv.org/abs/2603.10718)
• Keywords: generation, generative
• Abstract: Flow Matching enables simulation-free training of generative models on Riemannian manifolds, yet sampling typically still relies on numerically integrating a probability-flow ODE. We propose Riemannian MeanFlow (RMF), extending MeanFlow to manifold-valued generation where velocities lie in location-dependent tangent spaces. RMF defines an average-velocity field via parallel transport and derives a Riemannian MeanFlow identity that links average and instantaneous velocities for intrinsic supervision. We make this identity practical in a log-map tangent representation, avoiding trajectory simulation and heavy geometric computations. For stable optimization, we decompose the RMF objective into two terms and apply conflict-aware multi-task learning to mitigate gradient interference. RMF also supports conditional generation via classifier-free guidance. Experiments on spheres, tori, and SO(3) demonstrate competitive one-step sampling with improved quality-efficiency trade-offs and substantially reduced sampling cost.
• 摘要：流匹配可以在黎曼流形上进行生成模型的无模拟训练，但采样通常仍然依赖于概率流 ODE 的数值积分。我们提出黎曼平均流（RMF），将平均流扩展到流形值生成，其中速度位于位置相关的切空间中。 RMF 通过并行传输定义平均速度场，并导出黎曼平均流恒等式，该恒等式将平均速度和瞬时速度联系起来以进行内在监督。我们使这种恒等式在对数图切线表示中变得实用，避免了轨迹模拟和繁重的几何计算。为了稳定优化，我们将 RMF 目标分解为两项，并应用冲突感知多任务学习来减轻梯度干扰。 RMF 还支持通过无分类器指导进行条件生成。对球体、环面和 SO(3) 的实验证明了竞争性一步采样，可以改善质量效率权衡并大幅降低采样成本。

Title: Just-in-Time: Training-Free Spatial Acceleration for Diffusion Transformers

• Authors: Wenhao Sun, Ji Li, Zhaoqiang Liu
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.10744
• Pdf URL: https://arxiv.org/pdf/2603.10744
• Copy Paste: [[2603.10744]] Just-in-Time: Training-Free Spatial Acceleration for Diffusion Transformers(https://arxiv.org/abs/2603.10744)
• Keywords: generation, generative
• Abstract: Diffusion Transformers have established a new state-of-the-art in image synthesis, but the high computational cost of iterative sampling severely hampers their practical deployment. While existing acceleration methods often focus on the temporal domain, they overlook the substantial spatial redundancy inherent in the generative process, where global structures emerge long before fine-grained details are formed. The uniform computational treatment of all spatial regions represents a critical inefficiency. In this paper, we introduce Just-in-Time (JiT), a novel training-free framework that addresses this challenge by acceleration in the spatial domain. JiT formulates a spatially approximated generative ordinary differential equation (ODE) that drives the full latent state evolution based on computations from a dynamically selected, sparse subset of anchor tokens. To ensure seamless transitions as new tokens are incorporated to expand the dimensions of the latent state, we propose a deterministic micro-flow, a simple and effective finite-time ODE that maintains both structural coherence and statistical correctness. Extensive experiments on the state-of-the-art FLUX.1-dev model demonstrate that JiT achieves up to a 7x speedup with nearly lossless performance, significantly outperforming existing acceleration methods and establishing a new and superior trade-off between inference speed and generation fidelity.
• 摘要：扩散变压器在图像合成方面建立了新的最先进技术，但迭代采样的高计算成本严重阻碍了其实际部署。虽然现有的加速方法通常关注时域，但它们忽略了生成过程中固有的大量空间冗余，其中全局结构早在细粒度细节形成之前就出现了。所有空间区域的统一计算处理代表了严重的低效率。在本文中，我们介绍了 Just-in-Time (JiT)，这是一种新颖的免训练框架，它通过空间域加速来解决这一挑战。 JiT 制定了一个空间近似的生成常微分方程 (ODE)，该方程基于动态选择的稀疏锚标记子集的计算来驱动完整的潜在状态演化。为了确保在合并新令牌以扩展潜在状态维度时的无缝转换，我们提出了一种确定性微流，这是一种简单有效的有限时间 ODE，可以保持结构一致性和统计正确性。对最先进的 FLUX.1-dev 模型进行的大量实验表明，JiT 在几乎无损的性能下实现了高达 7 倍的加速，显着优于现有的加速方法，并在推理速度和生成保真度之间建立了新的、卓越的权衡。

Title: CodePercept: Code-Grounded Visual STEM Perception for MLLMs

• Authors: Tongkun Guan, Zhibo Yang, Jianqiang Wan, Mingkun Yang, Zhengtao Guo, Zijian Hu, Ruilin Luo, Ruize Chen, Songtao Jiang, Peng Wang, Wei Shen, Junyang Lin, Xiaokang Yang
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.10757
• Pdf URL: https://arxiv.org/pdf/2603.10757
• Copy Paste: [[2603.10757]] CodePercept: Code-Grounded Visual STEM Perception for MLLMs(https://arxiv.org/abs/2603.10757)
• Keywords: generation
• Abstract: When MLLMs fail at Science, Technology, Engineering, and Mathematics (STEM) visual reasoning, a fundamental question arises: is it due to perceptual deficiencies or reasoning limitations? Through systematic scaling analysis that independently scales perception and reasoning components, we uncover a critical insight: scaling perception consistently outperforms scaling reasoning. This reveals perception as the true lever limiting current STEM visual reasoning. Motivated by this insight, our work focuses on systematically enhancing the perception capabilities of MLLMs by establishing code as a powerful perceptual medium--executable code provides precise semantics that naturally align with the structured nature of STEM visuals. Specifically, we construct ICC-1M, a large-scale dataset comprising 1M Image-Caption-Code triplets that materializes this code-as-perception paradigm through two complementary approaches: (1) Code-Grounded Caption Generation treats executable code as ground truth for image captions, eliminating the hallucinations inherent in existing knowledge distillation methods; (2) STEM Image-to-Code Translation prompts models to generate reconstruction code, mitigating the ambiguity of natural language for perception enhancement. To validate this paradigm, we further introduce STEM2Code-Eval, a novel benchmark that directly evaluates visual perception in STEM domains. Unlike existing work relying on problem-solving accuracy as a proxy that only measures problem-relevant understanding, our benchmark requires comprehensive visual comprehension through executable code generation for image reconstruction, providing deterministic and verifiable assessment. Code is available at this https URL.
• 摘要：当 MLLM 在科学、技术、工程和数学 (STEM) 视觉推理方面失败时，就会出现一个基本问题：这是由于感知缺陷还是推理限制造成的？通过独立缩放感知和推理组件的系统缩放分析，我们发现了一个重要的见解：缩放感知始终优于缩放推理。这揭示了感知是限制当前 STEM 视觉推理的真正杠杆。受这种洞察力的推动，我们的工作重点是通过将代码建立为强大的感知媒介来系统地增强 MLLM 的感知能力——可执行代码提供精确的语义，自然地与 STEM 视觉效果的结构化性质保持一致。具体来说，我们构建了 ICC-1M，这是一个包含 1M 个图像-标题-代码三元组的大型数据集，通过两种互补的方法实现了这种代码即感知范式：（1）基于代码的标题生成将可执行代码视为图像标题的基本事实，消除了现有知识蒸馏方法中固有的幻觉； (2) STEM图像到代码翻译提示模型生成重建代码，减轻自然语言的歧义以增强感知。为了验证这一范例，我们进一步引入了 STEM2Code-Eval，这是一种直接评估 STEM 领域视觉感知的新颖基准。与依赖问题解决准确性作为仅衡量与问题相关的理解的代理的现有工作不同，我们的基准测试需要通过用于图像重建的可执行代码生成来进行全面的视觉理解，从而提供确定性和可验证的评估。代码可从此 https URL 获取。

Title: The Quadratic Geometry of Flow Matching: Semantic Granularity Alignment for Text-to-Image Synthesis

• Authors: Zhinan Xiong, Shunqi Yuan
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.10785
• Pdf URL: https://arxiv.org/pdf/2603.10785
• Copy Paste: [[2603.10785]] The Quadratic Geometry of Flow Matching: Semantic Granularity Alignment for Text-to-Image Synthesis(https://arxiv.org/abs/2603.10785)
• Keywords: generative
• Abstract: In this work, we analyze the optimization dynamics of generative fine-tuning. We observe that under the Flow Matching framework, the standard MSE objective can be formulated as a Quadratic Form governed by a dynamically evolving Neural Tangent Kernel (NTK). This geometric perspective reveals a latent Data Interaction Matrix, where diagonal terms represent independent sample learning and off-diagonal terms encode residual correlation between heterogeneous features. Although standard training implicitly optimizes these cross-term interferences, it does so without explicit control; moreover, the prevailing data-homogeneity assumption may constrain the model's effective capacity. Motivated by this insight, we propose Semantic Granularity Alignment (SGA), using Text-to-Image synthesis as a testbed. SGA engineers targeted interventions in the vector residual field to mitigate gradient conflicts. Evaluations across DiT and U-Net architectures confirm that SGA advances the efficiency-quality trade-off by accelerating convergence and improving structural integrity.
• 摘要：在这项工作中，我们分析了生成微调的优化动态。我们观察到，在流匹配框架下，标准 MSE 目标可以表示为由动态演化的神经正切核 (NTK) 控制的二次形式。这种几何视角揭示了潜在的数据交互矩阵，其中对角项代表独立样本学习，非对角项编码异构特征之间的残差相关性。尽管标准训练隐式地优化了这些交叉项干扰，但它是在没有显式控制的情况下实现的；此外，普遍的数据同质性假设可能会限制模型的有效能力。受此启发，我们提出语义粒度对齐（SGA），使用文本到图像合成作为测试平台。 SGA 工程师有针对性地干预矢量残差场，以减轻梯度冲突。对 DiT 和 U-Net 架构的评估证实，SGA 通过加速收敛和提高结构完整性来促进效率与质量的权衡。

Title: HanMoVLM: Large Vision-Language Models for Professional Artistic Painting Evaluation

• Authors: Hongji Yang, Yucheng Zhou, Wencheng Han, Songlian Li, Xiaotong Zhao, Jianbing Shen
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.10814
• Pdf URL: https://arxiv.org/pdf/2603.10814
• Copy Paste: [[2603.10814]] HanMoVLM: Large Vision-Language Models for Professional Artistic Painting Evaluation(https://arxiv.org/abs/2603.10814)
• Keywords: generation, generative
• Abstract: While Large Vision-Language Models (VLMs) demonstrate impressive general visual capabilities, they remain artistically blind and unable to offer professional evaluation of artworks within specific artistic domains like human experts. To bridge this gap, we transform VLMs into experts capable of professional-grade painting evaluation in the Chinese Artistic Domain, which is more abstract and demands extensive artistic training for evaluation. We introduce HanMo-Bench, a new dataset that features authentic auction-grade masterpieces and AI-generated works, grounded in real-world market valuations. To realize the rigorous judgment, we propose the HanMoVLM and construct a Chain-of-Thought (CoT) validated by experts. This CoT guides the model to perform expert-level reasoning: from content identification and Region of Interest (RoI) localization to professional evaluation, guided by both theme-specific evaluation and typical three-tier evaluation in Chinese paintings. Furthermore, we design a reward function to refine the reasoning process of the HanMoVLM to improve the accuracy. We demonstrate that HanMoVLM can serve as a critical backbone for Test-time Scaling in image generation. By acting as a high-quality verifier, HanMoVLM enables generative models to select the most artistically superior outputs from multiple candidates. Experimental results and human studies confirm that the proposed HanMoVLM effectively bridges the gap, achieving a high consistency with professional experts and significantly improving the quality of Chinese Painting generation.
• 摘要：虽然大视觉语言模型（VLM）表现出令人印象深刻的一般视觉能力，但它们在艺术上仍然是盲目的，无法像人类专家一样对特定艺术领域内的艺术品提供专业评估。为了弥补这一差距，我们将VLM转变为能够进行中国艺术领域专业级绘画评估的专家，该评估更加抽象，需要经过广泛的艺术训练才能进行评估。我们推出 HanMo-Bench，这是一个新的数据集，包含真实的拍卖级杰作和人工智能生成的作品，以现实世界的市场估值为基础。为了实现严格的判断，我们提出了HanMoVLM并构建了经过专家验证的思想链（CoT）。该CoT指导模型进行专家级推理：从内容识别和兴趣区域（RoI）定位到专业评估，以主题特定评估和中国画中典型的三层评估为指导。此外，我们设计了一个奖励函数来细化 HanMoVLM 的推理过程，以提高准确性。我们证明 HanMoVLM 可以作为图像生成中测试时间缩放的关键支柱。通过充当高质量验证者，HanMoVLM 使生成模型能够从多个候选者中选择最具艺术优势的输出。实验结果和人体研究证实，所提出的HanMoVLM有效地弥补了这一差距，实现了与专业专家的高度一致性，显着提高了中国画生成的质量。

Title: Beyond Sequential Distance: Inter-Modal Distance Invariant Position Encoding

• Authors: Lin Chen, Bolin Ni, Qi Yang, Zili Wang, Kun Ding, Ying Wang, Houwen Peng, Shiming Xiang
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.10863
• Pdf URL: https://arxiv.org/pdf/2603.10863
• Copy Paste: [[2603.10863]] Beyond Sequential Distance: Inter-Modal Distance Invariant Position Encoding(https://arxiv.org/abs/2603.10863)
• Keywords: generation
• Abstract: Despite the remarkable capabilities of Multimodal Large Language Models (MLLMs), they still suffer from visual fading in long-context scenarios. Specifically, the attention to visual tokens diminishes as the text sequence lengthens, leading to text generation detached from visual constraints. We attribute this degradation to the inherent inductive bias of Multimodal RoPE, which penalizes inter-modal attention as the distance between visual and text tokens increases. To address this, we propose inter-modal Distance Invariant Position Encoding (DIPE), a simple but effective mechanism that disentangles position encoding based on modality interactions. DIPE retains the natural relative positioning for intra-modal interactions to preserve local structure, while enforcing an anchored perceptual proximity for inter-modal interactions. This strategy effectively mitigates the inter-modal distance-based penalty, ensuring that visual signals remain perceptually consistent regardless of the context length. Experimental results demonstrate that by integrating DIPE with Multimodal RoPE, the model maintains stable visual grounding in long-context scenarios, significantly alleviating visual fading while preserving performance on standard short-context benchmarks. Code is available at this https URL.
• 摘要：尽管多模态大语言模型 (MLLM) 具有卓越的功能，但它们在长上下文场景中仍然会出现视觉褪色的问题。具体来说，随着文本序列的延长，对视觉标记的关注会减少，导致文本生成脱离视觉约束。我们将这种退化归因于多模态 RoPE 固有的归纳偏差，随着视觉和文本标记之间距离的增加，它会惩罚模间注意力。为了解决这个问题，我们提出了模间距离不变位置编码（DIPE），这是一种简单但有效的机制，可以解开基于模态交互的位置编码。 DIPE 保留模态内交互的自然相对定位以保留局部结构，同时为模态间交互强制执行锚定的感知接近度。该策略有效地减轻了基于模间距离的惩罚，确保无论上下文长度如何，视觉信号都保持感知一致。实验结果表明，通过将 DIPE 与多模态 RoPE 集成，该模型在长上下文场景中保持稳定的视觉基础，显着减轻视觉褪色，同时保持标准短上下文基准的性能。代码可从此 https URL 获取。

Title: SNPgen: Phenotype-Supervised Genotype Representation and Synthetic Data Generation via Latent Diffusion

• Authors: Andrea Lampis, Michela Carlotta Massi, Nicola Pirastu, Francesca Ieva, Matteo Matteucci, Emanuele Di Angelantonio
• Subjects: cs.LG, q-bio.GN
• Abstract URL: https://arxiv.org/abs/2603.10873
• Pdf URL: https://arxiv.org/pdf/2603.10873
• Copy Paste: [[2603.10873]] SNPgen: Phenotype-Supervised Genotype Representation and Synthetic Data Generation via Latent Diffusion(https://arxiv.org/abs/2603.10873)
• Keywords: generation
• Abstract: Polygenic risk scores and other genomic analyses require large individual-level genotype datasets, yet strict data access restrictions impede sharing. Synthetic genotype generation offers a privacy-preserving alternative, but most existing methods operate unconditionally, producing samples without phenotype alignment, or rely on unsupervised compression, creating a gap between statistical fidelity and downstream task utility. We present SNPgen, a two-stage conditional latent diffusion framework for generating phenotype-supervised synthetic genotypes. SNPgen combines GWAS-guided variant selection (1,024-2,048 trait-associated SNPs) with a variational autoencoder for genotype compression and a latent diffusion model conditioned on binary disease labels via classifier-free guidance. Evaluated on 458,724 UK Biobank individuals across four complex diseases (coronary artery disease, breast cancer, type 1 and type 2 diabetes), models trained on synthetic data matched real-data predictive performance in a train-on-synthetic, test-on-real protocol, approaching genome-wide PRS methods that use $2$-$6\times$ more variants. Privacy analysis confirmed zero identical matches, near-random membership inference (AUC $\approx 0.50$), preserved linkage disequilibrium structure, and high allele frequency correlation ($r \geq 0.95$) with source data. A controlled simulation with known causal effects verified faithful recovery of the imposed genetic association structure.
• 摘要：多基因风险评分和其他基因组分析需要大量的个体水平基因型数据集，但严格的数据访问限制阻碍了共享。合成基因型生成提供了一种保护隐私的替代方案，但大多数现有方法都是无条件运行的，产生没有表型比对的样本，或者依赖于无监督压缩，从而在统计保真度和下游任务效用之间造成差距。我们提出了 SNPgen，一个两阶段条件潜在扩散框架，用于生成表型监督的合成基因型。 SNPgen 将 GWAS 引导的变异选择（1,024-2,048 个性状相关的 SNP）与用于基因型压缩的变异自动编码器和通过无分类器指导以二元疾病标签为条件的潜在扩散模型结合起来。对四种复杂疾病（冠状动脉疾病、乳腺癌、1 型和 2 型糖尿病）的 458,724 名英国生物银行个体进行了评估，在合成数据上训练的模型在合成训练、真实测试方案中与真实数据预测性能相匹配，接近使用 2$-$6\times$ 多变体的全基因组 PRS 方法。隐私分析证实了零相同匹配、近随机成员推断（AUC $\约 0.50$）、保留的连锁不平衡结构以及与源数据的高等位基因频率相关性（$r \geq 0.95$）。具有已知因果效应的受控模拟验证了强加的遗传关联结构的忠实恢复。

Title: LookaheadKV: Fast and Accurate KV Cache Eviction by Glimpsing into the Future without Generation

• Authors: Jinwoo Ahn, Ingyu Seong, Akhil Kedia, Junhan Kim, Hyemi Jang, Kangwook Lee, Yongkweon Jeon
• Subjects: cs.LG, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.10899
• Pdf URL: https://arxiv.org/pdf/2603.10899
• Copy Paste: [[2603.10899]] LookaheadKV: Fast and Accurate KV Cache Eviction by Glimpsing into the Future without Generation(https://arxiv.org/abs/2603.10899)
• Keywords: generation
• Abstract: Transformer-based large language models (LLMs) rely on key-value (KV) caching to avoid redundant computation during autoregressive inference. While this mechanism greatly improves efficiency, the cache size grows linearly with the input sequence length, quickly becoming a bottleneck for long-context tasks. Existing solutions mitigate this problem by evicting prompt KV that are deemed unimportant, guided by estimated importance scores. Notably, a recent line of work proposes to improve eviction quality by "glimpsing into the future", in which a draft generator produces a surrogate future response approximating the target model's true response, and this surrogate is subsequently used to estimate the importance of cached KV more accurately. However, these approaches rely on computationally expensive draft generation, which introduces substantial prefilling overhead and limits their practicality in real-world deployment. To address this challenge, we propose LookaheadKV, a lightweight eviction framework that leverages the strength of surrogate future response without requiring explicit draft generation. LookaheadKV augments transformer layers with parameter-efficient modules trained to predict true importance scores with high accuracy. Our design ensures negligible runtime overhead comparable to existing inexpensive heuristics, while achieving accuracy superior to more costly approximation methods. Extensive experiments on long-context understanding benchmarks, across a wide range of models, demonstrate that our method not only outperforms recent competitive baselines in various long-context understanding tasks, but also reduces the eviction cost by up to 14.5x, leading to significantly faster time-to-first-token. Our code is available at this https URL.
• 摘要：基于 Transformer 的大型语言模型 (LLM) 依靠键值 (KV) 缓存来避免自回归推理过程中的冗余计算。虽然这种机制极大地提高了效率，但缓存大小随着输入序列长度线性增长，很快成为长上下文任务的瓶颈。现有的解决方案通过在估计的重要性分数的指导下驱逐被认为不重要的提示 KV 来缓解这个问题。值得注意的是，最近的一项工作提出通过“瞥见未来”来提高逐出质量，其中草稿生成器生成接近目标模型真实响应的替代未来响应，并且该替代随后用于更准确地估计缓存 KV 的重要性。然而，这些方法依赖于计算成本高昂的草稿生成，这引入了大量的预填充开销并限制了它们在实际部署中的实用性。为了应对这一挑战，我们提出了 LookaheadKV，这是一个轻量级驱逐框架，它利用替代未来响应的力量，而不需要显式的草稿生成。 LookaheadKV 通过经过训练的参数高效模块来增强变压器层，以高精度预测真实的重要性分数。我们的设计确保与现有廉价启发法相比可以忽略不计的运行时间开销，同时实现优于更昂贵的近似方法的准确性。对各种模型的长上下文理解基准进行的广泛实验表明，我们的方法不仅在各种长上下文理解任务中优于最新的竞争基线，而且还将逐出成本降低了 14.5 倍，从而显着缩短了首次生成令牌的时间。我们的代码可以在这个 https URL 上找到。

Title: Bridging the Skill Gap in Clinical CBCT Interpretation with CBCTRepD

• Authors: Qinxin Wu, Fucheng Niu, Hengchuan Zhu, Yifan Sun, Ye Shen, Xu Li, Han Wu, Leqi Liu, Zhiwen Pan, Zuozhu Liu, Fudong Zhu, Bin Feng
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.10933
• Pdf URL: https://arxiv.org/pdf/2603.10933
• Copy Paste: [[2603.10933]] Bridging the Skill Gap in Clinical CBCT Interpretation with CBCTRepD(https://arxiv.org/abs/2603.10933)
• Keywords: generation, generative
• Abstract: Generative AI has advanced rapidly in medical report generation; however, its application to oral and maxillofacial CBCT reporting remains limited, largely because of the scarcity of high-quality paired CBCT-report data and the intrinsic complexity of volumetric CBCT interpretation. To address this, we introduce CBCTRepD, a bilingual oral and maxillofacial CBCT report-generation system designed for integration into routine radiologist-AI co-authoring workflows. We curated a large-scale, high-quality paired CBCT-report dataset comprising approximately 7,408 studies, covering 55 oral disease entities across diverse acquisition settings, and used it to develop the system. We further established a clinically grounded, multi-level evaluation framework that assesses both direct AI-generated drafts and radiologist-edited collaboration reports using automatic metrics together with radiologist- and clinician-centered evaluation. Using this framework, we show that CBCTRepD achieves superior report-generation performance and produces drafts with writing quality and standardization comparable to those of intermediate radiologists. More importantly, in radiologist-AI collaboration, CBCTRepD provides consistent and clinically meaningful benefits across experience levels: it helps novice radiologists improve toward intermediate-level reporting, enables intermediate radiologists to approach senior-level performance, and even assists senior radiologists by reducing omission-related errors, including clinically important missed lesions. By improving report structure, reducing omissions, and promoting attention to co-existing lesions across anatomical regions, CBCTRepD shows strong and reliable potential as a practical assistant for real-world CBCT reporting across multi-level care settings.
• 摘要：生成式人工智能在医疗报告生成方面进展迅速；然而，其在口腔颌面部 CBCT 报告中的应用仍然有限，很大程度上是因为缺乏高质量的配对 CBCT 报告数据以及体积 CBCT 解释的内在复杂性。为了解决这个问题，我们推出了 CBCTRepD，这是一种双语口腔颌面 CBCT 报告生成系统，旨在集成到常规放射科医生与 AI 共同创作工作流程中。我们策划了一个大规模、高质量的配对 CBCT 报告数据集，其中包含大约 7,408 项研究，涵盖不同采集环境中的 55 个口腔疾病实体，并用它来开发该系统。我们进一步建立了一个以临床为基础的多层次评估框架，使用自动指标以及以放射科医生和临床医生为中心的评估来评估人工智能直接生成的草稿和放射科医生编辑的协作报告。使用此框架，我们表明 CBCTRepD 实现了卓越的报告生成性能，并生成了与中级放射科医生相当的写作质量和标准化草稿。更重要的是，在放射科医生与人工智能的合作中，CBCTRepD 在不同经验水平上提供了一致且具有临床意义的益处：它帮助新手放射科医生提高中级报告水平，使中级放射科医生能够接近高级水平的表现，甚至通过减少与遗漏相关的错误（包括临床上重要的遗漏病灶）来帮助高级放射科医生。通过改进报告结构、减少遗漏并促进对跨解剖区域共存病变的关注，CBCTRepD 显示出作为跨多级护理环境的真实 CBCT 报告的实用助手的强大而可靠的潜力。

Title: Quantifying Membership Disclosure Risk for Tabular Synthetic Data Using Kernel Density Estimators

• Authors: Rajdeep Pathak, Sayantee Jana
• Subjects: cs.LG, stat.AP
• Abstract URL: https://arxiv.org/abs/2603.10937
• Pdf URL: https://arxiv.org/pdf/2603.10937
• Copy Paste: [[2603.10937]] Quantifying Membership Disclosure Risk for Tabular Synthetic Data Using Kernel Density Estimators(https://arxiv.org/abs/2603.10937)
• Keywords: generation
• Abstract: The use of synthetic data has become increasingly popular as a privacy-preserving alternative to sharing real datasets, especially in sensitive domains such as healthcare, finance, and demography. However, the privacy assurances of synthetic data are not absolute, and remain susceptible to membership inference attacks (MIAs), where adversaries aim to determine whether a specific individual was present in the dataset used to train the generator. In this work, we propose a practical and effective method to quantify membership disclosure risk in tabular synthetic datasets using kernel density estimators (KDEs). Our KDE-based approach models the distribution of nearest-neighbour distances between synthetic data and the training records, allowing probabilistic inference of membership and enabling robust evaluation via ROC curves. We propose two attack models: a 'True Distribution Attack', which assumes privileged access to training data, and a more realistic, implementable 'Realistic Attack' that uses auxiliary data without true membership labels. Empirical evaluations across four real-world datasets and six synthetic data generators demonstrate that our method consistently achieves higher F1 scores and sharper risk characterization than a prior baseline approach, without requiring computationally expensive shadow models. The proposed method provides a practical framework and metric for quantifying membership disclosure risk in synthetic data, which enables data custodians to conduct a post-generation risk assessment prior to releasing their synthetic datasets for downstream use. The datasets and codes for this study are available at this https URL.
• 摘要：作为共享真实数据集的隐私保护替代方案，合成数据的使用变得越来越流行，特别是在医疗保健、金融和人口统计等敏感领域。然而，合成数据的隐私保证并不是绝对的，并且仍然容易受到成员推理攻击（MIA）的影响，攻击者的目的是确定用于训练生成器的数据集中是否存在特定的个人。在这项工作中，我们提出了一种实用且有效的方法，使用核密度估计器（KDE）来量化表格合成数据集中的成员资格披露风险。我们基于 KDE 的方法对合成数据和训练记录之间的最近邻距离分布进行建模，允许对成员资格进行概率推断并通过 ROC 曲线进行稳健评估。我们提出了两种攻击模型：“真实分布攻击”，它假设对训练数据的特权访问，以及更现实、可实施的“现实攻击”，它使用没有真实成员标签的辅助数据。对四个真实世界数据集和六个合成数据生成器的实证评估表明，与之前的基线方法相比，我们的方法始终能够实现更高的 F1 分数和更清晰的风险表征，而无需计算成本高昂的影子模型。所提出的方法提供了一个用于量化合成数据中的成员披露风险的实用框架和指标，使数据保管人能够在发布其合成数据集供下游使用之前进行生成后风险评估。本研究的数据集和代码可从此 https URL 获取。

Title: Contrastive learning-based video quality assessment-jointed video vision transformer for video recognition

• Authors: Jian Sun, Mohammad H. Mahoor
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.10965
• Pdf URL: https://arxiv.org/pdf/2603.10965
• Copy Paste: [[2603.10965]] Contrastive learning-based video quality assessment-jointed video vision transformer for video recognition(https://arxiv.org/abs/2603.10965)
• Keywords: quality assessment
• Abstract: Video quality significantly affects video classification. We found this problem when we classified Mild Cognitive Impairment well from clear videos, but worse from blurred ones. From then, we realized that referring to Video Quality Assessment (VQA) may improve video classification. This paper proposed Self-Supervised Learning-based Video Vision Transformer combined with No-reference VQA for video classification (SSL-V3) to fulfill the goal. SSL-V3 leverages Combined-SSL mechanism to join VQA into video classification and address the label shortage of VQA, which commonly occurs in video datasets, making it impossible to provide an accurate Video Quality Score. In brief, Combined-SSL takes video quality score as a factor to directly tune the feature map of the video classification. Then, the score, as an intersected point, links VQA and classification, using the supervised classification task to tune the parameters of VQA. SSL-V3 achieved robust experimental results on two datasets. For example, it reached an accuracy of 94.87% on some interview videos in the I-CONECT (a facial video-involved healthcare dataset), verifying SSL-V3's effectiveness.
• 摘要：视频质量显着影响视频分类。当我们对清晰视频中的轻度认知障碍进行良好分类，对模糊视频进行分类时，我们发现了这个问题。从那时起，我们意识到参考视频质量评估（VQA）可以改善视频分类。本文提出了基于自监督学习的视频视觉变换器与无参考 VQA 相结合的视频分类（SSL-V3）来实现这一目标。 SSL-V3利用Combined-SSL机制将VQA加入到视频分类中，解决了VQA在视频数据集中常见的标签短缺问题，无法提供准确的视频质量分数。简而言之，Combined-SSL以视频质量得分作为因素来直接调整视频分类的特征图。然后，分数作为一个交点，将VQA和分类联系起来，利用监督分类任务来调整VQA的参数。 SSL-V3 在两个数据集上取得了稳健的实验结果。例如，在I-CONECT（涉及面部视频的医疗数据集）中的一些采访视频上达到了94.87%的准确率，验证了SSL-V3的有效性。

Title: FRIEND: Federated Learning for Joint Optimization of multi-RIS Configuration and Eavesdropper Intelligent Detection in B5G Networks

• Authors: Maria Lamprini A. Bartsioka, Ioannis A. Bartsiokas, Anastasios K. Papazafeiropoulos, Maria A. Seimeni, Dimitra I. Kaklamani, Iakovos S. Venieris
• Subjects: cs.LG
• Abstract URL: https://arxiv.org/abs/2603.10977
• Pdf URL: https://arxiv.org/pdf/2603.10977
• Copy Paste: [[2603.10977]] FRIEND: Federated Learning for Joint Optimization of multi-RIS Configuration and Eavesdropper Intelligent Detection in B5G Networks(https://arxiv.org/abs/2603.10977)
• Keywords: generation
• Abstract: As wireless systems evolve toward Beyond 5G (B5G), the adoption of cell-free (CF) millimeter-wave (mmWave) architectures combined with Reconfigurable Intelligent Surfaces (RIS) is emerging as a key enabler for ultra-reliable, high-capacity, scalable, and secure Industrial Internet of Things (IIoT) communications. However, safeguarding these complex and distributed environments against eavesdropping remains a critical challenge, particularly when conventional security mechanisms struggle to overcome scalability, and latency constraints. In this paper, a novel framework for detecting malicious users in RIS-enhanced cell-free mmWave networks using Federated Learning (FL) is presented. The envisioned setup features multiple access points (APs) operating without traditional cell boundaries, assisted by RIS nodes to dynamically shape the wireless propagation environment. Edge devices collaboratively train a Deep Convolutional Neural Network (DCNN) on locally observed Channel State Information (CSI), eliminating the need for raw data exchange. Moreover, an early-exit mechanism is incorporated in that model to jointly satisfy computational complexity requirements. Performance evaluation indicates that the integration of FL and multi-RIS coordination improves approximately 30% the achieved secrecy rate (SR) compared to baseline non-RIS-assisted methods while maintaining near-optimal detection accuracy levels. This work establishes a distributed, privacy-preserving approach to physical layer eavesdropping detection tailored for next-generation IIoT deployments.
• 摘要：随着无线系统向超越 5G (B5G) 发展，无蜂窝 (CF) 毫米波 (mmWave) 架构与可重构智能表面 (RIS) 相结合的采用正在成为超可靠、高容量、可扩展和安全的工业物联网 (IIoT) 通信的关键推动者。然而，保护这些复杂的分布式环境免遭窃听仍然是一个严峻的挑战，特别是当传统的安全机制难以克服可扩展性和延迟限制时。本文提出了一种使用联邦学习 (FL) 检测 RIS 增强型无细胞毫米波网络中恶意用户的新颖框架。设想的设置具有多个接入点 (AP) 在没有传统小区边界的情况下运行，并在 RIS 节点的协助下动态塑造无线传播环境。边缘设备根据本地观察到的通道状态信息 (CSI) 协作训练深度卷积神经网络 (DCNN)，从而无需交换原始数据。此外，该模型中还引入了提前退出机制，以共同满足计算复杂性要求。性能评估表明，与基线非 RIS 辅助方法相比，FL 和多 RIS 协调的集成将实现的保密率 (SR) 提高了约 30%，同时保持接近最佳的检测精度水平。这项工作建立了一种分布式、隐私保护的物理层窃听检测方法，专为下一代工业物联网部署量身定制。

Title: Too Vivid to Be Real? Benchmarking and Calibrating Generative Color Fidelity

• Authors: Zhengyao Fang, Zexi Jia, Yijia Zhong, Pengcheng Luo, Jinchao Zhang, Guangming Lu, Jun Yu, Wenjie Pei
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.10990
• Pdf URL: https://arxiv.org/pdf/2603.10990
• Copy Paste: [[2603.10990]] Too Vivid to Be Real? Benchmarking and Calibrating Generative Color Fidelity(https://arxiv.org/abs/2603.10990)
• Keywords: generation, generative
• Abstract: Recent advances in text-to-image (T2I) generation have greatly improved visual quality, yet producing images that appear visually authentic to real-world photography remains challenging. This is partly due to biases in existing evaluation paradigms: human ratings and preference-trained metrics often favor visually vivid images with exaggerated saturation and contrast, which make generations often too vivid to be real even when prompted for realistic-style images. To address this issue, we present Color Fidelity Dataset (CFD) and Color Fidelity Metric (CFM) for objective evaluation of color fidelity in realistic-style generations. CFD contains over 1.3M real and synthetic images with ordered levels of color realism, while CFM employs a multimodal encoder to learn perceptual color fidelity. In addition, we propose a training-free Color Fidelity Refinement (CFR) that adaptively modulates spatial-temporal guidance scale in generation, thereby enhancing color authenticity. Together, CFD supports CFM for assessment, whose learned attention further guides CFR to refine T2I fidelity, forming a progressive framework for assessing and improving color fidelity in realistic-style T2I generation. The dataset and code are available at this https URL.
• 摘要：文本到图像 (T2I) 生成技术的最新进展极大地提高了视觉质量，但生成在视觉上与现实世界摄影相似的图像仍然具有挑战性。这在一定程度上是由于现有评估范式的偏差：人类评分和偏好训练的指标通常偏爱视觉上生动的图像，具有夸张的饱和度和对比度，这使得几代人即使在提示使用写实风格的图像时也往往过于生动而不真实。为了解决这个问题，我们提出了颜色保真度数据集（CFD）和颜色保真度度量（CFM），用于客观评估写实风格生成中的颜色保真度。 CFD 包含超过 130 万张真实和合成图像，具有有序的色彩逼真度，而 CFM 采用多模态编码器来学习感知色彩保真度。此外，我们提出了一种免训练的颜色保真度细化（CFR），可在生成过程中自适应调节时空指导尺度，从而增强颜色真实性。 CFD 共同支持 CFM 进行评估，其学习注意力进一步指导 CFR 完善 T2I 保真度，形成一个用于评估和提高写实风格 T2I 生成中颜色保真度的渐进框架。数据集和代码可从此 https URL 获取。

Title: Does AI See like Art Historians? Interpreting How Vision Language Models Recognize Artistic Style

• Authors: Marvin Limpijankit, Milad Alshomary, Yassin Oulad Daoud, Amith Ananthram, Tim Trombley, Elias Stengel-Eskin, Mohit Bansal, Noam M. Elcott, Kathleen McKeown
• Subjects: cs.CV, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.11024
• Pdf URL: https://arxiv.org/pdf/2603.11024
• Copy Paste: [[2603.11024]] Does AI See like Art Historians? Interpreting How Vision Language Models Recognize Artistic Style(https://arxiv.org/abs/2603.11024)
• Keywords: generation
• Abstract: VLMs have become increasingly proficient at a range of computer vision tasks, such as visual question answering and object detection. This includes increasingly strong capabilities in the domain of art, from analyzing artwork to generation of art. In an interdisciplinary collaboration between computer scientists and art historians, we characterize the mechanisms underlying VLMs' ability to predict artistic style and assess the extent to which they align with the criteria art historians use to reason about artistic style. We employ a latent-space decomposition approach to identify concepts that drive art style prediction and conduct quantitative evaluations, causal analysis and assessment by art historians. Our findings indicate that 73% of the extracted concepts are judged by art historians to exhibit a coherent and semantically meaningful visual feature and 90% of concepts used to predict style of a given artwork were judged relevant. In cases where an irrelevant concept was used to successfully predict style, art historians identified possible reasons for its success; for example, the model might "understand" a concept in more formal terms, such as dark/light contrasts.
• 摘要：VLM 在一系列计算机视觉任务上变得越来越熟练，例如视觉问答和目标检测。这包括艺术领域日益强大的能力，从分析艺术品到艺术生成。在计算机科学家和艺术史学家之间的跨学科合作中，我们描述了 VLM 预测艺术风格的能力的机制，并评估它们与艺术史学家用来推理艺术风格的标准的一致程度。我们采用潜在空间分解方法来识别驱动艺术风格预测的概念，并由艺术史学家进行定量评估、因果分析和评估。我们的研究结果表明，艺术史学家认为 73% 的提取概念具有连贯且语义上有意义的视觉特征，并且 90% 用于预测给定艺术品风格的概念被认为是相关的。在使用不相关的概念成功预测风格的情况下，艺术史学家找出了其成功的可能原因；例如，模型可能会用更正式的术语“理解”一个概念，例如暗/亮对比。

Title: DynVLA: Learning World Dynamics for Action Reasoning in Autonomous Driving

• Authors: Shuyao Shang, Bing Zhan, Yunfei Yan, Yuqi Wang, Yingyan Li, Yasong An, Xiaoman Wang, Jierui Liu, Lu Hou, Lue Fan, Zhaoxiang Zhang, Tieniu Tan
• Subjects: cs.CV, cs.RO
• Abstract URL: https://arxiv.org/abs/2603.11041
• Pdf URL: https://arxiv.org/pdf/2603.11041
• Copy Paste: [[2603.11041]] DynVLA: Learning World Dynamics for Action Reasoning in Autonomous Driving(https://arxiv.org/abs/2603.11041)
• Keywords: generation
• Abstract: We propose DynVLA, a driving VLA model that introduces a new CoT paradigm termed Dynamics CoT. DynVLA forecasts compact world dynamics before action generation, enabling more informed and physically grounded decision-making. To obtain compact dynamics representations, DynVLA introduces a Dynamics Tokenizer that compresses future evolution into a small set of dynamics tokens. Considering the rich environment dynamics in interaction-intensive driving scenarios, DynVLA decouples ego-centric and environment-centric dynamics, yielding more accurate world dynamics modeling. We then train DynVLA to generate dynamics tokens before actions through SFT and RFT, improving decision quality while maintaining latency-efficient inference. Compared to Textual CoT, which lacks fine-grained spatiotemporal understanding, and Visual CoT, which introduces substantial redundancy due to dense image prediction, Dynamics CoT captures the evolution of the world in a compact, interpretable, and efficient form. Extensive experiments on NAVSIM, Bench2Drive, and a large-scale in-house dataset demonstrate that DynVLA consistently outperforms Textual CoT and Visual CoT methods, validating the effectiveness and practical value of Dynamics CoT.
• 摘要：我们提出了 DynVLA，这是一种驱动 VLA 模型，它引入了一种新的 CoT 范式，称为 Dynamics CoT。 DynVLA 在行动生成之前预测紧凑的世界动态，从而实现更明智、更实际的决策。为了获得紧凑的动态表示，DynVLA 引入了 Dynamics Tokenizer，将未来的演化压缩为一小组动态标记。考虑到交互密集型驾驶场景中丰富的环境动态，DynVLA 解耦了以自我为中心和以环境为中心的动态，从而产生更准确的世界动态建模。然后，我们训练 DynVLA 在通过 SFT 和 RFT 执行操作之前生成动态令牌，从而提高决策质量，同时保持延迟高效的推理。与缺乏细粒度时空理解的 Textual CoT 和由于密集图像预测而引入大量冗余的 Visual CoT 相比，Dynamics CoT 以紧凑、可解释和高效的形式捕获世界的演变。在 NAVSIM、Bench2Drive 和大规模内部数据集上进行的大量实验表明，DynVLA 始终优于 Textual CoT 和 Visual CoT 方法，验证了 Dynamics CoT 的有效性和实用价值。

Title: V2M-Zero: Zero-Pair Time-Aligned Video-to-Music Generation

• Authors: Yan-Bo Lin, Jonah Casebeer, Long Mai, Aniruddha Mahapatra, Gedas Bertasius, Nicholas J. Bryan
• Subjects: cs.CV, cs.AI, cs.LG, cs.MM, cs.SD
• Abstract URL: https://arxiv.org/abs/2603.11042
• Pdf URL: https://arxiv.org/pdf/2603.11042
• Copy Paste: [[2603.11042]] V2M-Zero: Zero-Pair Time-Aligned Video-to-Music Generation(https://arxiv.org/abs/2603.11042)
• Keywords: generation
• Abstract: Generating music that temporally aligns with video events is challenging for existing text-to-music models, which lack fine-grained temporal control. We introduce V2M-Zero, a zero-pair video-to-music generation approach that outputs time-aligned music for video. Our method is motivated by a key observation: temporal synchronization requires matching when and how much change occurs, not what changes. While musical and visual events differ semantically, they exhibit shared temporal structure that can be captured independently within each modality. We capture this structure through event curves computed from intra-modal similarity using pretrained music and video encoders. By measuring temporal change within each modality independently, these curves provide comparable representations across modalities. This enables a simple training strategy: fine-tune a text-to-music model on music-event curves, then substitute video-event curves at inference without cross-modal training or paired data. Across OES-Pub, MovieGenBench-Music, and AIST++, V2M-Zero achieves substantial gains over paired-data baselines: 5-21% higher audio quality, 13-15% better semantic alignment, 21-52% improved temporal synchronization, and 28% higher beat alignment on dance videos. We find similar results via a large crowd-source subjective listening test. Overall, our results validate that temporal alignment through within-modality features, rather than paired cross-modal supervision, is effective for video-to-music generation. Results are available at this https URL
• 摘要：对于现有的文本到音乐模型来说，生成与视频事件在时间上一致的音乐是一项挑战，因为现有的文本到音乐模型缺乏细粒度的时间控制。我们推出了 V2M-Zero，这是一种零对视频到音乐生成方法，可为视频输出时间对齐的音乐。我们的方法受到一个关键观察的启发：时间同步需要匹配发生变化的时间和程度，而不是变化的内容。虽然音乐和视觉事件在语义上有所不同，但它们表现出共享的时间结构，可以在每种模态中独立捕获。我们通过使用预训练的音乐和视频编码器根据模内相似性计算的事件曲线来捕获这种结构。通过独立测量每种模态内的时间变化，这些曲线提供了跨模态的可比较的表示。这实现了一种简单的训练策略：在音乐事件曲线上微调文本到音乐模型，然后在推理时替换视频事件曲线，而无需跨模式训练或配对数据。在 OES-Pub、MovieGenBench-Music 和 AIST++ 中，V2M-Zero 比配对数据基线取得了显着的进步：音频质量提高了 5-21%，语义对齐提高了 13-15%，时间同步提高了 21-52%，舞蹈视频的节拍对齐提高了 28%。我们通过大型众包主观听力测试发现了类似的结果。总的来说，我们的结果验证了通过模态内特征进行时间对齐，而不是配对的跨模态监督，对于视频到音乐的生成是有效的。结果可在此 https URL 获取

Title: LiTo: Surface Light Field Tokenization

• Authors: Jen-Hao Rick Chang, Xiaoming Zhao, Dorian Chan, Oncel Tuzel
• Subjects: cs.CV, cs.AI, cs.GR
• Abstract URL: https://arxiv.org/abs/2603.11047
• Pdf URL: https://arxiv.org/pdf/2603.11047
• Copy Paste: [[2603.11047]] LiTo: Surface Light Field Tokenization(https://arxiv.org/abs/2603.11047)
• Keywords: generation
• Abstract: We propose a 3D latent representation that jointly models object geometry and view-dependent appearance. Most prior works focus on either reconstructing 3D geometry or predicting view-independent diffuse appearance, and thus struggle to capture realistic view-dependent effects. Our approach leverages that RGB-depth images provide samples of a surface light field. By encoding random subsamples of this surface light field into a compact set of latent vectors, our model learns to represent both geometry and appearance within a unified 3D latent space. This representation reproduces view-dependent effects such as specular highlights and Fresnel reflections under complex lighting. We further train a latent flow matching model on this representation to learn its distribution conditioned on a single input image, enabling the generation of 3D objects with appearances consistent with the lighting and materials in the input. Experiments show that our approach achieves higher visual quality and better input fidelity than existing methods.
• 摘要：我们提出了一种 3D 潜在表示，可以联合建模对象几何形状和依赖于视图的外观。大多数先前的工作都集中于重建 3D 几何或预测与视图无关的漫反射外观，因此很难捕捉真实的视图相关效果。我们的方法利用 RGB 深度图像提供表面光场的样本。通过将该表面光场的随机子样本编码为一组紧凑的潜在向量，我们的模型学会了在统一的 3D 潜在空间中表示几何形状和外观。这种表示再现了依赖于视图的效果，例如复杂照明下的镜面高光和菲涅耳反射。我们进一步在此表示上训练潜在流匹配模型，以了解其在单个输入图像上的分布，从而能够生成外观与输入中的照明和材质一致的 3D 对象。实验表明，我们的方法比现有方法实现了更高的视觉质量和更好的输入保真度。

Title: COMIC: Agentic Sketch Comedy Generation

• Authors: Susung Hong, Brian Curless, Ira Kemelmacher-Shlizerman, Steve Seitz
• Subjects: cs.CV, cs.AI, cs.CL, cs.MA, cs.NE
• Abstract URL: https://arxiv.org/abs/2603.11048
• Pdf URL: https://arxiv.org/pdf/2603.11048
• Copy Paste: [[2603.11048]] COMIC: Agentic Sketch Comedy Generation(https://arxiv.org/abs/2603.11048)
• Keywords: generation
• Abstract: We propose a fully automated AI system that produces short comedic videos similar to sketch shows such as Saturday Night Live. Starting with character references, the system employs a population of agents loosely based on real production studio roles, structured to optimize the quality and diversity of ideas and outputs through iterative competition, evaluation, and improvement. A key contribution is the introduction of LLM critics aligned with real viewer preferences through the analysis of a corpus of comedy videos on YouTube to automatically evaluate humor. Our experiments show that our framework produces results approaching the quality of professionally produced sketches while demonstrating state-of-the-art performance in video generation.
• 摘要：我们提出了一个完全自动化的人工智能系统，可以生成类似于周六夜现场等小品节目的喜剧短片。从角色参考开始，该系统根据真实的制作工作室角色松散地采用了一群代理，其结构是通过迭代竞争、评估和改进来优化想法和输出的质量和多样性。一个关键贡献是通过分析 YouTube 上的喜剧视频语料库来自动评估幽默，引入了与真实观众偏好相一致的法学硕士评论家。我们的实验表明，我们的框架产生的结果接近专业制作草图的质量，同时展示了视频生成中最先进的性能。