2026-03-05

Title: Biased Generalization in Diffusion Models

• Authors: Jerome Garnier-Brun, Luca Biggio, Davide Beltrame, Marc Mézard, Luca Saglietti
• Subjects: cs.LG, cond-mat.dis-nn, cond-mat.stat-mech
• Abstract URL: https://arxiv.org/abs/2603.03469
• Pdf URL: https://arxiv.org/pdf/2603.03469
• Copy Paste: [[2603.03469]] Biased Generalization in Diffusion Models(https://arxiv.org/abs/2603.03469)
• Keywords: generative
• Abstract: Generalization in generative modeling is defined as the ability to learn an underlying distribution from a finite dataset and produce novel samples, with evaluation largely driven by held-out performance and perceived sample quality. In practice, training is often stopped at the minimum of the test loss, taken as an operational indicator of generalization. We challenge this viewpoint by identifying a phase of biased generalization during training, in which the model continues to decrease the test loss while favoring samples with anomalously high proximity to training data. By training the same network on two disjoint datasets and comparing the mutual distances of generated samples and their similarity to training data, we introduce a quantitative measure of bias and demonstrate its presence on real images. We then study the mechanism of bias, using a controlled hierarchical data model where access to exact scores and ground-truth statistics allows us to precisely characterize its onset. We attribute this phenomenon to the sequential nature of feature learning in deep networks, where coarse structure is learned early in a data-independent manner, while finer features are resolved later in a way that increasingly depends on individual training samples. Our results show that early stopping at the test loss minimum, while optimal under standard generalization criteria, may be insufficient for privacy-critical applications.
• 摘要：生成建模中的泛化被定义为从有限数据集中学习基础分布并生成新样本的能力，其评估很大程度上由保留的性能和感知的样本质量驱动。在实践中，训练通常在测试损失最小时停止，作为泛化的操作指标。我们通过识别训练期间有偏差的泛化阶段来挑战这一观点，在该阶段中，模型继续减少测试损失，同时偏向与训练数据异常高度接近的样本。通过在两个不相交的数据集上训练相同的网络并比较生成样本的相互距离及其与训练数据的相似性，我们引入了偏差的定量测量并证明了其在真实图像上的存在。然后，我们使用受控的分层数据模型来研究偏差的机制，在该模型中，获得准确的分数和真实的统计数据使我们能够精确地描述其发生的特征。我们将这种现象归因于深度网络中特征学习的顺序性质，其中粗略的结构是在早期以与数据无关的方式学习的，而更精细的特征是在稍后以越来越依赖于个体训练样本的方式解决的。我们的结果表明，早期停止测试损失最小值虽然在标准泛化标准下是最佳的，但对于隐私关键型应用程序来说可能还不够。

Title: Beyond Pixel Histories: World Models with Persistent 3D State

• Authors: Samuel Garcin, Thomas Walker, Steven McDonagh, Tim Pearce, Hakan Bilen, Tianyu He, Kaixin Wang, Jiang Bian
• Subjects: cs.CV, cs.AI, cs.LG
• Abstract URL: https://arxiv.org/abs/2603.03482
• Pdf URL: https://arxiv.org/pdf/2603.03482
• Copy Paste: [[2603.03482]] Beyond Pixel Histories: World Models with Persistent 3D State(https://arxiv.org/abs/2603.03482)
• Keywords: generation
• Abstract: Interactive world models continually generate video by responding to a user's actions, enabling open-ended generation capabilities. However, existing models typically lack a 3D representation of the environment, meaning 3D consistency must be implicitly learned from data, and spatial memory is restricted to limited temporal context windows. This results in an unrealistic user experience and presents significant obstacles to down-stream tasks such as training agents. To address this, we present PERSIST, a new paradigm of world model which simulates the evolution of a latent 3D scene: environment, camera, and renderer. This allows us to synthesize new frames with persistent spatial memory and consistent geometry. Both quantitative metrics and a qualitative user study show substantial improvements in spatial memory, 3D consistency, and long-horizon stability over existing methods, enabling coherent, evolving 3D worlds. We further demonstrate novel capabilities, including synthesising diverse 3D environments from a single image, as well as enabling fine-grained, geometry-aware control over generated experiences by supporting environment editing and specification directly in 3D space. Project page: this https URL
• 摘要：交互式世界模型通过响应用户的操作来不断生成视频，从而实现开放式生成功能。然而，现有模型通常缺乏环境的 3D 表示，这意味着必须从数据中隐式学习 3D 一致性，并且空间记忆仅限于有限的时间上下文窗口。这会导致不切实际的用户体验，并对训练代理等下游任务造成重大障碍。为了解决这个问题，我们提出了 PERSIST，一种新的世界模型范式，它模拟潜在 3D 场景的演变：环境、相机和渲染器。这使我们能够合成具有持久空间记忆和一致几何形状的新框架。定量指标和定性用户研究都表明，与现有方法相比，空间记忆、3D 一致性和长期稳定性方面有了显着改进，从而实现连贯、不断发展的 3D 世界。我们进一步展示了新颖的功能，包括从单个图像合成不同的 3D 环境，以及通过直接在 3D 空间中支持环境编辑和规范来实现对生成的体验进行细粒度、几何感知的控制。项目页面：此 https URL

Title: Phys4D: Fine-Grained Physics-Consistent 4D Modeling from Video Diffusion

• Authors: Haoran Lu, Shang Wu, Jianshu Zhang, Maojiang Su, Guo Ye, Chenwei Xu, Lie Lu, Pranav Maneriker, Fan Du, Manling Li, Zhaoran Wang, Han Liu
• Subjects: cs.CV, cs.AI, cs.RO
• Abstract URL: https://arxiv.org/abs/2603.03485
• Pdf URL: https://arxiv.org/pdf/2603.03485
• Copy Paste: [[2603.03485]] Phys4D: Fine-Grained Physics-Consistent 4D Modeling from Video Diffusion(https://arxiv.org/abs/2603.03485)
• Keywords: generative
• Abstract: Recent video diffusion models have achieved impressive capabilities as large-scale generative world models. However, these models often struggle with fine-grained physical consistency, exhibiting physically implausible dynamics over time. In this work, we present \textbf{Phys4D}, a pipeline for learning physics-consistent 4D world representations from video diffusion models. Phys4D adopts \textbf{a three-stage training paradigm} that progressively lifts appearance-driven video diffusion models into physics-consistent 4D world representations. We first bootstrap robust geometry and motion representations through large-scale pseudo-supervised pretraining, establishing a foundation for 4D scene modeling. We then perform physics-grounded supervised fine-tuning using simulation-generated data, enforcing temporally consistent 4D dynamics. Finally, we apply simulation-grounded reinforcement learning to correct residual physical violations that are difficult to capture through explicit supervision. To evaluate fine-grained physical consistency beyond appearance-based metrics, we introduce a set of \textbf{4D world consistency evaluation} that probe geometric coherence, motion stability, and long-horizon physical plausibility. Experimental results demonstrate that Phys4D substantially improves fine-grained spatiotemporal and physical consistency compared to appearance-driven baselines, while maintaining strong generative performance. Our project page is available at this https URL
• 摘要：最近的视频扩散模型作为大规模生成世界模型已经取得了令人印象深刻的能力。然而，这些模型常常难以实现细粒度的物理一致性，随着时间的推移表现出物理上令人难以置信的动态。在这项工作中，我们提出了 \textbf{Phys4D}，一个用于从视频扩散模型学习物理一致的 4D 世界表示的管道。 Phys4D 采用 \textbf{三阶段训练范例}，逐步将外观驱动的视频扩散模型提升为物理一致的 4D 世界表示。我们首先通过大规模伪监督预训练引导鲁棒的几何和运动表示，为 4D 场景建模奠定基础。然后，我们使用模拟生成的数据执行基于物理的监督微调，从而实现时间一致的 4D 动态。最后，我们应用基于模拟的强化学习来纠正难以通过显式监督捕获的残留物理违规行为。为了评估基于外观的指标之外的细粒度物理一致性，我们引入了一组 \textbf{4D 世界一致性评估}，用于探测几何相干性、运动稳定性和长期物理合理性。实验结果表明，与外观驱动的基线相比，Phys4D 显着提高了细粒度时空和物理一致性，同时保持了强大的生成性能。我们的项目页面可通过此 https URL 访问

Title: PhyPrompt: RL-based Prompt Refinement for Physically Plausible Text-to-Video Generation

• Authors: Shang Wu, Chenwei Xu, Zhuofan Xia, Weijian Li, Lie Lu, Pranav Maneriker, Fan Du, Manling Li, Han Liu
• Subjects: cs.CV, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.03505
• Pdf URL: https://arxiv.org/pdf/2603.03505
• Copy Paste: [[2603.03505]] PhyPrompt: RL-based Prompt Refinement for Physically Plausible Text-to-Video Generation(https://arxiv.org/abs/2603.03505)
• Keywords: generation
• Abstract: State-of-the-art text-to-video (T2V) generators frequently violate physical laws despite high visual quality. We show this stems from insufficient physical constraints in prompts rather than model limitations: manually adding physics details reliably produces physically plausible videos, but requires expertise and does not scale. We present PhyPrompt, a two-stage reinforcement learning framework that automatically refines prompts for physically realistic generation. First, we fine-tune a large language model on a physics-focused Chain-of-Thought dataset to integrate principles like object motion and force interactions while preserving user intent. Second, we apply Group Relative Policy Optimization with a dynamic reward curriculum that initially prioritizes semantic fidelity, then progressively shifts toward physical commonsense. This curriculum achieves synergistic optimization: PhyPrompt-7B reaches 40.8\% joint success on VideoPhy2 (8.6pp gain), improving physical commonsense by 11pp (55.8\% to 66.8\%) while simultaneously increasing semantic adherence by 4.4pp (43.4\% to 47.8\%). Remarkably, our curriculum exceeds single-objective training on both metrics, demonstrating compositional prompt discovery beyond conventional multi-objective trade-offs. PhyPrompt outperforms GPT-4o (+3.8\% joint) and DeepSeek-V3 (+2.2\%, 100$\times$ larger) using only 7B parameters. The approach transfers zero-shot across diverse T2V architectures (Lavie, VideoCrafter2, CogVideoX-5B) with up to 16.8\% improvement, establishing that domain-specialized reinforcement learning with compositional curricula surpasses general-purpose scaling for physics-aware generation.
• 摘要：尽管视觉质量很高，但最先进的文本到视频 (T2V) 生成器经常违反物理定律。我们表明，这源于提示中物理约束不足，而不是模型限制：手动添加物理细节可以可靠地生成物理上合理的视频，但需要专业知识并且无法扩展。我们提出了 PhyPrompt，这是一个两阶段强化学习框架，可以自动优化提示以实现物理真实的生成。首先，我们在以物理为中心的思想链数据集上微调大型语言模型，以集成对象运动和力交互等原理，同时保留用户意图。其次，我们应用群体相对策略优化和动态奖励课程，该课程最初优先考虑语义保真度，然后逐步转向物理常识。该课程实现了协同优化：PhyPrompt-7B 在 VideoPhy2 上达到 40.8\% 联合成功率（8.6pp 增益），将物理常识提高 11pp（55.8\% 至 66.8\%），同时将语义依从性提高 4.4pp（43.4\% 至 47.8\%）。值得注意的是，我们的课程在这两个指标上都超过了单目标训练，展示了超越传统多目标权衡的组合即时发现。仅使用 7B 参数，PhyPrompt 就优于 GPT-4o（+3.8\% 联合）和 DeepSeek-V3（+2.2\%，大 100$\times$）。该方法在不同的 T2V 架构（Lavie、VideoCrafter2、CogVideoX-5B）之间进行零样本传输，性能提升高达 16.8%，确立了具有组合课程的领域专业强化学习超越了物理感知生成的通用扩展。

Title: Test-Time Meta-Adaptation with Self-Synthesis

• Authors: Zeyneb N. Kaya, Nick Rui
• Subjects: cs.LG, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.03524
• Pdf URL: https://arxiv.org/pdf/2603.03524
• Copy Paste: [[2603.03524]] Test-Time Meta-Adaptation with Self-Synthesis(https://arxiv.org/abs/2603.03524)
• Keywords: generation
• Abstract: As strong general reasoners, large language models (LLMs) encounter diverse domains and tasks, where the ability to adapt and self-improve at test time is valuable. We introduce MASS, a meta-learning framework that enables LLMs to self-adapt by generating problem-specific synthetic training data and performing targeted self-updates optimized for downstream performance at inference time. We train this behavior end-to-end via bilevel optimization: an inner loop adapts on self-generated examples while an outer loop meta-learns data-attribution signals and rewards post-update task performance. The synthetic data is optimized with scalable meta-gradients, backpropagating the downstream loss through the inner updates to reward useful generations. Experiments on mathematical reasoning show that MASS learns to synthesize per-instance curricula that yield effective, data-efficient test-time adaptation.
• 摘要：作为强大的通用推理机，大型语言模型 (LLM) 会遇到不同的领域和任务，在这些领域和任务中，在测试时适应和自我改进的能力非常有价值。我们引入了 MASS，这是一种元学习框架，它使法学硕士能够通过生成特定问题的合成训练数据并在推理时执行针对下游性能优化的有针对性的自我更新来进行自我调整。我们通过双层优化端到端地训练这种行为：内部循环适应自生成的示例，而外部循环元学习数据属性信号并奖励更新后的任务性能。合成数据通过可扩展的元梯度进行优化，通过内部更新反向传播下游损失以奖励有用的一代。数学推理实验表明，MASS 学会综合每个实例的课程，从而产生有效的、数据高效的测试时间适应。

Title: Online Learnability of Chain-of-Thought Verifiers: Soundness and Completeness Trade-offs

• Authors: Maria-Florina Balcan, Avrim Blum, Kiriaki Fragkia, Zhiyuan Li, Dravyansh Sharma
• Subjects: cs.LG
• Abstract URL: https://arxiv.org/abs/2603.03538
• Pdf URL: https://arxiv.org/pdf/2603.03538
• Copy Paste: [[2603.03538]] Online Learnability of Chain-of-Thought Verifiers: Soundness and Completeness Trade-offs(https://arxiv.org/abs/2603.03538)
• Keywords: generation
• Abstract: Large language models with chain-of-thought generation have demonstrated great potential for producing complex mathematical proofs. However, their reasoning can often go astray, leading to increasing interest in formal and learned verifiers. A major challenge in learning verifiers, especially when their output will be used by the prover, is that this feedback loop may produce substantial distribution shift. Motivated by this challenge, we propose an online learning framework for learning chain-of-thought verifiers that, given a problem and a sequence of reasoning steps, check the correctness of the solution. Highlighting the asymmetric role of soundness (failure in catching errors in a proof) and completeness (flagging correct proofs as wrong) mistakes of the verifier, we introduce novel extensions of the Littlestone dimension which tightly characterize the mistake bounds for learning a verifier in the realizable setting. We provide optimal algorithms for finding the Pareto-frontier (the smallest total number of mistakes given a budget of soundness mistakes) as well as minimizing a linear combination of asymmetric costs. We further show how our learned verifiers can be used to boost the accuracy of a collection of weak provers, and enable generation of proofs beyond what they were trained on. With the mild assumption that one of the provers can generate the next reasoning step correctly with some minimal probability, we show how to learn a strong prover with small error and abstention rates.
• 摘要：具有思想链生成功能的大型语言模型已经证明了产生复杂数学证明的巨大潜力。然而，他们的推理经常会误入歧途，导致人们对形式验证和学习验证的兴趣日益浓厚。学习验证者的一个主要挑战，特别是当证明者使用其输出时，该反馈循环可能会产生大量的分布偏移。受这一挑战的推动，我们提出了一个用于学习思想链验证器的在线学习框架，该框架在给定问题和一系列推理步骤的情况下，检查解决方案的正确性。强调了验证者的健全性（未能发现证明中的错误）和完整性（将正确的证明标记为错误）错误的不对称作用，我们引入了 Littlestone 维度的新颖扩展，它紧密地描述了在可实现的设置中学习验证者的错误界限。我们提供最佳算法来查找帕累托前沿（给定健全性错误预算的最小错误总数）以及最小化不对称成本的线性组合。我们进一步展示了如何使用我们学习的验证者来提高弱证明者集合的准确性，并能够生成超出他们训练范围的证明。温和地假设其中一个证明者可以以最小概率正确生成下一个推理步骤，我们展示了如何学习一个错误率和弃权率较小的强大证明者。

Title: Hazard-Aware Traffic Scene Graph Generation

• Authors: Yaoqi Huang, Julie Stephany Berrio, Mao Shan, Stewart Worrall
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.03584
• Pdf URL: https://arxiv.org/pdf/2603.03584
• Copy Paste: [[2603.03584]] Hazard-Aware Traffic Scene Graph Generation(https://arxiv.org/abs/2603.03584)
• Keywords: generation
• Abstract: Maintaining situational awareness in complex driving scenarios is challenging. It requires continuously prioritizing attention among extensive scene entities and understanding how prominent hazards might affect the ego vehicle. While existing studies excel at detecting specific semantic categories and visually salient regions, they lack the ability to assess safety-relevance. Meanwhile, the generic spatial predicates either for foreground objects only or for all scene entities modeled by existing scene graphs are inadequate for driving scenarios. To bridge this gap, we introduce a novel task, Traffic Scene Graph Generation, which captures traffic-specific relations between prominent hazards and the ego vehicle. We propose a novel framework that explicitly uses traffic accident data and depth cues to supplement visual features and semantic information for reasoning. The output traffic scene graphs provide intuitive guidelines that stress prominent hazards by color-coding their severity and notating their effect mechanism and relative location to the ego vehicle. We create relational annotations on Cityscapes dataset and evaluate our model on 10 tasks from 5 perspectives. The results in comparative experiments and ablation studies demonstrate our capacity in ego-centric reasoning for hazard-aware traffic scene understanding.
• 摘要：在复杂的驾驶场景中保持态势感知具有挑战性。它需要不断优先关注广泛的场景实体，并了解突出的危险可能如何影响自我车辆。虽然现有的研究擅长检测特定的语义类别和视觉显着区域，但它们缺乏评估安全相关性的能力。同时，仅针对前景对象或针对现有场景图建模的所有场景实体的通用空间谓词不足以满足驾驶场景。为了弥补这一差距，我们引入了一项新颖的任务，即交通场景图生成，它捕获突出危险和自我车辆之间的交通特定关系。我们提出了一种新颖的框架，明确使用交通事故数据和深度线索来补充用于推理的视觉特征和语义信息。输出的交通场景图提供了直观的指导，通过对显着危险的严重程度进行颜色编码并标注其影响机制和与自我车辆的相对位置来强调显着危险。我们在 Cityscapes 数据集上创建关系注释，并从 5 个角度评估 10 项任务的模型。比较实验和消融研究的结果证明了我们以自我为中心的推理能力，能够理解危险感知的交通场景。

Title: DM-CFO: A Diffusion Model for Compositional 3D Tooth Generation with Collision-Free Optimization

• Authors: Yan Tian, Pengcheng Xue, Weiping Ding, Mahmoud Hassaballah, Karen Egiazarian, Aura Conci, Abdulkadir Sengur, Leszek Rutkowski
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.03602
• Pdf URL: https://arxiv.org/pdf/2603.03602
• Copy Paste: [[2603.03602]] DM-CFO: A Diffusion Model for Compositional 3D Tooth Generation with Collision-Free Optimization(https://arxiv.org/abs/2603.03602)
• Keywords: generation
• Abstract: The automatic design of a 3D tooth model plays a crucial role in dental digitization. However, current approaches face challenges in compositional 3D tooth generation because both the layouts and shapes of missing teeth need to be this http URL addition, collision conflicts are often omitted in 3D Gaussian-based compositional 3D generation, where objects may intersect with each other due to the absence of explicit geometric information on the object surfaces. Motivated by graph generation through diffusion models and collision detection using 3D Gaussians, we propose an approach named DM-CFO for compositional tooth generation, where the layout of missing teeth is progressively restored during the denoising phase under both text and graph constraints. Then, the Gaussian parameters of each layout-guided tooth and the entire jaw are alternately updated using score distillation sampling (SDS). Furthermore, a regularization term based on the distances between the 3D Gaussians of neighboring teeth and the anchor tooth is introduced to penalize tooth intersections. Experimental results on three tooth-design datasets demonstrate that our approach significantly improves the multiview consistency and realism of the generated teeth compared with existing methods. Project page: this https URL.
• 摘要：3D牙齿模型的自动设计在牙科数字化中发挥着至关重要的作用。然而，当前的方法在组合 3D 牙齿生成中面临挑战，因为缺失牙齿的布局和形状都需要添加 http URL，在基于 3D 高斯的组合 3D 生成中经常会忽略碰撞冲突，其中由于对象表面上缺乏明确的几何信息，对象可能会彼此相交。受通过扩散模型生成图形和使用 3D 高斯的碰撞检测的启发，我们提出了一种名为 DM-CFO 的组合牙齿生成方法，其中缺失牙齿的布局在文本和图形约束下的去噪阶段逐步恢复。然后，使用分数蒸馏采样（SDS）交替更新每个布局引导牙齿和整个颌的高斯参数。此外，引入了基于相邻牙齿和锚定牙齿的 3D 高斯之间的距离的正则化项来惩罚牙齿相交。三个牙齿设计数据集的实验结果表明，与现有方法相比，我们的方法显着提高了生成牙齿的多视图一致性和真实感。项目页面：此 https URL。

Title: RAGTrack: Language-aware RGBT Tracking with Retrieval-Augmented Generation

• Authors: Hao Li, Yuhao Wang, Wenning Hao, Pingping Zhang, Dong Wang, Huchuan Lu
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.03617
• Pdf URL: https://arxiv.org/pdf/2603.03617
• Copy Paste: [[2603.03617]] RAGTrack: Language-aware RGBT Tracking with Retrieval-Augmented Generation(https://arxiv.org/abs/2603.03617)
• Keywords: generation
• Abstract: RGB-Thermal (RGBT) tracking aims to achieve robust object localization across diverse environmental conditions by fusing visible and thermal infrared modalities. However, existing RGBT trackers rely solely on initial-frame visual information for target modeling, failing to adapt to appearance variations due to the absence of language guidance. Furthermore, current methods suffer from redundant search regions and heterogeneous modality gaps, causing background distraction. To address these issues, we first introduce textual descriptions into RGBT tracking benchmarks. This is accomplished through a pipeline that leverages Multi-modal Large Language Models (MLLMs) to automatically produce texual annotations. Afterwards, we propose RAGTrack, a novel Retrieval-Augmented Generation framework for robust RGBT tracking. To this end, we introduce a Multi-modal Transformer Encoder (MTE) for unified visual-language modeling. Then, we design an Adaptive Token Fusion (ATF) to select target-relevant tokens and perform channel exchanges based on cross-modal correlations, mitigating search redundancies and modality gaps. Finally, we propose a Context-aware Reasoning Module (CRM) to maintain a dynamic knowledge base and employ a Retrieval-Augmented Generation (RAG) to enable temporal linguistic reasoning for robust target modeling. Extensive experiments on four RGBT benchmarks demonstrate that our framework achieves state-of-the-art performance across various challenging scenarios. The source code is available this https URL.
• 摘要：RGB 热 (RGBT) 跟踪旨在通过融合可见光和热红外模式，在不同的环境条件下实现稳健的对象定位。然而，现有的 RGBT 跟踪器仅依赖初始帧视觉信息进行目标建模，由于缺乏语言指导而无法适应外观变化。此外，当前的方法存在冗余搜索区域和异构模态间隙，导致背景干扰。为了解决这些问题，我们首先将文本描述引入 RGBT 跟踪基准测试中。这是通过利用多模式大型语言模型 (MLLM) 自动生成文本注释的管道来完成的。之后，我们提出了 RAGTrack，一种新颖的检索增强生成框架，用于稳健的 RGBT 跟踪。为此，我们引入了用于统一视觉语言建模的多模态转换器编码器（MTE）。然后，我们设计了自适应令牌融合（ATF）来选择目标相关令牌并基于跨模态相关性执行通道交换，从而减少搜索冗余和模态差距。最后，我们提出了上下文感知推理模块（CRM）来维护动态知识库，并采用检索增强生成（RAG）来实现时间语言推理以实现稳健的目标建模。对四个 RGBT 基准的大量实验表明，我们的框架在各种具有挑战性的场景中实现了最先进的性能。源代码可通过 https URL 获取。

Title: InfinityStory: Unlimited Video Generation with World Consistency and Character-Aware Shot Transitions

• Authors: Mohamed Elmoghany, Liangbing Zhao, Xiaoqian Shen, Subhojyoti Mukherjee, Yang Zhou, Gang Wu, Viet Dac Lai, Seunghyun Yoon, Ryan Rossi, Abdullah Rashwan, Puneet Mathur, Varun Manjunatha, Daksh Dangi, Chien Nguyen, Nedim Lipka, Trung Bui, Krishna Kumar Singh, Ruiyi Zhang, Xiaolei Huang, Jaemin Cho, Yu Wang, Namyong Park, Zhengzhong Tu, Hongjie Chen, Hoda Eldardiry, Nesreen Ahmed, Thien Nguyen, Dinesh Manocha, Mohamed Elhoseiny, Franck Dernoncourt
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.03646
• Pdf URL: https://arxiv.org/pdf/2603.03646
• Copy Paste: [[2603.03646]] InfinityStory: Unlimited Video Generation with World Consistency and Character-Aware Shot Transitions(https://arxiv.org/abs/2603.03646)
• Keywords: generation
• Abstract: Generating long-form storytelling videos with consistent visual narratives remains a significant challenge in video synthesis. We present a novel framework, dataset, and a model that address three critical limitations: background consistency across shots, seamless multi-subject shot-to-shot transitions, and scalability to hour-long narratives. Our approach introduces a background-consistent generation pipeline that maintains visual coherence across scenes while preserving character identity and spatial relationships. We further propose a transition-aware video synthesis module that generates smooth shot transitions for complex scenarios involving multiple subjects entering or exiting frames, going beyond the single-subject limitations of prior work. To support this, we contribute with a synthetic dataset of 10,000 multi-subject transition sequences covering underrepresented dynamic scene compositions. On VBench, InfinityStory achieves the highest Background Consistency (88.94), highest Subject Consistency (82.11), and the best overall average rank (2.80), showing improved stability, smoother transitions, and better temporal coherence.
• 摘要：生成具有一致视觉叙事的长篇故事视频仍然是视频合成中的重大挑战。我们提出了一个新颖的框架、数据集和模型，解决了三个关键限制：镜头之间的背景一致性、无缝的多主题镜头过渡以及长达一小时叙事的可扩展性。我们的方法引入了背景一致的生成管道，可以保持场景之间的视觉连贯性，同时保留角色身份和空间关系。我们进一步提出了一种过渡感知视频合成模块，可以为涉及多个主体进入或退出帧的复杂场景生成平滑的镜头过渡，超越了先前工作的单一主体限制。为了支持这一点，我们贡献了一个包含 10,000 个多主体过渡序列的合成数据集，涵盖了代表性不足的动态场景组合。在 VBench 上，InfinityStory 实现了最高的背景一致性 (88.94)、最高的主题一致性 (82.11) 和最佳的总体平均排名 (2.80)，显示出更高的稳定性、更平滑的过渡和更好的时间连贯性。

Title: One-Step Face Restoration via Shortcut-Enhanced Coupling Flow

• Authors: Xiaohui Sun, Hanlin Wu
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.03648
• Pdf URL: https://arxiv.org/pdf/2603.03648
• Copy Paste: [[2603.03648]] One-Step Face Restoration via Shortcut-Enhanced Coupling Flow(https://arxiv.org/abs/2603.03648)
• Keywords: restoration, generative
• Abstract: Face restoration has advanced significantly with generative models like diffusion models and flow matching (FM), which learn continuous-time mappings between distributions. However, existing FM-based approaches often start from Gaussian noise, ignoring the inherent dependency between low-quality (LQ) and high-quality (HQ) data, resulting in path crossovers, curved trajectories, and multi-step sampling requirements. To address these issues, we propose Shortcut-enhanced Coupling flow for Face Restoration (SCFlowFR). First, it establishes a \textit{data-dependent coupling} that explicitly models the LQ--HQ dependency, minimizing path crossovers and promoting near-linear transport. Second, we employ conditional mean estimation to obtain a coarse prediction that refines the source anchor to tighten coupling and conditions the velocity field to stabilize large-step updates. Third, a shortcut constraint supervises average velocities over arbitrary time intervals, enabling accurate one-step inference. Experiments demonstrate that SCFlowFR achieves state-of-the-art one-step face restoration quality with inference speed comparable to traditional non-diffusion methods.
• 摘要：借助扩散模型和流匹配 (FM) 等生成模型，人脸恢复取得了显着进展，这些模型学习分布之间的连续时间映射。然而，现有的基于 FM 的方法通常从高斯噪声开始，忽略了低质量（LQ）和高质量（HQ）数据之间的固有依赖性，导致路径交叉、弯曲轨迹和多步采样要求。为了解决这些问题，我们提出了面部恢复的快捷增强耦合流程（SCFlowFR）。首先，它建立了一个 \textit{数据依赖耦合}，明确地模拟 LQ-HQ 依赖关系，最大限度地减少路径交叉并促进近线性传输。其次，我们采用条件均值估计来获得粗略预测，从而细化源锚点以加强耦合并调节速度场以稳定大步长更新。第三，快捷约束监督任意时间间隔内的平均速度，从而实现准确的一步推理。实验表明，SCFlowFR 实现了最先进的一步人脸恢复质量，推理速度可与传统非扩散方法相媲美。

Title: InEdit-Bench: Benchmarking Intermediate Logical Pathways for Intelligent Image Editing Models

• Authors: Zhiqiang Sheng, Xumeng Han, Zhiwei Zhang, Zenghui Xiong, Yifan Ding, Aoxiang Ping, Xiang Li, Tong Guo, Yao Mao
• Subjects: cs.CV, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.03657
• Pdf URL: https://arxiv.org/pdf/2603.03657
• Copy Paste: [[2603.03657]] InEdit-Bench: Benchmarking Intermediate Logical Pathways for Intelligent Image Editing Models(https://arxiv.org/abs/2603.03657)
• Keywords: generative
• Abstract: Multimodal generative models have made significant strides in image editing, demonstrating impressive performance on a variety of static tasks. However, their proficiency typically does not extend to complex scenarios requiring dynamic reasoning, leaving them ill-equipped to model the coherent, intermediate logical pathways that constitute a multi-step evolution from an initial state to a final one. This capacity is crucial for unlocking a deeper level of procedural and causal understanding in visual manipulation. To systematically measure this critical limitation, we introduce InEdit-Bench, the first evaluation benchmark dedicated to reasoning over intermediate pathways in image editing. InEdit-Bench comprises meticulously annotated test cases covering four fundamental task categories: state transition, dynamic process, temporal sequence, and scientific simulation. Additionally, to enable fine-grained evaluation, we propose a set of assessment criteria to evaluate the logical coherence and visual naturalness of the generated pathways, as well as the model's fidelity to specified path constraints. Our comprehensive evaluation of 14 representative image editing models on InEdit-Bench reveals significant and widespread shortcomings in this domain. By providing a standardized and challenging benchmark, we aim for InEdit-Bench to catalyze research and steer development towards more dynamic, reason-aware, and intelligent multimodal generative models.
• 摘要：多模态生成模型在图像编辑方面取得了重大进展，在各种静态任务上展示了令人印象深刻的性能。然而，他们的熟练程度通常不会扩展到需要动态推理的复杂场景，这使得他们无法对构成从初始状态到最终状态的多步演化的连贯的中间逻辑路径进行建模。这种能力对于解锁视觉操纵中更深层次的程序和因果理解至关重要。为了系统地衡量这一关键限制，我们引入了 InEdit-Bench，这是第一个致力于对图像编辑中的中间路径进行推理的评估基准。 InEdit-Bench 包含精心注释的测试用例，涵盖四个基本任务类别：状态转换、动态过程、时间序列和科学模拟。此外，为了实现细粒度的评估，我们提出了一套评估标准来评估生成路径的逻辑一致性和视觉自然度，以及模型对指定路径约束的保真度。我们在 InEdit-Bench 上对 14 个代表性图像编辑模型的综合评估揭示了该领域的重大且普遍的缺陷。通过提供标准化和具有挑战性的基准，我们的目标是 InEdit-Bench 促进研究并引导开发走向更加动态、理性感知和智能的多模式生成模型。

Title: A Stein Identity for q-Gaussians with Bounded Support

• Authors: Sophia Sklaviadis, Thomas Moellenhoff, Andre F. T. Martins, Mario A. T. Figueiredo, Mohammad Emtiyaz Khan
• Subjects: cs.LG, stat.ML
• Abstract URL: https://arxiv.org/abs/2603.03673
• Pdf URL: https://arxiv.org/pdf/2603.03673
• Copy Paste: [[2603.03673]] A Stein Identity for q-Gaussians with Bounded Support(https://arxiv.org/abs/2603.03673)
• Keywords: generative
• Abstract: Stein's identity is a fundamental tool in machine learning with applications in generative models, stochastic optimization, and other problems involving gradients of expectations under Gaussian distributions. Less attention has been paid to problems with non-Gaussian expectations. Here, we consider the class of bounded-support $q$-Gaussians and derive a new Stein identity leading to gradient estimators which have nearly identical forms to the Gaussian ones, and which are similarly easy to implement. We do this by extending the previous results of Landsman, Vanduffel, and Yao (2013) to prove new Bonnet- and Price-type theorems for q-Gaussians. We also simplify their forms by using escort distributions. Our experiments show that bounded-support distributions can reduce the variance of gradient estimators, which can potentially be useful for Bayesian deep learning and sharpness-aware minimization. Overall, our work simplifies the application of Stein's identity for an important class of non-Gaussian distributions.
• 摘要：斯坦因恒等式是机器学习的基本工具，可应用于生成模型、随机优化以及涉及高斯分布下期望梯度的其他问题。对非高斯期望问题的关注较少。在这里，我们考虑有界支持$q$-高斯类，并推导出一个新的斯坦因恒等式，导致梯度估计器具有与高斯估计器几乎相同的形式，并且同样易于实现。我们通过扩展 Landsman、Vanduffel 和 Yao (2013) 先前的结果来证明 q-高斯的新 Bonnet 型和 Price 型定理来做到这一点。我们还通过使用护送分布来简化它们的形式。我们的实验表明，有界支持分布可以减少梯度估计器的方差，这可能对贝叶斯深度学习和锐度感知最小化有用。总的来说，我们的工作简化了斯坦因恒等式对于一类重要的非高斯分布的应用。

Title: Error as Signal: Stiffness-Aware Diffusion Sampling via Embedded Runge-Kutta Guidance

• Authors: Inho Kong, Sojin Lee, Youngjoon Hong, Hyunwoo J. Kim
• Subjects: cs.CV, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.03692
• Pdf URL: https://arxiv.org/pdf/2603.03692
• Copy Paste: [[2603.03692]] Error as Signal: Stiffness-Aware Diffusion Sampling via Embedded Runge-Kutta Guidance(https://arxiv.org/abs/2603.03692)
• Keywords: generation
• Abstract: Classifier-Free Guidance (CFG) has established the foundation for guidance mechanisms in diffusion models, showing that well-designed guidance proxies significantly improve conditional generation and sample quality. Autoguidance (AG) has extended this idea, but it relies on an auxiliary network and leaves solver-induced errors unaddressed. In stiff regions, the ODE trajectory changes sharply, where local truncation error (LTE) becomes a critical factor that deteriorates sample quality. Our key observation is that these errors align with the dominant eigenvector, motivating us to leverage the solver-induced error as a guidance signal. We propose Embedded Runge-Kutta Guidance (ERK-Guid), which exploits detected stiffness to reduce LTE and stabilize sampling. We theoretically and empirically analyze stiffness and eigenvector estimators with solver errors to motivate the design of ERK-Guid. Our experiments on both synthetic datasets and the popular benchmark dataset, ImageNet, demonstrate that ERK-Guid consistently outperforms state-of-the-art methods. Code is available at this https URL.
• 摘要：无分类器指导 (CFG) 为扩散模型中的指导机制奠定了基础，表明精心设计的指导代理可显着提高条件生成和样本质量。自动制导 (AG) 扩展了这一想法，但它依赖于辅助网络，并且无法解决求解器引起的错误。在刚性区域中，ODE 轨迹急剧变化，其中局部截断误差 (LTE) 成为降低样本质量的关键因素。我们的主要观察结果是，这些误差与主要特征向量一致，激励我们利用求解器引起的误差作为指导信号。我们提出了嵌入式龙格-库塔指南（ERK-Guid），它利用检测到的刚度来减少 LTE 并稳定采样。我们从理论上和实证上分析了具有求解器误差的刚度和特征向量估计器，以激发 ERK-Guid 的设计。我们对合成数据集和流行的基准数据集 ImageNet 进行的实验表明，ERK-Guid 始终优于最先进的方法。代码可从此 https URL 获取。

Title: MPFlow: Multi-modal Posterior-Guided Flow Matching for Zero-Shot MRI Reconstruction

• Authors: Seunghoi Kim, Chen Jin, Henry F. J. Tregidgo, Matteo Figini, Daniel C. Alexander
• Subjects: cs.CV, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.03710
• Pdf URL: https://arxiv.org/pdf/2603.03710
• Copy Paste: [[2603.03710]] MPFlow: Multi-modal Posterior-Guided Flow Matching for Zero-Shot MRI Reconstruction(https://arxiv.org/abs/2603.03710)
• Keywords: generative
• Abstract: Zero-shot MRI reconstruction relies on generative priors, but single-modality unconditional priors produce hallucinations under severe ill-posedness. In many clinical workflows, complementary MRI acquisitions (e.g. high-quality structural scans) are routinely available, yet existing reconstruction methods lack mechanisms to leverage this additional information. We propose MPFlow, a zero-shot multi-modal reconstruction framework built on rectified flow that incorporates auxiliary MRI modalities at inference time without retraining the generative prior to improve anatomical fidelity. Cross-modal guidance is enabled by our proposed self-supervised pretraining strategy, Patch-level Multi-modal MR Image Pretraining (PAMRI), which learns shared representations across modalities. Sampling is jointly guided by data consistency and cross-modal feature alignment using pre-trained PAMRI, systematically suppressing intrinsic and extrinsic hallucinations. Extensive experiments on HCP and BraTS show that MPFlow matches diffusion baselines on image quality using only 20% of sampling steps while reducing tumor hallucinations by more than 15% (segmentation dice score). This demonstrates that cross-modal guidance enables more reliable and efficient zero-shot MRI reconstruction.
• 摘要：零样本 MRI 重建依赖于生成先验，但单模态无条件先验会在严重不适定情况下产生幻觉。在许多临床工作流程中，补充 MRI 采集（例如高质量结构扫描）通常是可用的，但现有的重建方法缺乏利用这些附加信息的机制。我们提出了 MPFlow，一种基于校正流构建的零样本多模态重建框架，它在推理时结合了辅助 MRI 模态，而无需重新训练生成器以提高解剖保真度。跨模态指导是通过我们提出的自监督预训练策略、补丁级多模态 MR 图像预训练 (PAMRI) 实现的，该策略学习跨模态的共享表示。采样由数据一致性和使用预先训练的 PAMRI 的跨模式特征对齐联合指导，系统地抑制内在和外在的幻觉。 HCP 和 BraTS 上的大量实验表明，MPFlow 仅使用 20% 的采样步骤即可在图像质量上匹配扩散基线，同时将肿瘤幻觉减少 15% 以上（分割骰子评分）。这表明跨模态引导能够实现更可靠、更高效的零次 MRI 重建。

Title: QD-PCQA: Quality-Aware Domain Adaptation for Point Cloud Quality Assessment

• Authors: Guohua Zhang, Jian Jin, Meiqin Liu, Chao Yao, Weisi Lin
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.03726
• Pdf URL: https://arxiv.org/pdf/2603.03726
• Copy Paste: [[2603.03726]] QD-PCQA: Quality-Aware Domain Adaptation for Point Cloud Quality Assessment(https://arxiv.org/abs/2603.03726)
• Keywords: quality assessment
• Abstract: No-Reference Point Cloud Quality Assessment (NR-PCQA) still struggles with generalization, primarily due to the scarcity of annotated point cloud datasets. Since the Human Visual System (HVS) drives perceptual quality assessment independently of media types, prior knowledge on quality learned from images can be repurposed for point clouds. This insight motivates adopting Unsupervised Domain Adaptation (UDA) to transfer quality-relevant priors from labeled images to unlabeled point clouds. However, existing UDA-based PCQA methods often overlook key characteristics of perceptual quality, such as sensitivity to quality ranking and quality-aware feature alignment, thereby limiting their effectiveness. To address these issues, we propose a novel Quality-aware Domain adaptation framework for PCQA, termed QD-PCQA. The framework comprises two main components: i) a Rank-weighted Conditional Alignment (RCA) strategy that aligns features under consistent quality levels and adaptively emphasizes misranked samples to reinforce perceptual quality ranking awareness; and ii) a Quality-guided Feature Augmentation (QFA) strategy, which includes quality-guided style mixup, multi-layer extension, and dual-domain augmentation modules to augment perceptual feature alignment. Extensive cross-domain experiments demonstrate that QD-PCQA significantly improves generalization in NR-PCQA tasks. The code is available at this https URL.
• 摘要：无参考点云质量评估（NR-PCQA）仍然难以泛化，这主要是由于带注释的点云数据集的稀缺。由于人类视觉系统 (HVS) 独立于媒体类型驱动感知质量评估，因此从图像中学习到的有关质量的先验知识可以重新用于点云。这种见解促使采用无监督域适应（UDA）将质量相关的先验从标记图像转移到未标记点云。然而，现有的基于 UDA 的 PCQA 方法经常忽视感知质量的关键特征，例如对质量排名的敏感性和质量感知特征对齐，从而限制了其有效性。为了解决这些问题，我们提出了一种新颖的 PCQA 质量感知域适应框架，称为 QD-PCQA。该框架包括两个主要组成部分：i）排名加权条件对齐（RCA）策略，该策略在一致的质量水平下对齐特征，并自适应地强调错误排名的样本，以加强感知质量排名意识； ii）质量引导的特征增强（QFA）策略，其中包括质量引导的风格混合、多层扩展和双域增强模块，以增强感知特征对齐。广泛的跨域实验表明，QD-PCQA 显着提高了 NR-PCQA 任务的泛化能力。该代码可从此 https URL 获取。

Title: JANUS: Structured Bidirectional Generation for Guaranteed Constraints and Analytical Uncertainty

• Authors: Taha Racicot
• Subjects: cs.LG, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.03748
• Pdf URL: https://arxiv.org/pdf/2603.03748
• Copy Paste: [[2603.03748]] JANUS: Structured Bidirectional Generation for Guaranteed Constraints and Analytical Uncertainty(https://arxiv.org/abs/2603.03748)
• Keywords: generation, generative
• Abstract: High-stakes synthetic data generation faces a fundamental Quadrilemma: achieving Fidelity to the original distribution, Control over complex logical constraints, Reliability in uncertainty estimation, and Efficiency in computational cost -- simultaneously. State-of-the-art Deep Generative Models (CTGAN, TabDDPM) excel at fidelity but rely on inefficient rejection sampling for continuous range constraints. Conversely, Structural Causal Models offer logical control but struggle with high-dimensional fidelity and complex noise inversion. We introduce JANUS (Joint Ancestral Network for Uncertainty and Synthesis), a framework that unifies these capabilities using a DAG of Bayesian Decision Trees. Our key innovation is Reverse-Topological Back-filling, an algorithm that propagates constraints backwards through the causal graph, achieving 100% constraint satisfaction on feasible constraint sets without rejection sampling. This is paired with an Analytical Uncertainty Decomposition derived from Dirichlet priors, enabling 128x faster uncertainty estimation than Monte Carlo methods. Across 15 datasets and 523 constrained scenarios, JANUS achieves state-of-the-art fidelity (Detection Score 0.497), eliminates mode collapse on imbalanced data, and provides exact handling of complex inter-column constraints (e.g., Salary_offered >= Salary_requested) where baselines fail entirely.
• 摘要：高风险的合成数据生成面临着一个基本的四难困境：同时实现对原始分布的保真度、对复杂逻辑约束的控制、不确定性估计的可靠性以及计算成本的效率。最先进的深度生成模型（CTGAN、TabDDPM）在保真度方面表现出色，但依赖低效的拒绝采样来实现连续范围约束。相反，结构因果模型提供逻辑控制，但难以应对高维保真度和复杂的噪声反演。我们引入 JANUS（不确定性和综合联合祖先网络），这是一个使用贝叶斯决策树 DAG 统一这些功能的框架。我们的关键创新是反向拓扑回填，这是一种通过因果图向后传播约束的算法，无需拒绝采样即可在可行约束集上实现 100% 的约束满足。与源自狄利克雷先验的分析不确定性分解相结合，使不确定性估计速度比蒙特卡罗方法快 128 倍。在 15 个数据集和 523 个受限场景中，JANUS 实现了最先进的保真度（检测分数 0.497），消除了不平衡数据上的模式崩溃，并在基线完全失败的情况下精确处理复杂的列间约束（例如，Salary_offered >= Salary_requested）。

Title: MOOSE-Star: Unlocking Tractable Training for Scientific Discovery by Breaking the Complexity Barrier

• Authors: Zonglin Yang, Lidong Bing
• Subjects: cs.LG, cs.CE, cs.CL
• Abstract URL: https://arxiv.org/abs/2603.03756
• Pdf URL: https://arxiv.org/pdf/2603.03756
• Copy Paste: [[2603.03756]] MOOSE-Star: Unlocking Tractable Training for Scientific Discovery by Breaking the Complexity Barrier(https://arxiv.org/abs/2603.03756)
• Keywords: generative
• Abstract: While large language models (LLMs) show promise in scientific discovery, existing research focuses on inference or feedback-driven training, leaving the direct modeling of the generative reasoning process, $P(\text{hypothesis}|\text{background})$ ($P(h|b)$), unexplored. We demonstrate that directly training $P(h|b)$ is mathematically intractable due to the combinatorial complexity ($O(N^k)$) inherent in retrieving and composing inspirations from a vast knowledge base. To break this barrier, we introduce MOOSE-Star, a unified framework enabling tractable training and scalable inference. In the best case, MOOSE-Star reduces complexity from exponential to logarithmic ($O(\log N)$) by (1) training on decomposed subtasks derived from the probabilistic equation of discovery, (2) employing motivation-guided hierarchical search to enable logarithmic retrieval and prune irrelevant subspaces, and (3) utilizing bounded composition for robustness against retrieval noise. To facilitate this, we release TOMATO-Star, a dataset of 108,717 decomposed papers (38,400 GPU hours) for training. Furthermore, we show that while brute-force sampling hits a ''complexity wall,'' MOOSE-Star exhibits continuous test-time scaling.
• 摘要：虽然大型语言模型 (LLM) 在科学发现方面显示出前景，但现有研究侧重于推理或反馈驱动的训练，而对生成推理过程的直接建模 $P(\text{hypothesis}|\text{background})$ ($P(h|b)$) 尚未进行探索。我们证明，由于从庞大的知识库中检索和组合灵感所固有的组合复杂性 ($O(N^k)$)，直接训练 $P(h|b)$ 在数学上是棘手的。为了打破这一障碍，我们引入了 MOOSE-Star，这是一个统一的框架，可实现易于处理的训练和可扩展的推理。在最好的情况下，MOOSE-Star 通过以下方式将复杂性从指数降低到对数 ($O(\log N)$)：(1) 对从发现概率方程派生的分解子任务进行训练，(2) 采用动机引导的分层搜索来实现对数检索并修剪不相关的子空间，以及 (3) 利用有界组合来增强对抗检索噪声的鲁棒性。为了实现这一目标，我们发布了 TOMATO-Star，这是一个包含 108,717 篇分解论文（38,400 个 GPU 小时）的数据集，用于训练。此外，我们还表明，虽然强力采样遇到了“复杂性墙”，但 MOOSE-Star 表现出了连续的测试时间缩放。

Title: TAP: A Token-Adaptive Predictor Framework for Training-Free Diffusion Acceleration

• Authors: Haowei Zhu, Tingxuan Huang, Xing Wang, Tianyu Zhao, Jiexi Wang, Weifeng Chen, Xurui Peng, Fangmin Chen, Junhai Yong, Bin Wang
• Subjects: cs.CV, cs.LG
• Abstract URL: https://arxiv.org/abs/2603.03792
• Pdf URL: https://arxiv.org/pdf/2603.03792
• Copy Paste: [[2603.03792]] TAP: A Token-Adaptive Predictor Framework for Training-Free Diffusion Acceleration(https://arxiv.org/abs/2603.03792)
• Keywords: generation, generative
• Abstract: Diffusion models achieve strong generative performance but remain slow at inference due to the need for repeated full-model denoising passes. We present Token-Adaptive Predictor (TAP), a training-free, probe-driven framework that adaptively selects a predictor for each token at every sampling step. TAP uses a single full evaluation of the model's first layer as a low-cost probe to compute proxy losses for a compact family of candidate predictors (instantiated primarily with Taylor expansions of varying order and horizon), then assigns each token the predictor with the smallest proxy error. This per-token "probe-then-select" strategy exploits heterogeneous temporal dynamics, requires no additional training, and is compatible with various predictor designs. TAP incurs negligible overhead while enabling large speedups with little or no perceptual quality loss. Extensive experiments across multiple diffusion architectures and generation tasks show that TAP substantially improves the accuracy-efficiency frontier compared to fixed global predictors and caching-only baselines.
• 摘要：扩散模型实现了强大的生成性能，但由于需要重复的全模型去噪过程，推理速度仍然缓慢。我们提出了令牌自适应预测器（TAP），这是一个免训练、探针驱动的框架，可以在每个采样步骤为每个令牌自适应地选择一个预测器。 TAP 使用模型第一层的单个完整评估作为低成本探针来计算候选预测变量的紧凑系列的代理损失（主要通过不同阶数和范围的泰勒展开来实例化），然后为每个标记分配具有最小代理误差的预测变量。这种每个令牌的“探测然后选择”策略利用异构时间动态，不需要额外的训练，并且与各种预测器设计兼容。 TAP 产生的开销可以忽略不计，同时可以实现大幅加速，而感知质量损失很小或没有。跨多个扩散架构和生成任务的大量实验表明，与固定的全局预测器和仅缓存基线相比，TAP 大大提高了准确性-效率边界。

Title: All-in-One Image Restoration via Causal-Deconfounding Wavelet-Disentangled Prompt Network

• Authors: Bingnan Wang, Bin Qin, Jiangmeng Li, Fanjiang Xu, Fuchun Sun, Hui Xiong
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.03839
• Pdf URL: https://arxiv.org/pdf/2603.03839
• Copy Paste: [[2603.03839]] All-in-One Image Restoration via Causal-Deconfounding Wavelet-Disentangled Prompt Network(https://arxiv.org/abs/2603.03839)
• Keywords: restoration
• Abstract: Image restoration represents a promising approach for addressing the inherent defects of image content distortion. Standard image restoration approaches suffer from high storage cost and the requirement towards the known degradation pattern, including type and degree, which can barely be satisfied in dynamic practical scenarios. In contrast, all-in-one image restoration (AiOIR) eliminates multiple degradations within a unified model to circumvent the aforementioned issues. However, according to our causal analysis, we disclose that two significant defects still exacerbate the effectiveness and generalization of AiOIR models: 1) the spurious correlation between non-degradation semantic features and degradation patterns; 2) the biased estimation of degradation patterns. To obtain the true causation between degraded images and restored images, we propose Causal-deconfounding Wavelet-disentangled Prompt Network (CWP-Net) to perform effective AiOIR. CWP-Net introduces two modules for decoupling, i.e., wavelet attention module of encoder and wavelet attention module of decoder. These modules explicitly disentangle the degradation and semantic features to tackle the issue of spurious correlation. To address the issue stemming from the biased estimation of degradation patterns, CWP-Net leverages a wavelet prompt block to generate the alternative variable for causal deconfounding. Extensive experiments on two all-in-one settings prove the effectiveness and superior performance of our proposed CWP-Net over the state-of-the-art AiOIR methods.
• 摘要：图像恢复是解决图像内容失真的固有缺陷的一种有前途的方法。标准的图像恢复方法面临着高存储成本和对已知退化模式（包括类型和程度）的要求，这在动态实际场景中几乎不能满足。相比之下，一体式图像恢复（AiOIR）消除了统一模型内的多重退化，从而规避了上述问题。然而，根据我们的因果分析，我们发现两个重大缺陷仍然加剧了 AiOIR 模型的有效性和泛化性：1）非退化语义特征和退化模式之间的虚假相关性； 2）退化模式的有偏估计。为了获得退化图像和恢复图像之间的真实因果关系，我们提出因果解混小波解缠提示网络（CWP-Net）来执行有效的 AiOIR。 CWP-Net引入了两个模块进行解耦，即编码器的小波注意力模块和解码器的小波注意力模块。这些模块明确地解开了退化和语义特征，以解决虚假相关问题。为了解决退化模式估计偏差带来的问题，CWP-Net 利用小波提示块来生成用于因果解混的替代变量。对两种一体化设置的大量实验证明了我们提出的 CWP-Net 相对于最先进的 AiOIR 方法的有效性和优越性能。

Title: DISC: Dense Integrated Semantic Context for Large-Scale Open-Set Semantic Mapping

• Authors: Felix Igelbrink, Lennart Niecksch, Martin Atzmueller, Joachim Hertzberg
• Subjects: cs.CV, cs.RO
• Abstract URL: https://arxiv.org/abs/2603.03935
• Pdf URL: https://arxiv.org/pdf/2603.03935
• Copy Paste: [[2603.03935]] DISC: Dense Integrated Semantic Context for Large-Scale Open-Set Semantic Mapping(https://arxiv.org/abs/2603.03935)
• Keywords: generation
• Abstract: Open-set semantic mapping enables language-driven robotic perception, but current instance-centric approaches are bottlenecked by context-depriving and computationally expensive crop-based feature extraction. To overcome this fundamental limitation, we introduce DISC (Dense Integrated Semantic Context), featuring a novel single-pass, distance-weighted extraction mechanism. By deriving high-fidelity CLIP embeddings directly from the vision transformer's intermediate layers, our approach eliminates the latency and domain-shift artifacts of traditional image cropping, yielding pure, mask-aligned semantic representations. To fully leverage these features in large-scale continuous mapping, DISC is built upon a fully GPU-accelerated architecture that replaces periodic offline processing with precise, on-the-fly voxel-level instance refinement. We evaluate our approach on standard benchmarks (Replica, ScanNet) and a newly generated large-scale-mapping dataset based on Habitat-Matterport 3D (HM3DSEM) to assess scalability across complex scenes in multi-story buildings. Extensive evaluations demonstrate that DISC significantly surpasses current state-of-the-art zero-shot methods in both semantic accuracy and query retrieval, providing a robust, real-time capable framework for robotic deployment. The full source code, data generation and evaluation pipelines will be made available at this https URL.
• 摘要：开放集语义映射可以实现语言驱动的机器人感知，但当前以实例为中心的方法受到上下文剥夺和计算成本昂贵的基于作物的特征提取的瓶颈。为了克服这一基本限制，我们引入了 DISC（密集集成语义上下文），其具有新颖的单通道、距离加权提取机制。通过直接从视觉转换器的中间层导出高保真 CLIP 嵌入，我们的方法消除了传统图像裁剪的延迟和域移位伪影，产生纯粹的、掩模对齐的语义表示。为了在大规模连续映射中充分利用这些功能，DISC 基于完全 GPU 加速的架构构建，该架构用精确的动态体素级实例细化取代定期离线处理。我们在标准基准（Replica、ScanNet）和基于 Habitat-Matterport 3D (HM3DSEM) 的新生成的大规模测绘数据集上评估我们的方法，以评估多层建筑中复杂场景的可扩展性。广泛的评估表明，DISC 在语义准确性和查询检索方面都显着超越了当前最先进的零样本方法，为机器人部署提供了强大的实时框架。完整的源代码、数据生成和评估管道将在此 https URL 上提供。

Title: Slice-wise quality assessment of high b-value breast DWI via deep learning-based artifact detection

• Authors: Ameya Markale, Luise Brock, Ihor Horishnyi, Dominika Skwierawska, Tri-Thien Nguyen, Hannes Schreiter, Shirin Heidarikahkesh, Lorenz A. Kapsner, Michael Uder, Sabine Ohlmeyer, Frederik B Laun, Andrzej Liebert, Sebastian Bickelhaupt
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.03941
• Pdf URL: https://arxiv.org/pdf/2603.03941
• Copy Paste: [[2603.03941]] Slice-wise quality assessment of high b-value breast DWI via deep learning-based artifact detection(https://arxiv.org/abs/2603.03941)
• Keywords: quality assessment
• Abstract: Diffusion-weighted imaging (DWI) can support lesion detection and characterization in breast magnetic resonance imaging (MRI), however especially high b-value diffusion-weighted acquisitions can be prone to intensity artifacts that can affect diagnostic image assessment. This study aims to detect both hyper- and hypointense artifacts on high b-value diffusion-weighted images (b=1500 s/mm2) using deep learning, employing either a binary classification (artifact presence) or a multiclass classification (artifact intensity) approach on a slice-wise this http URL IRB-approved retrospective study used the single-center dataset comprising n=11806 slices from routine 3T breast MRI examinations performed between 2022 and mid-2023. Three convolutional neural network (CNN) architectures (DenseNet121, ResNet18, and SEResNet50) were trained for binary classification of hyper- and hypointense artifacts. The best performing model (DenseNet121) was applied to an independent holdout test set and was further trained separately for multiclass classification. Evaluation included area under receiver operating characteristic curve (AUROC), area under precision recall curve (AUPRC), precision, and recall, as well as analysis of predicted bounding box positions, derived from the network Grad-CAM heatmaps. DenseNet121 achieved AUROCs of 0.92 and 0.94 for hyper- and hypointense artifact detection, respectively, and weighted AUROCs of 0.85 and 0.88 for multiclass classification on single-slice high b-value diffusion-weighted images. A radiologist evaluated bounding box precision on a 1-5 Likert-like scale across 200 slices, achieving mean scores of 3.33+-1.04 for hyperintense artifacts and 2.62+-0.81 for hypointense artifacts. Hyper- and hypointense artifact detection in slice-wise breast DWI MRI dataset (b=1500 s/mm2) using CNNs particularly DenseNet121, seems promising and requires further validation.
• 摘要：扩散加权成像 (DWI) 可以支持乳腺磁共振成像 (MRI) 中的病变检测和表征，但是，特别高 b 值的扩散加权采集可能容易出现强度伪影，从而影响诊断图像评估。本研究旨在使用深度学习检测高 b 值扩散加权图像 (b=1500 s/mm2) 上的高信号和低信号伪影，在切片上采用二元分类（伪影存在）或多类分类（伪影强度）方法。此 http URL IRB 批准的回顾性研究使用单中心数据集，其中包含来自 2022 年至 2022 年之间进行的常规 3T 乳腺 MRI 检查的 n=11806 个切片。 2023 年中。三个卷积神经网络 (CNN) 架构（DenseNet121、ResNet18 和 SEResNet50）经过训练，用于高信号和低信号伪影的二元分类。将性能最佳的模型 (DenseNet121) 应用于独立的保留测试集，并进一步单独训练以进行多类分类。评估包括接收者操作特征曲线下面积 (AUROC)、精确召回曲线下面积 (AUPRC)、精确度和召回，以及从网络 Grad-CAM 热图导出的预测边界框位置分析。 DenseNet121 在高信号和低信号伪影检测方面分别实现了 0.92 和 0.94 的 AUROC，在单切片高 b 值扩散加权图像上实现了多类分类的加权 AUROC 分别为 0.85 和 0.88。一名放射科医生在 200 个切片中以 1-5 类李克特量表评估了边界框精度，高信号伪影的平均得分为 3.33+-1.04，低信号伪影的平均得分为 2.62+-0.81。使用 CNN（特别是 DenseNet121）在切片乳房 DWI MRI 数据集 (b=1500 s/mm2) 中进行高信号和低信号伪影检测，似乎很有前景，需要进一步验证。

Title: Lang2Str: Two-Stage Crystal Structure Generation with LLMs and Continuous Flow Models

• Authors: Cong Liu, Chengyue Gong, Zhenyu Liu, Jiale Zhao, Yuxuan Zhang
• Subjects: cs.LG
• Abstract URL: https://arxiv.org/abs/2603.03946
• Pdf URL: https://arxiv.org/pdf/2603.03946
• Copy Paste: [[2603.03946]] Lang2Str: Two-Stage Crystal Structure Generation with LLMs and Continuous Flow Models(https://arxiv.org/abs/2603.03946)
• Keywords: generation, generative
• Abstract: Generative models hold great promise for accelerating material discovery but are often limited by their inflexible single-stage generative process in designing valid and diverse materials. To address this, we propose a two-stage generative framework, Lang2Str, that combines the strengths of large language models (LLMs) and flow-based models for flexible and precise material generation. Our method frames the generative process as a conditional generative task, where an LLM provides high-level conditions by generating descriptions of material unit cells' geometric layouts and properties. These descriptions, informed by the LLM's extensive background knowledge, ensure reasonable structure designs. A conditioned flow model then decodes these textual conditions into precise continuous coordinates and unit cell parameters. This staged approach combines the structured reasoning of LLMs and the distribution modeling capabilities of flow models. Experimental results show that our method achieves competitive performance on \textit{ab initio} material generation and crystal structure prediction tasks, with generated structures exhibiting closer alignment to ground truth in both geometry and energy levels, surpassing state-of-the-art models. The flexibility and modularity of our framework further enable fine-grained control over the generation process, potentially leading to more efficient and customizable material design.
• 摘要：生成模型对于加速材料发现有着巨大的希望，但在设计有效和多样化的材料时往往受到其不灵活的单阶段生成过程的限制。为了解决这个问题，我们提出了一个两阶段生成框架 Lang2Str，它结合了大型语言模型 (LLM) 和基于流的模型的优势，以实现灵活而精确的材料生成。我们的方法将生成过程构建为条件生成任务，其中法学硕士通过生成材料单元几何布局和属性的描述来提供高级条件。这些描述以法学硕士广泛的背景知识为基础，确保了合理的结构设计。然后，条件流模型将这些文本条件解码为精确的连续坐标和晶胞参数。这种分阶段方法结合了法学硕士的结构化推理和流模型的分布建模功能。实验结果表明，我们的方法在 \textit{ab initio} 材料生成和晶体结构预测任务上实现了具有竞争力的性能，生成的结构在几何和能级上表现出与地面真实情况更接近的对齐，超越了最先进的模型。我们框架的灵活性和模块化进一步实现了对生成过程的细粒度控制，有可能导致更高效和可定制的材料设计。

Title: BLOCK: An Open-Source Bi-Stage MLLM Character-to-Skin Pipeline for Minecraft

• Authors: Hengquan Guo
• Subjects: cs.CV, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.03964
• Pdf URL: https://arxiv.org/pdf/2603.03964
• Copy Paste: [[2603.03964]] BLOCK: An Open-Source Bi-Stage MLLM Character-to-Skin Pipeline for Minecraft(https://arxiv.org/abs/2603.03964)
• Keywords: generation
• Abstract: We present \textbf{BLOCK}, an open-source bi-stage character-to-skin pipeline that generates pixel-perfect Minecraft skins from arbitrary character concepts. BLOCK decomposes the problem into (i) a \textbf{3D preview synthesis stage} driven by a large multimodal model (MLLM) with a carefully designed prompt-and-reference template, producing a consistent dual-panel (front/back) oblique-view Minecraft-style preview; and (ii) a \textbf{skin decoding stage} based on a fine-tuned FLUX.2 model that translates the preview into a skin atlas image. We further propose \textbf{EvolveLoRA}, a progressive LoRA curriculum (text-to-image $\rightarrow$ image-to-image $\rightarrow$ preview-to-skin) that initializes each phase from the previous adapter to improve stability and efficiency. BLOCK is released with all prompt templates and fine-tuned weights to support reproducible character-to-skin generation.
• 摘要：我们推出了 \textbf{BLOCK}，这是一个开源双级角色到皮肤管道，可以根据任意角色概念生成像素完美的 Minecraft 皮肤。 BLOCK 将问题分解为 (i) 由大型多模态模型 (MLLM) 驱动的 \textbf{3D 预览合成阶段}，并带有精心设计的提示和参考模板，生成一致的双面板（前/后）倾斜视图 Minecraft 风格的预览； (ii) 基于微调 FLUX.2 模型的 \textbf{皮肤解码阶段}，该模型将预览转换为皮肤图集图像。我们进一步提出 \textbf{EvolveLoRA}，一种渐进式 LoRA 课程（文本到图像 $\rightarrow$ 图像到图像 $\rightarrow$ 预览到皮肤），它初始化先前适配器的每个阶段，以提高稳定性和效率。 BLOCK 与所有提示模板和微调权重一起发布，以支持可复制的角色到皮肤的生成。

Title: UniRain: Unified Image Deraining with RAG-based Dataset Distillation and Multi-objective Reweighted Optimization

• Authors: Qianfeng Yang, Qiyuan Guan, Xiang Chen, Jiyu Jin, Guiyue Jin, Jiangxin Dong
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.03967
• Pdf URL: https://arxiv.org/pdf/2603.03967
• Copy Paste: [[2603.03967]] UniRain: Unified Image Deraining with RAG-based Dataset Distillation and Multi-objective Reweighted Optimization(https://arxiv.org/abs/2603.03967)
• Keywords: generation
• Abstract: Despite significant progress has been made in image deraining, we note that most existing methods are often developed for only specific types of rain degradation and fail to generalize across diverse real-world rainy scenes. How to effectively model different rain degradations within a universal framework is important for real-world image deraining. In this paper, we propose UniRain, an effective unified image deraining framework capable of restoring images degraded by rain streak and raindrop under both daytime and nighttime conditions. To better enhance unified model generalization, we construct an intelligent retrieval augmented generation (RAG)-based dataset distillation pipeline that selects high-quality training samples from all public deraining datasets for better mixed training. Furthermore, we incorporate a simple yet effective multi-objective reweighted optimization strategy into the asymmetric mixture-of-experts (MoE) architecture to facilitate consistent performance and improve robustness across diverse scenes. Extensive experiments show that our framework performs favorably against the state-of-the-art models on our proposed benchmarks and multiple public datasets.
• 摘要：尽管在图像去雨方面取得了重大进展，但我们注意到大多数现有方法通常仅针对特定类型的降雨退化而开发，并且无法泛化到不同的现实世界雨景中。如何在通用框架内有效地模拟不同的降雨退化对于现实世界的图像去雨非常重要。在本文中，我们提出了 UniRain，这是一种有效的统一图像去雨框架，能够在白天和夜间条件下恢复因雨条纹和雨滴而退化的图像。为了更好地增强统一模型的泛化能力，我们构建了一个基于智能检索增强生成（RAG）的数据集蒸馏管道，该管道从所有公共去雨数据集中选择高质量的训练样本，以实现更好的混合训练。此外，我们将简单而有效的多目标重新加权优化策略纳入非对称专家混合（MoE）架构中，以促进一致的性能并提高跨不同场景的鲁棒性。大量的实验表明，我们的框架在我们提出的基准和多个公共数据集上的表现优于最先进的模型。

Title: Dual-Solver: A Generalized ODE Solver for Diffusion Models with Dual Prediction

• Authors: Soochul Park, Yeon Ju Lee
• Subjects: cs.LG, cs.CV
• Abstract URL: https://arxiv.org/abs/2603.03973
• Pdf URL: https://arxiv.org/pdf/2603.03973
• Copy Paste: [[2603.03973]] Dual-Solver: A Generalized ODE Solver for Diffusion Models with Dual Prediction(https://arxiv.org/abs/2603.03973)
• Keywords: generation
• Abstract: Diffusion models achieve state-of-the-art image quality. However, sampling is costly at inference time because it requires a large number of function evaluations (NFEs). To reduce NFEs, classical ODE numerical methods have been adopted. Yet, the choice of prediction type and integration domain leads to different sampling behaviors. To address these issues, we introduce Dual-Solver, which generalizes multistep samplers through learnable parameters that continuously (i) interpolate among prediction types, (ii) select the integration domain, and (iii) adjust the residual terms. It retains the standard predictor-corrector structure while preserving second-order local accuracy. These parameters are learned via a classification-based objective using a frozen pretrained classifier (e.g., MobileNet or CLIP). For ImageNet class-conditional generation (DiT, GM-DiT) and text-to-image generation (SANA, PixArt-$\alpha$), Dual-Solver improves FID and CLIP scores in the low-NFE regime ($3 \le$ NFE $\le 9$) across backbones.
• 摘要：扩散模型实现了最先进的图像质量。然而，采样在推理时的成本很高，因为它需要大量的函数评估（NFE）。为了减少 NFE，采用了经典的 ODE 数值方法。然而，预测类型和积分域的选择会导致不同的采样行为。为了解决这些问题，我们引入了双求解器，它通过可学习的参数来概括多步采样器，这些参数连续地（i）在预测类型之间进行插值，（ii）选择积分域，以及（iii）调整残差项。它保留了标准的预测器-校正器结构，同时保留二阶局部精度。这些参数是使用冻结的预训练分类器（例如 MobileNet 或 CLIP）通过基于分类的目标来学习的。对于 ImageNet 类条件生成（DiT、GM-DiT）和文本到图像生成（SANA、PixArt-$\alpha$），双解算器提高了跨主干网的低 NFE 体系（$3 \le$ NFE $\le 9$）中的 FID 和 CLIP 分数。

Title: Rethinking the Efficiency and Effectiveness of Reinforcement Learning for Radiology Report Generation

• Authors: Zilin Lu, Ruifeng Yuan, Weiwei Cao, Wanxing Chang, Zhongyu Wei, Sinuo Wang, Yong Xia, Ling Zhang, Jianpeng Zhang
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.04022
• Pdf URL: https://arxiv.org/pdf/2603.04022
• Copy Paste: [[2603.04022]] Rethinking the Efficiency and Effectiveness of Reinforcement Learning for Radiology Report Generation(https://arxiv.org/abs/2603.04022)
• Keywords: generation
• Abstract: Radiologists highly desire fully automated AI for radiology report generation (R2G), yet existing approaches fall short in clinical utility. Reinforcement learning (RL) holds potential to address these shortcomings, but its adoption in this task remains underexplored. In this paper, we revisit RL in terms of data efficiency and optimization effectiveness for R2G tasks. First, we explore the impact of data quantity and quality on the performance of RL in medical contexts, revealing that data quality plays a more critical role than quantity. To this end, we propose a diagnostic diversity-based data sampling strategy that enables comparable performance with fewer samples. Second, we observe that the majority of tokens in radiology reports are template-like and diagnostically uninformative, whereas the low frequency of clinically critical tokens heightens the risk of being overlooked during optimization. To tackle this, we introduce Diagnostic Token-weighted Policy Optimization (DiTPO), which directly optimizes for clinical accuracy by using a diagnostic F1 score as the reward signal. Unlike standard RL approaches that treat all tokens equally, DiTPO explicitly models the varying importance of different tokens through rule- or gradient-based mechanisms to prioritize clinically relevant content. Extensive experiments on the MIMIC-CXR, IU-Xray, and CheXpert Plus datasets demonstrate that our framework achieves state-of-the-art (SOTA) performance while requiring substantially fewer training samples in RL. Notably, on MIMIC-CXR, our framework attains an F1 score of 0.516 using only 20% of the RL training samples.
• 摘要：放射科医生非常希望能够使用全自动 AI 生成放射学报告 (R2G)，但现有方法在临床实用性方面存在不足。强化学习（RL）有潜力解决这些缺点，但其在这项任务中的应用仍未得到充分探索。在本文中，我们从 R2G 任务的数据效率和优化有效性方面重新审视 RL。首先，我们探讨了数据数量和质量对医学环境中强化学习性能的影响，结果表明数据质量比数量发挥着更重要的作用。为此，我们提出了一种基于诊断多样性的数据采样策略，可以用更少的样本实现可比的性能。其次，我们观察到放射学报告中的大多数标记都是类似模板的并且在诊断上缺乏信息，而临床关键标记的低频率增加了在优化过程中被忽视的风险。为了解决这个问题，我们引入了诊断令牌加权策略优化（DiTPO），它通过使用诊断 F1 分数作为奖励信号来直接优化临床准确性。与平等对待所有标记的标准强化学习方法不同，DiTPO 通过基于规则或梯度的机制明确模拟不同标记的不同重要性，以优先考虑临床相关内容。在 MIMIC-CXR、IU-Xray 和 CheXpert Plus 数据集上进行的大量实验表明，我们的框架实现了最先进的 (SOTA) 性能，同时在 RL 中需要的训练样本要少得多。值得注意的是，在 MIMIC-CXR 上，我们的框架仅使用 20% 的 RL 训练样本就获得了 0.516 的 F1 分数。

Title: Volumetric Directional Diffusion: Anchoring Uncertainty Quantification in Anatomical Consensus for Ambiguous Medical Image Segmentation

• Authors: Chao Wu, Kangxian Xie, Mingchen Gao
• Subjects: cs.CV, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.04024
• Pdf URL: https://arxiv.org/pdf/2603.04024
• Copy Paste: [[2603.04024]] Volumetric Directional Diffusion: Anchoring Uncertainty Quantification in Anatomical Consensus for Ambiguous Medical Image Segmentation(https://arxiv.org/abs/2603.04024)
• Keywords: generative
• Abstract: Equivocal 3D lesion segmentation exhibits high inter-observer variability. Conventional deterministic models ignore this aleatoric uncertainty, producing over-confident masks that obscure clinical risks. Conversely, while generative methods (e.g., standard diffusion) capture sample diversity, recovering complex topology from pure noise frequently leads to severe structural fractures and out-of-distribution anatomical hallucinations. To resolve this fidelity-diversity trade-off, we propose Volumetric Directional Diffusion (VDD). Unlike standard diffusion models that denoise isotropic Gaussian noise, VDD mathematically anchors the generative trajectory to a deterministic consensus prior. By restricting the generative search space to iteratively predict a 3D boundary residual field, VDD accurately explores the fine-grained geometric variations inherent in expert disagreements without risking topological collapse. Extensive validation on three multi-rater datasets (LIDC-IDRI, KiTS21, and ISBI 2015) demonstrates that VDD achieves state-of-the-art uncertainty quantification (significantly improving GED and CI) while remaining highly competitive in segmentation accuracy against deterministic upper bounds. Ultimately, VDD provides clinicians with anatomically coherent uncertainty maps, enabling safer decision-making and mitigating risks in downstream tasks (e.g., radiotherapy planning or surgical margin assessment).
• 摘要：模糊的 3D 病灶分割表现出观察者间的高度变异性。传统的确定性模型忽略了这种随意的不确定性，产生了过度自信的面具，掩盖了临床风险。相反，虽然生成方法（例如标准扩散）捕获样本多样性，但从纯噪声中恢复复杂的拓扑结构经常导致严重的结构断裂和分布不均的解剖幻觉。为了解决保真度与多样性之间的权衡问题，我们提出了体积定向扩散（VDD）。与去噪各向同性高斯噪声的标准扩散模型不同，VDD 在数学上将生成轨迹锚定到确定性共识先验。通过限制生成搜索空间来迭代预测 3D 边界残差场，VDD 可以准确地探索专家分歧中固有的细粒度几何变化，而无需冒拓扑崩溃的风险。对三个多评估者数据集（LIDC-IDRI、KiTS21 和 ISBI 2015）的广泛验证表明，VDD 实现了最先进的不确定性量化（显着提高了 GED 和 CI），同时在相对于确定性上限的分割精度方面保持了高度竞争力。最终，VDD 为临床医生提供解剖学上连贯的不确定性图，从而实现更安全的决策并减轻下游任务（例如放疗计划或手术切缘评估）中的风险。

Title: Inference-Time Toxicity Mitigation in Protein Language Models

• Authors: Manuel Fernández Burda, Santiago Aranguri, Iván Arcuschin Moreno, Enzo Ferrante
• Subjects: cs.LG, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.04045
• Pdf URL: https://arxiv.org/pdf/2603.04045
• Copy Paste: [[2603.04045]] Inference-Time Toxicity Mitigation in Protein Language Models(https://arxiv.org/abs/2603.04045)
• Keywords: generation, generative
• Abstract: Protein language models (PLMs) are becoming practical tools for de novo protein design, yet their dual-use potential raises safety concerns. We show that domain adaptation to specific taxonomic groups can elicit toxic protein generation, even when toxicity is not the training objective. To address this, we adapt Logit Diff Amplification (LDA) as an inference-time control mechanism for PLMs. LDA modifies token probabilities by amplifying the logit difference between a baseline model and a toxicity-finetuned model, requiring no retraining. Across four taxonomic groups, LDA consistently reduces predicted toxicity rate (measured via ToxDL2) below the taxon-finetuned baseline while preserving biological plausibility. We evaluate quality using Fréchet ESM Distance and predicted foldability (pLDDT), finding that LDA maintains distributional similarity to natural proteins and structural viability (unlike activation-based steering methods that tend to degrade sequence properties). Our results demonstrate that LDA provides a practical safety knob for protein generators that mitigates elicited toxicity while retaining generative quality.
• 摘要：蛋白质语言模型 (PLM) 正在成为从头蛋白质设计的实用工具，但其双重用途潜力引发了安全问题。我们表明，即使毒性不是训练目标，对特定分类群的域适应也可以引发有毒蛋白质的产生。为了解决这个问题，我们采用 Logit Diff Amplification (LDA) 作为 PLM 的推理时间控制机制。 LDA 通过放大基线模型和毒性微调模型之间的 logit 差异来修改令牌概率，无需重新训练。在四个分类群中，LDA 始终将预测毒性率（通过 ToxDL2 测量）降低到分类群微调基线以下，同时保持生物学合理性。我们使用 Fréchet ESM Distance 和预测可折叠性 (pLDDT) 评估质量，发现 LDA 保持了与天然蛋白质的分布相似性和结构可行性（与倾向于降低序列特性的基于激活的转向方法不同）。我们的结果表明，LDA 为蛋白质生成器提供了实用的安全旋钮，可减轻引发的毒性，同时保持生成质量。

Title: TumorFlow: Physics-Guided Longitudinal MRI Synthesis of Glioblastoma Growth

• Authors: Valentin Biller, Niklas Bubeck, Lucas Zimmer, Ayhan Can Erdur, Sandeep Nagar, Anke Meyer-Baese, Daniel Rückert, Benedikt Wiestler, Jonas Weidner
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.04058
• Pdf URL: https://arxiv.org/pdf/2603.04058
• Copy Paste: [[2603.04058]] TumorFlow: Physics-Guided Longitudinal MRI Synthesis of Glioblastoma Growth(https://arxiv.org/abs/2603.04058)
• Keywords: generative
• Abstract: Glioblastoma exhibits diverse, infiltrative, and patient-specific growth patterns that are only partially visible on routine MRI, making it difficult to reliably assess true tumor extent and personalize treatment planning and follow-up. We present a biophysically-conditioned generative framework that synthesizes biologically realistic 3D brain MRI volumes from estimated, spatially continuous tumor-concentration fields. Our approach combines a generative model with tumor-infiltration maps that can be propagated through time using a biophysical growth model, enabling fine-grained control over tumor shape and growth while preserving patient anatomy. This enables us to synthesize consistent tumor growth trajectories directly in the space of real patients, providing interpretable, controllable estimation of tumor infiltration and progression beyond what is explicitly observed in imaging. We evaluate the framework on longitudinal glioblastoma cases and demonstrate that it can generate temporally coherent sequences with realistic changes in tumor appearance and surrounding tissue response. These results suggest that integrating mechanistic tumor growth priors with modern generative modeling can provide a practical tool for patient-specific progression visualization and for generating controlled synthetic data to support downstream neuro-oncology workflows. In longitudinal extrapolation, we achieve a consistent 75% Dice overlap with the biophysical model while maintaining a constant PSNR of 25 in the surrounding tissue. Our code is available at: this https URL
• 摘要：胶质母细胞瘤表现出多样化、浸润性和患者特异性的生长模式，这些生长模式在常规 MRI 上只能部分可见，因此很难可靠地评估真实的肿瘤范围并制定个性化的治疗计划和随访。我们提出了一个生物物理条件生成框架，该框架从估计的空间连续肿瘤浓度场合成生物学上真实的 3D 脑部 MRI 体积。我们的方法将生成模型与肿瘤浸润图相结合，可以使用生物物理生长模型随时间传播肿瘤浸润图，从而能够对肿瘤形状和生长进行细粒度控制，同时保留患者的解剖结构。这使我们能够直接在真实患者的空间中合成一致的肿瘤生长轨迹，提供超出成像中明确观察到的肿瘤浸润和进展的可解释、可控的估计。我们评估了纵向胶质母细胞瘤病例的框架，并证明它可以生成时间连贯的序列，并具有肿瘤外观和周围组织反应的真实变化。这些结果表明，将肿瘤生长先验机制与现代生成模型相结合可以为患者特异性进展可视化和生成受控合成数据以支持下游神经肿瘤学工作流程提供实用工具。在纵向外推中，我们实现了与生物物理模型一致的 75% Dice 重叠，同时在周围组织中保持恒定的 PSNR 25。我们的代码位于：此 https URL

Title: Mask-Guided Attention Regulation for Anatomically Consistent Counterfactual CXR Synthesis

• Authors: Zichun Zhang, Weizhi Nie, Honglin Guo, Yuting Su
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.04130
• Pdf URL: https://arxiv.org/pdf/2603.04130
• Copy Paste: [[2603.04130]] Mask-Guided Attention Regulation for Anatomically Consistent Counterfactual CXR Synthesis(https://arxiv.org/abs/2603.04130)
• Keywords: generation
• Abstract: Counterfactual generation for chest X-rays (CXR) aims to simulate plausible pathological changes while preserving patient-specific anatomy. However, diffusion-based editing methods often suffer from structural drift, where stable anatomical semantics propagate globally through attention and distort non-target regions, and unstable pathology expression, since subtle and localized lesions induce weak and noisy conditioning signals. We present an inference-time attention regulation framework for reliable counterfactual CXR synthesis. An anatomy-aware attention regularization module gates self-attention and anatomy-token cross-attention with organ masks, confining structural interactions to anatomical ROIs and reducing unintended distortions. A pathology-guided module enhances pathology-token cross-attention within target lung regions during early denoising and performs lightweight latent corrections driven by an attention-concentration energy, enabling controllable lesion localization and extent. Extensive evaluations on CXR datasets show improved anatomical consistency and more precise, controllable pathological edits compared with standard diffusion editing, supporting localized counterfactual analysis and data augmentation for downstream tasks.
• 摘要：胸部 X 光 (CXR) 的反事实生成旨在模拟合理的病理变化，同时保留患者特定的解剖结构。然而，基于扩散的编辑方法经常遭受结构漂移的困扰，其中稳定的解剖语义通过注意力在全球范围内传播并扭曲非目标区域，以及不稳定的病理表达，因为微妙和局部的病变会引起微弱和嘈杂的条件信号。我们提出了一个推理时间注意力调节框架，用于可靠的反事实 CXR 合成。解剖感知注意力正则化模块通过器官掩模来控制自我注意力和解剖标记交叉注意力，将结构相互作用限制在解剖 ROI 上，并减少意外的扭曲。病理引导模块在早期去噪期间增强目标肺部区域内的病理标记交叉注意力，并执行由注意力集中能量驱动的轻量级潜在校正，从而实现可控病变定位和范围。对 CXR 数据集的广泛评估表明，与标准扩散编辑相比，CXR 数据集具有更高的解剖一致性和更精确、可控的病理编辑，支持下游任务的局部反事实分析和数据增强。

Title: Two-Stage Photovoltaic Forecasting: Separating Weather Prediction from Plant-Characteristics

• Authors: Philipp Danner, Hermann de Meer
• Subjects: cs.LG
• Abstract URL: https://arxiv.org/abs/2603.04132
• Pdf URL: https://arxiv.org/pdf/2603.04132
• Copy Paste: [[2603.04132]] Two-Stage Photovoltaic Forecasting: Separating Weather Prediction from Plant-Characteristics(https://arxiv.org/abs/2603.04132)
• Keywords: generation
• Abstract: Several energy management applications rely on accurate photovoltaic generation forecasts. Common metrics like mean absolute error or root-mean-square error, omit error-distribution details needed for stochastic optimization. In addition, several approaches use weather forecasts as inputs without analyzing the source of the prediction error. To overcome this gap, we decompose forecasting into a weather forecast model for environmental parameters such as solar irradiance and temperature and a plant characteristic model that captures site-specific parameters like panel orientation, temperature influence, or regular shading. Satellite-based weather observation serves as an intermediate layer. We analyze the error distribution of the high-resolution rapid-refresh numerical weather prediction model that covers the United States as a black-box model for weather forecasting and train an ensemble of neural networks on historical power output data for the plant characteristic model. Results show mean absolute error increases by 11% and 68% for two selected photovoltaic systems when using weather forecasts instead of satellite-based ground-truth weather observations as a perfect forecast. The generalized hyperbolic and Student's t distributions adequately fit the forecast errors across lead times.
• 摘要：多种能源管理应用依赖于准确的光伏发电预测。平均绝对误差或均方根误差等常见指标忽略了随机优化所需的误差分布细节。此外，一些方法使用天气预报作为输入，而不分析预测误差的来源。为了克服这一差距，我们将预测分解为太阳辐照度和温度等环境参数的天气预报模型，以及捕获特定地点参数（如面板方向、温度影响或规则阴影）的植物特征模型。基于卫星的天气观测充当中间层。我们分析了覆盖美国的高分辨率快速刷新数值天气预报模型作为天气预报的黑盒模型的误差分布，并根据电厂特征模型的历史功率输出数据训练神经网络集合。结果显示，当使用天气预报而不是基于卫星的地面实况天气观测作为完美预报时，两个选定的光伏系统的平均绝对误差增加了 11% 和 68%。广义双曲分布和学生 t 分布充分拟合整个交付周期的预测误差。

Title: DiverseDiT: Towards Diverse Representation Learning in Diffusion Transformers

• Authors: Mengping Yang, Zhiyu Tan, Binglei Li, Xiaomeng Yang, Hesen Chen, Hao Li
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.04239
• Pdf URL: https://arxiv.org/pdf/2603.04239
• Copy Paste: [[2603.04239]] DiverseDiT: Towards Diverse Representation Learning in Diffusion Transformers(https://arxiv.org/abs/2603.04239)
• Keywords: generation
• Abstract: Recent breakthroughs in Diffusion Transformers (DiTs) have revolutionized the field of visual synthesis due to their superior scalability. To facilitate DiTs' capability of capturing meaningful internal representations, recent works such as REPA incorporate external pretrained encoders for representation alignment. However, the underlying mechanisms governing representation learning within DiTs are not well understood. To this end, we first systematically investigate the representation dynamics of DiTs. Through analyzing the evolution and influence of internal representations under various settings, we reveal that representation diversity across blocks is a crucial factor for effective learning. Based on this key insight, we propose DiverseDiT, a novel framework that explicitly promotes representation diversity. DiverseDiT incorporates long residual connections to diversify input representations across blocks and a representation diversity loss to encourage blocks to learn distinct features. Extensive experiments on ImageNet 256x256 and 512x512 demonstrate that our DiverseDiT yields consistent performance gains and convergence acceleration when applied to different backbones with various sizes, even when tested on the challenging one-step generation setting. Furthermore, we show that DiverseDiT is complementary to existing representation learning techniques, leading to further performance gains. Our work provides valuable insights into the representation learning dynamics of DiTs and offers a practical approach for enhancing their performance.
• 摘要：扩散变压器 (DiT) 的最新突破因其卓越的可扩展性而彻底改变了视觉合成领域。为了促进 DiT 捕获有意义的内部表示的能力，REPA 等最近的工作结合了外部预训练编码器来进行表示对齐。然而，DiT 中控制表征学习的基本机制尚不清楚。为此，我们首先系统地研究 DiT 的表征动态。通过分析不同设置下内部表示的演变和影响，我们揭示了跨块的表示多样性是有效学习的关键因素。基于这一关键见解，我们提出了 DiverseDiT，这是一个明确促进表示多样性的新颖框架。 DiverseDiT 结合了长残差连接来使块之间的输入表示多样化，并采用表示多样性损失来鼓励块学习不同的特征。在 ImageNet 256x256 和 512x512 上进行的大量实验表明，即使在具有挑战性的一步生成设置上进行测试，我们的 DiverseDiT 在应用于不同尺寸的不同骨干网时也能产生一致的性能增益和收敛加速。此外，我们表明 DiverseDiT 是对现有表示学习技术的补充，从而进一步提高性能。我们的工作为 DiT 的表征学习动态提供了宝贵的见解，并提供了提高其性能的实用方法。

Title: IPD: Boosting Sequential Policy with Imaginary Planning Distillation in Offline Reinforcement Learning

• Authors: Yihao Qin, Yuanfei Wang, Hang Zhou, Peiran Liu, Hao Dong, Yiding Ji
• Subjects: cs.LG, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.04289
• Pdf URL: https://arxiv.org/pdf/2603.04289
• Copy Paste: [[2603.04289]] IPD: Boosting Sequential Policy with Imaginary Planning Distillation in Offline Reinforcement Learning(https://arxiv.org/abs/2603.04289)
• Keywords: generation
• Abstract: Decision transformer based sequential policies have emerged as a powerful paradigm in offline reinforcement learning (RL), yet their efficacy remains constrained by the quality of static datasets and inherent architectural limitations. Specifically, these models often struggle to effectively integrate suboptimal experiences and fail to explicitly plan for an optimal policy. To bridge this gap, we propose \textbf{Imaginary Planning Distillation (IPD)}, a novel framework that seamlessly incorporates offline planning into data generation, supervised training, and online inference. Our framework first learns a world model equipped with uncertainty measures and a quasi-optimal value function from the offline data. These components are utilized to identify suboptimal trajectories and augment them with reliable, imagined optimal rollouts generated via Model Predictive Control (MPC). A Transformer-based sequential policy is then trained on this enriched dataset, complemented by a value-guided objective that promotes the distillation of the optimal policy. By replacing the conventional, manually-tuned return-to-go with the learned quasi-optimal value function, IPD improves both decision-making stability and performance during inference. Empirical evaluations on the D4RL benchmark demonstrate that IPD significantly outperforms several state-of-the-art value-based and transformer-based offline RL methods across diverse tasks.
• 摘要：基于决策转换器的顺序策略已成为离线强化学习 (RL) 中的强大范例，但其功效仍然受到静态数据集质量和固有架构限制的限制。具体来说，这些模型通常难以有效地整合次优经验，并且无法明确规划最优策略。为了弥补这一差距，我们提出了 \textbf{想象规划蒸馏（IPD）}，这是一种新颖的框架，可以将离线规划无缝地融入数据生成、监督训练和在线推理中。我们的框架首先从离线数据中学习一个配备了不确定性度量和准最优价值函数的世界模型。这些组件用于识别次优轨迹，并通过模型预测控制 (MPC) 生成可靠的、想象的最佳推出来增强它们。然后，在这个丰富的数据集上训练基于 Transformer 的顺序策略，并辅以促进最优策略精炼的价值引导目标。通过用学习的准最优值函数取代传统的手动调整的返回，IPD 提高了推理过程中决策的稳定性和性能。对 D4RL 基准的实证评估表明，IPD 在不同的任务中显着优于几种最先进的基于价值和基于 Transformer 的离线 RL 方法。

Title: CubeComposer: Spatio-Temporal Autoregressive 4K 360° Video Generation from Perspective Video

• Authors: Lingen Li, Guangzhi Wang, Xiaoyu Li, Zhaoyang Zhang, Qi Dou, Jinwei Gu, Tianfan Xue, Ying Shan
• Subjects: cs.CV, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.04291
• Pdf URL: https://arxiv.org/pdf/2603.04291
• Copy Paste: [[2603.04291]] CubeComposer: Spatio-Temporal Autoregressive 4K 360° Video Generation from Perspective Video(https://arxiv.org/abs/2603.04291)
• Keywords: super-resolution, generation
• Abstract: Generating high-quality 360° panoramic videos from perspective input is one of the crucial applications for virtual reality (VR), whereby high-resolution videos are especially important for immersive experience. Existing methods are constrained by computational limitations of vanilla diffusion models, only supporting $\leq$ 1K resolution native generation and relying on suboptimal post super-resolution to increase resolution. We introduce CubeComposer, a novel spatio-temporal autoregressive diffusion model that natively generates 4K-resolution 360° videos. By decomposing videos into cubemap representations with six faces, CubeComposer autoregressively synthesizes content in a well-planned spatio-temporal order, reducing memory demands while enabling high-resolution output. Specifically, to address challenges in multi-dimensional autoregression, we propose: (1) a spatio-temporal autoregressive strategy that orchestrates 360° video generation across cube faces and time windows for coherent synthesis; (2) a cube face context management mechanism, equipped with a sparse context attention design to improve efficiency; and (3) continuity-aware techniques, including cube-aware positional encoding, padding, and blending to eliminate boundary seams. Extensive experiments on benchmark datasets demonstrate that CubeComposer outperforms state-of-the-art methods in native resolution and visual quality, supporting practical VR application scenarios. Project page: this https URL
• 摘要：根据视角输入生成高质量的 360° 全景视频是虚拟现实 (VR) 的关键应用之一，其中高分辨率视频对于沉浸式体验尤为重要。现有方法受到普通扩散模型计算限制的限制，仅支持 $\leq$ 1K 分辨率的原生生成，并依赖次优的后超分辨率来提高分辨率。我们引入了 CubeComposer，这是一种新颖的时空自回归扩散模型，可以原生生成 4K 分辨率的 360° 视频。通过将视频分解为具有六个面的立方体贴图表示，CubeComposer 以精心规划的时空顺序自动回归合成内容，减少内存需求，同时实现高分辨率输出。具体来说，为了解决多维自回归中的挑战，我们提出：（1）一种时空自回归策略，协调跨立方体面和时间窗口的 360° 视频生成，以进行相干合成； （2）立方体面上下文管理机制，配备稀疏上下文注意力设计以提高效率； (3) 连续性感知技术，包括立方体感知位置编码、填充和混合以消除边界接缝。对基准数据集的大量实验表明，CubeComposer 在原始分辨率和视觉质量方面优于最先进的方法，支持实际的 VR 应用场景。项目页面：此 https URL

Title: Motion Manipulation via Unsupervised Keypoint Positioning in Face Animation

• Authors: Hong Li, Boyu Liu, Xuhui Liu, Baochang Zhang
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.04302
• Pdf URL: https://arxiv.org/pdf/2603.04302
• Copy Paste: [[2603.04302]] Motion Manipulation via Unsupervised Keypoint Positioning in Face Animation(https://arxiv.org/abs/2603.04302)
• Keywords: generation
• Abstract: Face animation deals with controlling and generating facial features with a wide range of applications. The methods based on unsupervised keypoint positioning can produce realistic and detailed virtual portraits. However, they cannot achieve controllable face generation since the existing keypoint decomposition pipelines fail to fully decouple identity semantics and intertwined motion information (e.g., rotation, translation, and expression). To address these issues, we present a new method, Motion Manipulation via unsupervised keypoint positioning in Face Animation (MMFA). We first introduce self-supervised representation learning to encode and decode expressions in the latent feature space and decouple them from other motion information. Secondly, we propose a new way to compute keypoints aiming to achieve arbitrary motion control. Moreover, we design a variational autoencoder to map expression features to a continuous Gaussian distribution, allowing us for the first time to interpolate facial expressions in an unsupervised framework. We have conducted extensive experiments on publicly available datasets to validate the effectiveness of MMFA, which show that MMFA offers pronounced advantages over prior arts in creating realistic animation and manipulating face motion.
• 摘要：面部动画涉及控制和生成具有广泛应用的面部特征。基于无监督关键点定位的方法可以产生逼真且细致的虚拟肖像。然而，由于现有的关键点分解管道无法完全解耦身份语义和交织的运动信息（例如旋转、平移和表达），因此它们无法实现可控的面部生成。为了解决这些问题，我们提出了一种新方法，即通过面部动画中无监督关键点定位进行运动操纵（MMFA）。我们首先引入自监督表示学习来编码和解码潜在特征空间中的表达式，并将它们与其他运动信息解耦。其次，我们提出了一种计算关键点的新方法，旨在实现任意运动控制。此外，我们设计了一个变分自动编码器，将表情特征映射到连续高斯分布，使我们第一次能够在无监督框架中插入面部表情。我们对公开的数据集进行了广泛的实验，以验证 MMFA 的有效性，这表明 MMFA 在创建逼真的动画和操纵面部运动方面比现有技术具有明显的优势。

Title: Dual Diffusion Models for Multi-modal Guided 3D Avatar Generation

• Authors: Hong Li, Yutang Feng, Minqi Meng, Yichen Yang, Xuhui Liu, Baochang Zhang
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.04307
• Pdf URL: https://arxiv.org/pdf/2603.04307
• Copy Paste: [[2603.04307]] Dual Diffusion Models for Multi-modal Guided 3D Avatar Generation(https://arxiv.org/abs/2603.04307)
• Keywords: generation
• Abstract: Generating high-fidelity 3D avatars from text or image prompts is highly sought after in virtual reality and human-computer interaction. However, existing text-driven methods often rely on iterative Score Distillation Sampling (SDS) or CLIP optimization, which struggle with fine-grained semantic control and suffer from excessively slow inference. Meanwhile, image-driven approaches are severely bottlenecked by the scarcity and high acquisition cost of high-quality 3D facial scans, limiting model generalization. To address these challenges, we first construct a novel, large-scale dataset comprising over 100,000 pairs across four modalities: fine-grained textual descriptions, in-the-wild face images, high-quality light-normalized texture UV maps, and 3D geometric shapes. Leveraging this comprehensive dataset, we propose PromptAvatar, a framework featuring dual diffusion models. Specifically, it integrates a Texture Diffusion Model (TDM) that supports flexible multi-condition guidance from text and/or image prompts, alongside a Geometry Diffusion Model (GDM) guided by text prompts. By learning the direct mapping from multi-modal prompts to 3D representations, PromptAvatar eliminates the need for time-consuming iterative optimization, successfully generating high-fidelity, shading-free 3D avatars in under 10 seconds. Extensive quantitative and qualitative experiments demonstrate that our method significantly outperforms existing state-of-the-art approaches in generation quality, fine-grained detail alignment, and computational efficiency.
• 摘要：根据文本或图像提示生成高保真 3D 头像在虚拟现实和人机交互中备受追捧。然而，现有的文本驱动方法通常依赖于迭代分数蒸馏采样（SDS）或 CLIP 优化，这些方法难以实现细粒度的语义控制，并且推理速度过慢。与此同时，图像驱动的方法因高质量 3D 面部扫描的稀缺性和高获取成本而受到严重瓶颈，限制了模型的泛化。为了应对这些挑战，我们首先构建了一个新颖的大规模数据集，包含超过 100,000 对跨四种模式的数据集：细粒度文本描述、野外面部图像、高质量光归一化纹理 UV 贴图和 3D 几何形状。利用这个综合数据集，我们提出了 PromptAvatar，一个具有双扩散模型的框架。具体来说，它集成了纹理扩散模型（TDM），支持来自文本和/或图像提示的灵活多条件指导，以及由文本提示指导的几何扩散模型（GDM）。通过学习从多模式提示到 3D 表示的直接映射，PromptAvatar 消除了耗时的迭代优化的需要，在 10 秒内成功生成高保真、无阴影的 3D 头像。广泛的定量和定性实验表明，我们的方法在生成质量、细粒度细节对齐和计算效率方面显着优于现有的最先进方法。

Title: Scalable Evaluation of the Realism of Synthetic Environmental Augmentations in Images

• Authors: Damian J. Ruck, Paul Vautravers, Oliver Chalkley, Jake Thomas
• Subjects: cs.CV, cs.LG
• Abstract URL: https://arxiv.org/abs/2603.04325
• Pdf URL: https://arxiv.org/pdf/2603.04325
• Copy Paste: [[2603.04325]] Scalable Evaluation of the Realism of Synthetic Environmental Augmentations in Images(https://arxiv.org/abs/2603.04325)
• Keywords: generation, generative
• Abstract: Evaluation of AI systems often requires synthetic test cases, particularly for rare or safety-critical conditions that are difficult to observe in operational data. Generative AI offers a promising approach for producing such data through controllable image editing, but its usefulness depends on whether the resulting images are sufficiently realistic to support meaningful evaluation. We present a scalable framework for assessing the realism of synthetic image-editing methods and apply it to the task of adding environmental conditions-fog, rain, snow, and nighttime-to car-mounted camera images. Using 40 clear-day images, we compare rule-based augmentation libraries with generative AI image-editing models. Realism is evaluated using two complementary automated metrics: a vision-language model (VLM) jury for perceptual realism assessment, and embedding-based distributional analysis to measure similarity to genuine adverse-condition imagery. Generative AI methods substantially outperform rule-based approaches, with the best generative method achieving approximately 3.6 times the acceptance rate of the best rule-based method. Performance varies across conditions: fog proves easiest to simulate, while nighttime transformations remain challenging. Notably, the VLM jury assigns imperfect acceptance even to real adverse-condition imagery, establishing practical ceilings against which synthetic methods can be judged. By this standard, leading generative methods match or exceed real-image performance for most conditions. These results suggest that modern generative image-editing models can enable scalable generation of realistic adverse-condition imagery for evaluation pipelines. Our framework therefore provides a practical approach for scalable realism evaluation, though validation against human studies remains an important direction for future work.
• 摘要：人工智能系统的评估通常需要综合测试用例，特别是对于难以在操作数据中观察到的罕见或安全关键条件。生成式人工智能提供了一种通过可控图像编辑生成此类数据的有前景的方法，但其有用性取决于生成的图像是否足够真实以支持有意义的评估。我们提出了一个可扩展的框架，用于评估合成图像编辑方法的真实性，并将其应用于向车载摄像头图像添加雾、雨、雪和夜间等环境条件的任务。我们使用 40 张晴天图像，将基于规则的增强库与生成式 AI 图像编辑模型进行比较。使用两个互补的自动化指标来评估真实性：用于感知真实性评估的视觉语言模型（VLM）陪审团，以及用于测量与真实不利条件图像的相似性的基于嵌入的分布分析。生成式人工智能方法的性能远远优于基于规则的方法，最佳生成式方法的接受率约为基于规则的最佳方法的 3.6 倍。性能因条件而异：事实证明，雾是最容易模拟的，而夜间变换仍然具有挑战性。值得注意的是，VLM 评审团甚至对真实的不利条件图像也给出了不完美的接受度，从而建立了可以判断合成方法的实用上限。按照这个标准，领先的生成方法在大多数情况下都可以达到或超过真实图像的性能。这些结果表明，现代生成图像编辑模型可以为评估流程生成可扩展的真实不利条件图像。因此，我们的框架为可扩展的现实主义评估提供了一种实用的方法，尽管针对人类研究的验证仍然是未来工作的重要方向。

Title: Pointer-CAD: Unifying B-Rep and Command Sequences via Pointer-based Edges & Faces Selection

• Authors: Dacheng Qi, Chenyu Wang, Jingwei Xu, Tianzhe Chu, Zibo Zhao, Wen Liu, Wenrui Ding, Yi Ma, Shenghua Gao
• Subjects: cs.CV, cs.CL
• Abstract URL: https://arxiv.org/abs/2603.04337
• Pdf URL: https://arxiv.org/pdf/2603.04337
• Copy Paste: [[2603.04337]] Pointer-CAD: Unifying B-Rep and Command Sequences via Pointer-based Edges & Faces Selection(https://arxiv.org/abs/2603.04337)
• Keywords: generation
• Abstract: Constructing computer-aided design (CAD) models is labor-intensive but essential for engineering and manufacturing. Recent advances in Large Language Models (LLMs) have inspired the LLM-based CAD generation by representing CAD as command sequences. But these methods struggle in practical scenarios because command sequence representation does not support entity selection (e.g. faces or edges), limiting its ability to support complex editing operations such as chamfer or fillet. Further, the discretization of a continuous variable during sketch and extrude operations may result in topological errors. To address these limitations, we present Pointer-CAD, a novel LLM-based CAD generation framework that leverages a pointer-based command sequence representation to explicitly incorporate the geometric information of B-rep models into sequential modeling. In particular, Pointer-CAD decomposes CAD model generation into steps, conditioning the generation of each subsequent step on both the textual description and the B-rep generated from previous steps. Whenever an operation requires the selection of a specific geometric entity, the LLM predicts a Pointer that selects the most feature-consistent candidate from the available set. Such a selection operation also reduces the quantization error in the command sequence-based representation. To support the training of Pointer-CAD, we develop a data annotation pipeline that produces expert-level natural language descriptions and apply it to build a dataset of approximately 575K CAD models. Extensive experimental results demonstrate that Pointer-CAD effectively supports the generation of complex geometric structures and reduces segmentation error to an extremely low level, achieving a significant improvement over prior command sequence methods, thereby significantly mitigating the topological inaccuracies introduced by quantization error.
• 摘要：构建计算机辅助设计 (CAD) 模型是一项劳动密集型工作，但对于工程和制造至关重要。大型语言模型 (LLM) 的最新进展通过将 CAD 表示为命令序列，激发了基于 LLM 的 CAD 生成。但这些方法在实际场景中很困难，因为命令序列表示不支持实体选择（例如面或边），限制了其支持倒角或圆角等复杂编辑操作的能力。此外，在草图和拉伸操作期间连续变量的离散化可能会导致拓扑错误。为了解决这些限制，我们提出了 Pointer-CAD，这是一种基于 LLM 的新型 CAD 生成框架，它利用基于指针的命令序列表示来将 B-rep 模型的几何信息明确地合并到顺序建模中。特别是，Pointer-CAD 将 CAD 模型生成分解为步骤，根据文本描述和先前步骤生成的 B-rep 来调节每个后续步骤的生成。每当操作需要选择特定几何实体时，LLM 都会预测一个指针，该指针从可用集中选择特征最一致的候选者。这样的选择操作还减少了基于命令序列的表示中的量化误差。为了支持 Pointer-CAD 的训练，我们开发了一个数据注释管道，可生成专家级自然语言描述，并将其应用于构建约 575K CAD 模型的数据集。大量的实验结果表明，Pointer-CAD有效支持复杂几何结构的生成，并将分割误差降低到极低的水平，相对于现有的命令序列方法有了显着的改进，从而显着减轻了量化误差带来的拓扑误差。

Title: ArtHOI: Articulated Human-Object Interaction Synthesis by 4D Reconstruction from Video Priors

• Authors: Zihao Huang, Tianqi Liu, Zhaoxi Chen, Shaocong Xu, Saining Zhang, Lixing Xiao, Zhiguo Cao, Wei Li, Hao Zhao, Ziwei Liu
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.04338
• Pdf URL: https://arxiv.org/pdf/2603.04338
• Copy Paste: [[2603.04338]] ArtHOI: Articulated Human-Object Interaction Synthesis by 4D Reconstruction from Video Priors(https://arxiv.org/abs/2603.04338)
• Keywords: generation
• Abstract: Synthesizing physically plausible articulated human-object interactions (HOI) without 3D/4D supervision remains a fundamental challenge. While recent zero-shot approaches leverage video diffusion models to synthesize human-object interactions, they are largely confined to rigid-object manipulation and lack explicit 4D geometric reasoning. To bridge this gap, we formulate articulated HOI synthesis as a 4D reconstruction problem from monocular video priors: given only a video generated by a diffusion model, we reconstruct a full 4D articulated scene without any 3D supervision. This reconstruction-based approach treats the generated 2D video as supervision for an inverse rendering problem, recovering geometrically consistent and physically plausible 4D scenes that naturally respect contact, articulation, and temporal coherence. We introduce ArtHOI, the first zero-shot framework for articulated human-object interaction synthesis via 4D reconstruction from video priors. Our key designs are: 1) Flow-based part segmentation: leveraging optical flow as a geometric cue to disentangle dynamic from static regions in monocular video; 2) Decoupled reconstruction pipeline: joint optimization of human motion and object articulation is unstable under monocular ambiguity, so we first recover object articulation, then synthesize human motion conditioned on the reconstructed object states. ArtHOI bridges video-based generation and geometry-aware reconstruction, producing interactions that are both semantically aligned and physically grounded. Across diverse articulated scenes (e.g., opening fridges, cabinets, microwaves), ArtHOI significantly outperforms prior methods in contact accuracy, penetration reduction, and articulation fidelity, extending zero-shot interaction synthesis beyond rigid manipulation through reconstruction-informed synthesis.
• 摘要：在没有 3D/4D 监督的情况下合成物理上合理的人机交互 (HOI) 仍然是一个基本挑战。虽然最近的零镜头方法利用视频扩散模型来合成人与物体的交互，但它们很大程度上局限于刚性物体操作并且缺乏明确的 4D 几何推理。为了弥补这一差距，我们将铰接 HOI 合成制定为来自单目视频先验的 4D 重建问题：仅给定由扩散模型生成的视频，我们在没有任何 3D 监督的情况下重建完整的 4D 铰接场景。这种基于重建的方法将生成的 2D 视频视为逆渲染问题的监督，恢复几何上一致且物理上合理的 4D 场景，自然地尊重接触、清晰度和时间连贯性。我们介绍了 ArtHOI，这是第一个通过视频先验进行 4D 重建来进行关节式人机交互合成的零样本框架。我们的主要设计是：1）基于流的部分分割：利用光流作为几何线索来分离单目视频中的动态区域和静态区域； 2）解耦重建流程：人体运动和物体清晰度的联合优化在单目模糊条件下不稳定，因此我们首先恢复物体清晰度，然后根据重建的物体状态合成人体运动。 ArtHOI 将基于视频的生成和几何感知重建联系起来，产生语义上一致且物理上接地的交互。在不同的铰接场景（例如，打开冰箱、橱柜、微波炉）中，ArtHOI 在接触精度、穿透减少和铰接保真度方面显着优于先前的方法，通过重建信息合成将零样本交互合成扩展到刚性操作之外。

Title: Balancing Fidelity, Utility, and Privacy in Synthetic Cardiac MRI Generation: A Comparative Study

• Authors: Madhura Edirisooriya, Dasuni Kawya, Ishan Kumarasinghe, Isuri Devindi, Mary M. Maleckar, Roshan Ragel, Isuru Nawinne, Vajira Thambawita
• Subjects: cs.CV, cs.LG
• Abstract URL: https://arxiv.org/abs/2603.04340
• Pdf URL: https://arxiv.org/pdf/2603.04340
• Copy Paste: [[2603.04340]] Balancing Fidelity, Utility, and Privacy in Synthetic Cardiac MRI Generation: A Comparative Study(https://arxiv.org/abs/2603.04340)
• Keywords: generation, generative
• Abstract: Deep learning in cardiac MRI (CMR) is fundamentally constrained by both data scarcity and privacy regulations. This study systematically benchmarks three generative architectures: Denoising Diffusion Probabilistic Models (DDPM), Latent Diffusion Models (LDM), and Flow Matching (FM) for synthetic CMR generation. Utilizing a two-stage pipeline where anatomical masks condition image synthesis, we evaluate generated data across three critical axes: fidelity, utility, and privacy. Our results show that diffusion-based models, particularly DDPM, provide the most effective balance between downstream segmentation utility, image fidelity, and privacy preservation under limited-data conditions, while FM demonstrates promising privacy characteristics with slightly lower task-level performance. These findings quantify the trade-offs between cross-domain generalization and patient confidentiality, establishing a framework for safe and effective synthetic data augmentation in medical imaging.
• 摘要：心脏 MRI (CMR) 中的深度学习从根本上受到数据稀缺和隐私法规的限制。本研究系统地对三种生成架构进行了基准测试：用于合成 CMR 生成的去噪扩散概率模型 (DDPM)、潜在扩散模型 (LDM) 和流匹配 (FM)。利用解剖掩模调节图像合成的两级管道，我们在三个关键轴上评估生成的数据：保真度、实用性和隐私。我们的结果表明，基于扩散的模型，特别是 DDPM，在有限数据条件下提供了下游分割效用、图像保真度和隐私保护之间最有效的平衡，而 FM 则展示了有前景的隐私特性，但任务级性能稍低。这些发现量化了跨领域泛化和患者机密性之间的权衡，为医学成像中安全有效的合成数据增强建立了框架。

Title: Enhancing Authorship Attribution with Synthetic Paintings

• Authors: Clarissa Loures, Caio Hosken, Luan Oliveira, Gianlucca Zuin, Adriano Veloso
• Subjects: cs.CV, cs.LG
• Abstract URL: https://arxiv.org/abs/2603.04343
• Pdf URL: https://arxiv.org/pdf/2603.04343
• Copy Paste: [[2603.04343]] Enhancing Authorship Attribution with Synthetic Paintings(https://arxiv.org/abs/2603.04343)
• Keywords: generative
• Abstract: Attributing authorship to paintings is a historically complex task, and one of its main challenges is the limited availability of real artworks for training computational models. This study investigates whether synthetic images, generated through DreamBooth fine-tuning of Stable Diffusion, can improve the performance of classification models in this context. We propose a hybrid approach that combines real and synthetic data to enhance model accuracy and generalization across similar artistic styles. Experimental results show that adding synthetic images leads to higher ROC-AUC and accuracy compared to using only real paintings. By integrating generative and discriminative methods, this work contributes to the development of computer vision techniques for artwork authentication in data-scarce scenarios.
• 摘要：将作者归属于绘画是一项历史上复杂的任务，其主要挑战之一是用于训练计算模型的真实艺术品的可用性有限。本研究调查通过 DreamBooth 稳定扩散微调生成的合成图像是否可以提高在此背景下分类模型的性能。我们提出了一种混合方法，结合真实数据和合成数据，以提高模型的准确性和相似艺术风格的泛化能力。实验结果表明，与仅使用真实绘画相比，添加合成图像会带来更高的 ROC-AUC 和准确性。通过集成生成方法和判别方法，这项工作有助于开发用于数据稀缺场景中艺术品认证的计算机视觉技术。

Title: RANGER: Sparsely-Gated Mixture-of-Experts with Adaptive Retrieval Re-ranking for Pathology Report Generation

• Authors: Yixin Chen, Ziyu Su, Hikmat Khan, Muhammad Khalid Khan Niazi
• Subjects: cs.CV, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.04348
• Pdf URL: https://arxiv.org/pdf/2603.04348
• Copy Paste: [[2603.04348]] RANGER: Sparsely-Gated Mixture-of-Experts with Adaptive Retrieval Re-ranking for Pathology Report Generation(https://arxiv.org/abs/2603.04348)
• Keywords: generation, generative
• Abstract: Pathology report generation remains a relatively under-explored downstream task, primarily due to the gigapixel scale and complex morphological heterogeneity of Whole Slide Images (WSIs). Existing pathology report generation frameworks typically employ transformer architectures, relying on a homogeneous decoder architecture and static knowledge retrieval integration. Such architectures limit generative specialization and may introduce noisy external guidance during the report generation process. To address these limitations, we propose RANGER, a sparsely-gated Mixture-of-Experts (MoE) framework with adaptive retrieval re-ranking for pathology report generation. Specifically, we integrate a sparsely gated MoE into the decoder, along with noisy top-$k$ routing and load-balancing regularization, to enable dynamic expert specialization across various diagnostic patterns. Additionally, we introduce an adaptive retrieval re-ranking module that selectively refines retrieved memory from a knowledge base before integration, reducing noise and improving semantic alignment based on visual feature representations. We perform extensive experiments on the PathText-BRCA dataset and demonstrate consistent improvements over existing approaches across standard natural language generation metrics. Our full RANGER model achieves optimal performance on PathText dataset, reaching BLEU-1 to BLEU-4 scores of 0.4598, 0.3044, 0.2036, and 0.1435, respectively, with METEOR of 0.1883, and ROUGE-L of 0.3038, validating the effectiveness of dynamic expert routing and adaptive knowledge refinement for semantically grounded pathology report generation.
• 摘要：病理报告生成仍然是一项相对未被充分探索的下游任务，这主要是由于全幻灯片图像 (WSI) 的十亿像素规模和复杂的形态异质性。现有的病理报告生成框架通常采用变压器架构，依赖于同质解码器架构和静态知识检索集成。这种架构限制了生成专业化，并且可能在报告生成过程中引入嘈杂的外部指导。为了解决这些限制，我们提出了 RANGER，一种稀疏门控专家混合 (MoE) 框架，具有用于生成病理报告的自适应检索重排序功能。具体来说，我们将稀疏门控 MoE 以及嘈杂的 top-$k$ 路由和负载平衡正则化集成到解码器中，以实现跨各种诊断模式的动态专家专业化。此外，我们引入了一个自适应检索重排序模块，该模块在集成之前有选择地细化从知识库中检索到的记忆，减少噪音并基于视觉特征表示改进语义对齐。我们对 PathText-BRCA 数据集进行了广泛的实验，并展示了对标准自然语言生成指标的现有方法的一致改进。我们的完整 RANGER 模型在 PathText 数据集上实现了最佳性能，BLEU-1 至 BLEU-4 分数分别为 0.4598、0.3044、0.2036 和 0.1435，METEOR 为 0.1883，ROUGE-L 为 0.3038，验证了动态专家路由和自适应知识细化对于生成基于语义的病理报告的有效性。

Title: Helios: Real Real-Time Long Video Generation Model

• Authors: Shenghai Yuan, Yuanyang Yin, Zongjian Li, Xinwei Huang, Xiao Yang, Li Yuan
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.04379
• Pdf URL: https://arxiv.org/pdf/2603.04379
• Copy Paste: [[2603.04379]] Helios: Real Real-Time Long Video Generation Model(https://arxiv.org/abs/2603.04379)
• Keywords: generation, generative
• Abstract: We introduce Helios, the first 14B video generation model that runs at 19.5 FPS on a single NVIDIA H100 GPU and supports minute-scale generation while matching the quality of a strong baseline. We make breakthroughs along three key dimensions: (1) robustness to long-video drifting without commonly used anti-drifting heuristics such as self-forcing, error-banks, or keyframe sampling; (2) real-time generation without standard acceleration techniques such as KV-cache, sparse/linear attention, or quantization; and (3) training without parallelism or sharding frameworks, enabling image-diffusion-scale batch sizes while fitting up to four 14B models within 80 GB of GPU memory. Specifically, Helios is a 14B autoregressive diffusion model with a unified input representation that natively supports T2V, I2V, and V2V tasks. To mitigate drifting in long-video generation, we characterize typical failure modes and propose simple yet effective training strategies that explicitly simulate drifting during training, while eliminating repetitive motion at its source. For efficiency, we heavily compress the historical and noisy context and reduce the number of sampling steps, yielding computational costs comparable to -- or lower than -- those of 1.3B video generative models. Moreover, we introduce infrastructure-level optimizations that accelerate both inference and training while reducing memory consumption. Extensive experiments demonstrate that Helios consistently outperforms prior methods on both short- and long-video generation. We plan to release the code, base model, and distilled model to support further development by the community.
• 摘要：我们推出了 Helios，这是第一个 14B 视频生成模型，它在单个 NVIDIA H100 GPU 上以 19.5 FPS 运行，支持分钟级生成，同时匹配强大基线的质量。我们在三个关键维度上取得了突破：（1）对长视频漂移的鲁棒性，无需常用的抗漂移启发式方法，例如自我强迫、错误库或关键帧采样； (2) 实时生成，无需标准加速技术，例如 KV 缓存、稀疏/线性注意力或量化； (3) 在没有并行或分片框架的情况下进行训练，实现图像扩散规模的批量大小，同时在 80 GB GPU 内存中拟合最多四个 14B 模型。具体来说，Helios 是一个 14B 自回归扩散模型，具有统一的输入表示，原生支持 T2V、I2V 和 V2V 任务。为了减轻长视频生成中的漂移，我们描述了典型的故障模式，并提出了简单而有效的训练策略，这些策略在训练过程中明确模拟漂移，同时从源头消除重复运动。为了提高效率，我们大量压缩历史和噪声上下文，并减少采样步骤的数量，从而产生与 1.3B 视频生成模型相当或更低的计算成本。此外，我们引入了基础设施级优化，可以加速推理和训练，同时减少内存消耗。大量实验表明，Helios 在短视频和长视频生成方面始终优于先前的方法。我们计划发布代码、基础模型和蒸馏模型，以支持社区的进一步开发。