2026-03-09

Title: Traversal-as-Policy: Log-Distilled Gated Behavior Trees as Externalized, Verifiable Policies for Safe, Robust, and Efficient Agents

• Authors: Peiran Li, Jiashuo Sun, Fangzhou Lin, Shuo Xing, Tianfu Fu, Suofei Feng, Chaoqun Ni, Zhengzhong Tu
• Subjects: cs.LG, cs.AI, cs.CR, cs.SE
• Abstract URL: https://arxiv.org/abs/2603.05517
• Pdf URL: https://arxiv.org/pdf/2603.05517
• Copy Paste: [[2603.05517]] Traversal-as-Policy: Log-Distilled Gated Behavior Trees as Externalized, Verifiable Policies for Safe, Robust, and Efficient Agents(https://arxiv.org/abs/2603.05517)
• Keywords: generation
• Abstract: Autonomous LLM agents fail because long-horizon policy remains implicit in model weights and transcripts, while safety is retrofitted post hoc. We propose Traversal-as-Policy: distill sandboxed OpenHands execution logs into a single executable Gated Behavior Tree (GBT) and treat tree traversal -- rather than unconstrained generation -- as the control policy whenever a task is in coverage. Each node encodes a state-conditioned action macro mined and merge-checked from successful trajectories; macros implicated by unsafe traces attach deterministic pre-execution gates over structured tool context and bounded history, updated under experience-grounded monotonicity so previously rejected unsafe contexts cannot be re-admitted. At runtime, a lightweight traverser matches the base model's intent to child macros, executes one macro at a time under global and node-local gating, and when stalled performs risk-aware shortest-path recovery to a feasible success leaf; the visited path forms a compact spine memory that replaces transcript replay. Evaluated in a unified OpenHands sandbox on 15+ software, web, reasoning, and safety/security benchmarks, GBT improves success while driving violations toward zero and reducing cost. On SWE-bench Verified (Protocol A, 500 issues), GBT-SE raises success from 34.6% to 73.6%, reduces violations from 2.8% to 0.2%, and cuts token/character usage from 208k/820k to 126k/490k; with the same distilled tree, 8B executors more than double success on SWE-bench Verified (14.0%58.8%) and WebArena (9.1%37.3%).
• 摘要：自主 LLM 代理失败是因为长期政策仍然隐含在模型权重和成绩单中，而安全性则事后进行了改造。我们提出 Traversal-as-Policy：将沙盒 OpenHands 执行日志提取到单个可执行的门控行为树 (GBT) 中，并在任务覆盖范围内时将树遍历（而不是不受约束的生成）视为控制策略。每个节点都编码一个从成功轨迹中挖掘和合并检查的状态条件动作宏；不安全跟踪所涉及的宏将确定性的预执行门附加到结构化工具上下文和有限历史记录上，并在基于经验的单调性下进行更新，因此之前拒绝的不安全上下文不能被重新接纳。在运行时，轻量级遍历器将基本模型的意图与子宏相匹配，在全局和节点本地门控下一次执行一个宏，并在停止时执行风险感知的最短路径恢复到可行的成功叶子；访问过的路径形成一个紧凑的脊椎记忆，取代了转录记录重放。 GBT 在统一的 OpenHands 沙箱中对超过 15 个软件、网络、推理和安全/安保基准进行了评估，提高了成功率，同时将违规行为降至零并降低了成本。在 SWE-bench 验证（协议 A，500 个问题）上，GBT-SE 将成功率从 34.6% 提高到 73.6%，将违规率从 2.8% 减少到 0.2%，并将令牌/字符使用量从 208k/820k 减少到 126k/490k；使用相同的蒸馏树，8B 执行器在 SWE-bench Verified (14.0%58.8%) 和 WebArena (9.1%37.3%) 上的成功率提高了一倍以上。

Title: When AI Levels the Playing Field: Skill Homogenization, Asset Concentration, and Two Regimes of Inequality

• Authors: Xupeng Chen, Shuchen Meng
• Subjects: cs.LG, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.05565
• Pdf URL: https://arxiv.org/pdf/2603.05565
• Copy Paste: [[2603.05565]] When AI Levels the Playing Field: Skill Homogenization, Asset Concentration, and Two Regimes of Inequality(https://arxiv.org/abs/2603.05565)
• Keywords: generative
• Abstract: Generative AI compresses within-task skill differences while shifting economic value toward concentrated complementary assets, creating an apparent paradox: the technology that equalizes individual performance may widen aggregate inequality. We formalize this tension in a task-based model with endogenous education, employer screening, and heterogeneous firms. The model yields two regimes whose boundary depends on AI's technology structure (proprietary vs.\ commodity) and labor market institutions (rent-sharing elasticity, asset concentration). A scenario analysis via Method of Simulated Moments, matching six empirical targets, disciplines the model's quantitative magnitudes; a sensitivity decomposition reveals that the five non-$\Delta$Gini moments identify mechanism rates but not the aggregate sign, which at the calibrated parameters is pinned by $m_6$ and $\xi$, while AI's technology structure ($\eta_1$ vs.\ $\eta_0$) independently crosses the boundary. The contribution is the mechanism -- not a verdict on the sign. Occupation-level regressions using BLS OEWS data (2019--2023) illustrate why such data cannot test the model's task-level predictions. The predictions are testable with within-occupation, within-task panel data that do not yet exist at scale.
• 摘要：生成式人工智能压缩了任务内的技能差异，同时将经济价值转向集中的互补资产，从而产生了一个明显的悖论：平衡个人绩效的技术可能会扩大总体不平等。我们通过内生教育、雇主筛选和异质公司将这种紧张关系形式化为基于任务的模型。该模型产生了两种制度，其边界取决于人工智能的技术结构（专有与\商品）和劳动力市场制度（租金共享弹性、资产集中度）。通过模拟矩量法进行情景分析，匹配六个经验目标，规范模型的定量幅度；敏感性分解表明，五个非 $\Delta$Gini 矩识别机制率，但不识别聚合符号，其在校准参数下由 $m_6$ 和 $\xi$ 固定，而 AI 的技术结构（$\eta_1$ vs.\ $\eta_0$）独立跨越边界。贡献在于机制——而不是对符号的判断。使用 BLS OEWS 数据（2019--2023）进行的职业级别回归说明了为什么此类数据无法测试模型的任务级别预测。这些预测可以用尚未大规模存在的职业内、任务内面板数据进行测试。

Title: FuseDiff: Symmetry-Preserving Joint Diffusion for Dual-Target Structure-Based Drug Design

• Authors: Jianliang Wu, Anjie Qiao, Zhen Wang, Zhewei Wei, Sheng Chen
• Subjects: cs.LG
• Abstract URL: https://arxiv.org/abs/2603.05567
• Pdf URL: https://arxiv.org/pdf/2603.05567
• Copy Paste: [[2603.05567]] FuseDiff: Symmetry-Preserving Joint Diffusion for Dual-Target Structure-Based Drug Design(https://arxiv.org/abs/2603.05567)
• Keywords: generation
• Abstract: Dual-target structure-based drug design aims to generate a single ligand together with two pocket-specific binding poses, each compatible with a corresponding target pocket, enabling polypharmacological therapies with improved efficacy and reduced resistance. Existing approaches typically rely on staged pipelines, which either decouple the two poses via conditional-independence assumptions or enforce overly rigid correlations, and therefore fail to jointly generate two target-specific binding modes. To address this, we propose FuseDiff, an end-to-end diffusion model that jointly generates a ligand molecular graph and two pocket-specific binding poses conditioned on both pockets. FuseDiff features a message-passing backbone with Dual-target Local Context Fusion (DLCF), which fuses each ligand atom's local context from both pockets to enable expressive joint modeling while preserving the desired symmetries. Together with explicit bond generation, FuseDiff enforces topological consistency across the two poses under a shared graph while allowing target-specific geometric adaptation in each pocket. To support principled training and evaluation, we derive a dual-target training set and use an independent held-out test set for evaluation. Experiments on the benchmark and a real-world dual-target system show that FuseDiff achieves state-of-the-art docking performance and enables the first systematic assessment of dual-target pose quality prior to docking-based pose search.
• 摘要：基于双靶点结构的药物设计旨在生成单个配体和两个口袋特异性结合姿势，每个结合姿势与相应的目标口袋兼容，从而使多药物疗法能够提高疗效并降低耐药性。现有的方法通常依赖于分阶段的管道，它要么通过条件独立假设来解耦两个姿势，要么强制执行过于严格的相关性，因此无法联合生成两个特定于目标的绑定模式。为了解决这个问题，我们提出了 FuseDiff，这是一种端到端扩散模型，可联合生成配体分子图和以两个口袋为条件的两个口袋特异性结合姿势。 FuseDiff 具有具有双目标局部上下文融合 (DLCF) 的消息传递主干，可融合两个口袋中每个配体原子的局部上下文，以实现富有表现力的联合建模，同时保留所需的对称性。与显式键生成一起，FuseDiff 强制共享图下两个姿势的拓扑一致性，同时允许每个口袋中特定于目标的几何适应。为了支持原则性的训练和评估，我们导出了双目标训练集并使用独立的测试集进行评估。在基准测试和真实双目标系统上进行的实验表明，FuseDiff 实现了最先进的对接性能，并能够在基于对接的姿态搜索之前首次对双目标姿态质量进行系统评估。

Title: DreamCAD: Scaling Multi-modal CAD Generation using Differentiable Parametric Surfaces

• Authors: Mohammad Sadil Khan, Muhammad Usama, Rolandos Alexandros Potamias, Didier Stricker, Muhammad Zeshan Afzal, Jiankang Deng, Ismail Elezi
• Subjects: cs.CV, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.05607
• Pdf URL: https://arxiv.org/pdf/2603.05607
• Copy Paste: [[2603.05607]] DreamCAD: Scaling Multi-modal CAD Generation using Differentiable Parametric Surfaces(https://arxiv.org/abs/2603.05607)
• Keywords: generation, generative
• Abstract: Computer-Aided Design (CAD) relies on structured and editable geometric representations, yet existing generative methods are constrained by small annotated datasets with explicit design histories or boundary representation (BRep) labels. Meanwhile, millions of unannotated 3D meshes remain untapped, limiting progress in scalable CAD generation. To address this, we propose DreamCAD, a multi-modal generative framework that directly produces editable BReps from point-level supervision, without CAD-specific annotations. DreamCAD represents each BRep as a set of parametric patches (e.g., Bézier surfaces) and uses a differentiable tessellation method to generate meshes. This enables large-scale training on 3D datasets while reconstructing connected and editable surfaces. Furthermore, we introduce CADCap-1M, the largest CAD captioning dataset to date, with 1M+ descriptions generated using GPT-5 for advancing text-to-CAD research. DreamCAD achieves state-of-the-art performance on ABC and Objaverse benchmarks across text, image, and point modalities, improving geometric fidelity and surpassing 75% user preference. Code and dataset will be publicly available.
• 摘要：计算机辅助设计 (CAD) 依赖于结构化和可编辑的几何表示，但现有的生成方法受到具有明确设计历史或边界表示 (BRep) 标签的小型注释数据集的限制。与此同时，数百万个未注释的 3D 网格仍未得到开发，限制了可扩展 CAD 生成的进展。为了解决这个问题，我们提出了 DreamCAD，这是一种多模式生成框架，可以直接从点级监督生成可编辑的 BReps，而无需 CAD 特定的注释。 DreamCAD 将每个 BRep 表示为一组参数化面片（例如 Bézier 曲面），并使用可微细分方法来生成网格。这使得能够在重建连接且可编辑的表面的同时对 3D 数据集进行大规模训练。此外，我们还引入了 CADCap-1M，这是迄今为止最大的 CAD 字幕数据集，其中使用 GPT-5 生成了超过 100 万条描述，用于推进文本到 CAD 的研究。 DreamCAD 在文本、图像和点模式的 ABC 和 Objaverse 基准测试中实现了最先进的性能，提高了几何保真度并超过了 75% 的用户偏好。代码和数据集将公开。

Title: Making Reconstruction FID Predictive of Diffusion Generation FID

• Authors: Tongda Xu, Mingwei He, Shady Abu-Hussein, Jose Miguel Hernandez-Lobato, Haotian Zhang, Kai Zhao, Chao Zhou, Ya-Qin Zhang, Yan Wang
• Subjects: cs.CV, cs.LG
• Abstract URL: https://arxiv.org/abs/2603.05630
• Pdf URL: https://arxiv.org/pdf/2603.05630
• Copy Paste: [[2603.05630]] Making Reconstruction FID Predictive of Diffusion Generation FID(https://arxiv.org/abs/2603.05630)
• Keywords: generation
• Abstract: It is well known that the reconstruction FID (rFID) of a VAE is poorly correlated with the generation FID (gFID) of a latent diffusion model. We propose interpolated FID (iFID), a simple variant of rFID that exhibits a strong correlation with gFID. Specifically, for each element in the dataset, we retrieve its nearest neighbor (NN) in the latent space and interpolate their latent representations. We then decode the interpolated latent and compute the FID between the decoded samples and the original dataset. Additionally, we refine the claim that rFID correlates poorly with gFID, by showing that rFID correlates with sample quality in the diffusion refinement phase, whereas iFID correlates with sample quality in the diffusion navigation phase. Furthermore, we provide an explanation for why iFID correlates well with gFID, and why reconstruction metrics are negatively correlated with gFID, by connecting to results in the diffusion generalization and hallucination. Empirically, iFID is the first metric to demonstrate a strong correlation with diffusion gFID, achieving Pearson linear and Spearman rank correlations approximately 0.85. The source code is provided in this https URL.
• 摘要：众所周知，VAE 的重建 FID (rFID) 与潜在扩散模型的生成 FID (gFID) 相关性较差。我们提出插值 FID (iFID)，这是 rFID 的一个简单变体，与 gFID 表现出很强的相关性。 Specifically, for each element in the dataset, we retrieve its nearest neighbor (NN) in the latent space and interpolate their latent representations.然后，我们对插值潜伏进行解码并计算解码样本和原始数据集之间的 FID。 Additionally, we refine the claim that rFID correlates poorly with gFID, by showing that rFID correlates with sample quality in the diffusion refinement phase, whereas iFID correlates with sample quality in the diffusion navigation phase. Furthermore, we provide an explanation for why iFID correlates well with gFID, and why reconstruction metrics are negatively correlated with gFID, by connecting to results in the diffusion generalization and hallucination.根据经验，iFID 是第一个证明与扩散 gFID 强相关性的指标，实现了约 0.85 的皮尔逊线性和斯皮尔曼等级相关性。此 https URL 中提供了源代码。

Title: When Rubrics Fail: Error Enumeration as Reward in Reference-Free RL Post-Training for Virtual Try-On

• Authors: Wisdom Ikezogwo, Mehmet Saygin Seyfioglu, Ranjay Krishna, Karim Bouyarmane
• Subjects: cs.CV, cs.AI, cs.LG
• Abstract URL: https://arxiv.org/abs/2603.05659
• Pdf URL: https://arxiv.org/pdf/2603.05659
• Copy Paste: [[2603.05659]] When Rubrics Fail: Error Enumeration as Reward in Reference-Free RL Post-Training for Virtual Try-On(https://arxiv.org/abs/2603.05659)
• Keywords: generation
• Abstract: Reinforcement learning with verifiable rewards (RLVR) and Rubrics as Rewards (RaR) have driven strong gains in domains with clear correctness signals and even in subjective domains by synthesizing evaluation criteria from ideal reference answers. But many real-world tasks admit multiple valid outputs and lack the single ideal answer that rubric generation depends on. We identify this reference-free setting as a gap in current post-training methods and propose Implicit Error Counting (IEC) to fill it. Instead of checking what a response gets right against a rubric, IEC enumerates what it gets wrong, applying severity-weighted scores across task-relevant axes and converting them into calibrated per-aspect rewards. We show that naïve explicit enumeration is too noisy for stable optimization, and that two design choices: implicit score emission and group calibration are necessary to make error counting a reliable reward. As a case study, we validate IEC on virtual try-on (VTO), a domain that is simultaneously too constrained for holistic scoring and too permissive for rubric-based evaluation: subtle garment errors are unacceptable, yet many output variations are correct. We introduce Cascaded Error Counting (CEC) as an evaluation metric, which tracks human preferences well (60% top-1 vs. 30% others), and curate Mismatch-DressCode (MDressBench), a benchmark with maximal attribute mismatch to stress-test reward designs. On MDressBench, IEC outperforms RaR across all metrics (CEC: 5.31 vs. 5.60 on flat references; 5.20 vs. 5.53 on non-flat). On VITON-HD and DressCode, IEC matches or surpasses six baselines on 6 of 8 perceptual metrics. These results suggest that when ideal answers are unavailable, counting errors provide a stronger signal than constructing rubrics.
• 摘要：Reinforcement learning with verifiable rewards (RLVR) and Rubrics as Rewards (RaR) have driven strong gains in domains with clear correctness signals and even in subjective domains by synthesizing evaluation criteria from ideal reference answers.但许多现实世界的任务承认多个有效输出，并且缺乏标题生成所依赖的单一理想答案。我们认为这种无参考设置是当前训练后方法中的一个空白，并提出隐式错误计数（IEC）来填补它。 Instead of checking what a response gets right against a rubric, IEC enumerates what it gets wrong, applying severity-weighted scores across task-relevant axes and converting them into calibrated per-aspect rewards. We show that naïve explicit enumeration is too noisy for stable optimization, and that two design choices: implicit score emission and group calibration are necessary to make error counting a reliable reward. As a case study, we validate IEC on virtual try-on (VTO), a domain that is simultaneously too constrained for holistic scoring and too permissive for rubric-based evaluation: subtle garment errors are unacceptable, yet many output variations are correct. We introduce Cascaded Error Counting (CEC) as an evaluation metric, which tracks human preferences well (60% top-1 vs. 30% others), and curate Mismatch-DressCode (MDressBench), a benchmark with maximal attribute mismatch to stress-test reward designs.在 MDressBench 上，IEC 在所有指标上均优于 RaR（CEC：平坦参考上为 5.31 与 5.60；非平坦参考上为 5.20 与 5.53）。在 VITON-HD 和 DressCode 上，IEC 在 8 个感知指标中的 6 个指标上达到或超过了 6 个基线。这些结果表明，当无法获得理想答案时，计算错误会比构建评分细则提供更强的信号。

Title: OWL: A Novel Approach to Machine Perception During Motion

• Authors: Daniel Raviv, Juan D. Yepes
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.05686
• Pdf URL: https://arxiv.org/pdf/2603.05686
• Copy Paste: [[2603.05686]] OWL: A Novel Approach to Machine Perception During Motion(https://arxiv.org/abs/2603.05686)
• Keywords: generation
• Abstract: We introduce a perception-related function, OWL, designed to address the complex challenges of 3D perception during motion. It derives its values directly from two fundamental visual motion cues, with one set of cue values per point per time instant. During motion, two visual motion cues relative to a fixation point emerge: 1) perceived local visual looming of points near the fixation point, and 2) perceived rotation of the rigid object relative to the fixation point. It also expresses the relation between two well-known physical quantities, the relative instantaneous directional range and directional translation in 3D between the camera and any visible 3D point, without explicitly requiring their measurement or prior knowledge of their individual values. OWL offers a unified, analytical time-based approach that enhances and simplifies key perception capabilities, including scaled 3D mapping and camera heading. Simulations demonstrate that OWL achieves geometric constancy of 3D objects over time and enables scaled 3D scene reconstruction from visual motion cues alone. By leveraging direct measurements from raw visual motion image sequences, OWL values can be obtained without prior knowledge of stationary environments, moving objects, or camera motion. This approach employs minimalistic, pixel-based, parallel computations, providing an alternative real-time representation for 3D points in relative motion. OWL bridges the gap between theoretical concepts and practical applications in robotics and autonomous navigation and may unlock new possibilities for real-time decision-making and interaction, potentially serving as a building block for next-generation autonomous systems. This paper offers an alternative perspective on machine perception, with implications that may extend to natural perception and contribute to a better understanding of behavioral psychology and neural functionality.
• 摘要：我们引入了一种与感知相关的函数 OWL，旨在解决运动过程中 3D 感知的复杂挑战。它直接从两个基本的视觉运动线索中得出其值，每个时刻每个点都有一组线索值。在运动过程中，出现相对于注视点的两种视觉运动线索：1）感知到注视点附近的点的局部视觉隐现，以及2）感知到刚性物体相对于注视点的旋转。它还表达了两个众所周知的物理量之间的关系，即相机与任何可见 3D 点之间的 3D 相对瞬时方向范围和方向平移，而无需明确要求它们的测量或事先了解它们的各个值。 OWL 提供了一种统一的、基于时间的分析方法，可增强和简化关键感知功能，包括缩放的 3D 映射和摄像头航向。模拟表明，OWL 可以实现 3D 对象随时间的几何恒定性，并能够仅根据视觉运动线索进行缩放的 3D 场景重建。通过利用原始视觉运动图像序列的直接测量，无需事先了解静止环境、移动物体或相机运动即可获得 OWL 值。该方法采用简约、基于像素的并行计算，为相对运动的 3D 点提供替代的实时表示。 OWL 弥合了机器人和自主导航的理论概念与实际应用之间的差距，并可能为实时决策和交互释放新的可能性，有可能成为下一代自主系统的构建块。本文提供了机器感知的另一种视角，其影响可能会扩展到自然感知，并有助于更好地理解行为心理学和神经功能。

Title: Full Dynamic Range Sky-Modelling For Image Based Lighting

• Authors: Ian J. Maquignaz
• Subjects: cs.CV, cs.GR, cs.LG
• Abstract URL: https://arxiv.org/abs/2603.05758
• Pdf URL: https://arxiv.org/pdf/2603.05758
• Copy Paste: [[2603.05758]] Full Dynamic Range Sky-Modelling For Image Based Lighting(https://arxiv.org/abs/2603.05758)
• Keywords: generation
• Abstract: Accurate environment maps are a key component to modelling real-world outdoor scenes. They enable captivating visual arts, immersive virtual reality and a wide range of scientific and engineering applications. To alleviate the burden of physical-capture, physically-simulation and volumetric rendering, sky-models have been proposed as fast, flexible, and cost-saving alternatives. In recent years, sky-models have been extended through deep learning to be more comprehensive and inclusive of cloud formations, but recent work has demonstrated these models fall short in faithfully recreating accurate and photorealistic natural skies. Particularly at higher resolutions, DNN sky-models struggle to accurately model the 14EV+ class-imbalanced solar region, resulting in poor visual quality and scenes illuminated with skewed light transmission, shadows and tones. In this work, we propose Icarus, an all-weather sky-model capable of learning the exposure range of Full Dynamic Range (FDR) physically captured outdoor imagery. Our model allows conditional generation of environment maps with intuitive user-positioning of solar and cloud formations, and extends on current state-of-the-art to enable user-controlled texturing of atmospheric formations. Through our evaluation, we demonstrate Icarus is interchangeable with FDR physically captured outdoor imagery or parametric sky-models, and illuminates scenes with unprecedented accuracy, photorealism, lighting directionality (shadows), and tones in Image Based Lightning (IBL).
• 摘要：准确的环境地图是对真实户外场景进行建模的关键组成部分。它们能够实现迷人的视觉艺术、沉浸式虚拟现实以及广泛的科学和工程应用。为了减轻物理捕捉、物理模拟和体积渲染的负担，天空模型被认为是快速、灵活且节省成本的替代方案。近年来，天空模型通过深度学习得到了扩展，变得更加全面和包容云层，但最近的工作表明这些模型在忠实地再现准确和逼真的自然天空方面存在缺陷。特别是在更高分辨率的情况下，DNN 天空模型很难准确地模拟 14EV+ 级不平衡的太阳区域，从而导致视觉质量不佳以及光传输、阴影和色调倾斜的场景。在这项工作中，我们提出了 Icarus，一种全天候天空模型，能够学习全动态范围 (FDR) 物理捕捉的户外图像的曝光范围。我们的模型允许通过直观的用户定位太阳和云层来有条件地生成环境地图，并扩展当前最先进的技术以实现用户控制的大气层纹理。通过我们的评估，我们证明 Icarus 可以与 FDR 物理捕捉的户外图像或参数化天空模型互换，并以前所未有的精度、真实感、照明方向性（阴影）和基于图像的闪电 (IBL) 中的色调照亮场景。

Title: Score-Guided Proximal Projection: A Unified Geometric Framework for Rectified Flow Editing

• Authors: Vansh Bansal, James G Scott
• Subjects: cs.LG
• Abstract URL: https://arxiv.org/abs/2603.05761
• Pdf URL: https://arxiv.org/pdf/2603.05761
• Copy Paste: [[2603.05761]] Score-Guided Proximal Projection: A Unified Geometric Framework for Rectified Flow Editing(https://arxiv.org/abs/2603.05761)
• Keywords: generation, generative
• Abstract: Rectified Flow (RF) models achieve state-of-the-art generation quality, yet controlling them for precise tasks -- such as semantic editing or blind image recovery -- remains a challenge. Current approaches bifurcate into inversion-based guidance, which suffers from "geometric locking" by rigidly adhering to the source trajectory, and posterior sampling approximations (e.g., DPS), which are computationally expensive and unstable. In this work, we propose Score-Guided Proximal Projection (SGPP), a unified framework that bridges the gap between deterministic optimization and stochastic sampling. We reformulate the recovery task as a proximal optimization problem, defining an energy landscape that balances fidelity to the input with realism from the pre-trained score field. We theoretically prove that this objective induces a normal contraction property, geometrically guaranteeing that out-of-distribution inputs are snapped onto the data manifold, and it effectively reaches the posterior mode constrained to the manifold. Crucially, we demonstrate that SGPP generalizes state-of-the-art editing methods: RF-inversion is effectively a limiting case of our framework. By relaxing the proximal variance, SGPP enables "soft guidance," offering a continuous, training-free trade-off between strict identity preservation and generative freedom.
• 摘要：整流流 (RF) 模型实现了最先进的生成质量，但控制它们执行精确任务（例如语义编辑或盲图像恢复）仍然是一个挑战。当前的方法分为基于反演的引导和后验采样近似（例如，DPS），前者通过严格遵守源轨迹而受到“几何锁定”的影响，后者计算量大且不稳定。在这项工作中，我们提出了分数引导的近端投影（SGPP），这是一个弥合确定性优化和随机采样之间差距的统一框架。我们将恢复任务重新表述为近端优化问题，定义了一个能量景观，该能量景观平衡了输入的保真度与预训练得分字段的真实性。我们从理论上证明，该目标会产生正常的收缩特性，从几何上保证将分布外的输入捕捉到数据流形上，并且它有效地达到受流形约束的后验模式。至关重要的是，我们证明 SGPP 概括了最先进的编辑方法：RF 反转实际上是我们框架的限制情况。通过放宽近端方差，SGPP 实现了“软指导”，在严格的身份保存和生成自由之间提供连续的、无需训练的权衡。

Title: Layer-wise Instance Binding for Regional and Occlusion Control in Text-to-Image Diffusion Transformers

• Authors: Ruidong Chen, Yancheng Bai, Xuanpu Zhang, Jianhao Zeng, Lanjun Wang, Dan Song, Lei Sun, Xiangxiang Chu, Anan Liu
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.05769
• Pdf URL: https://arxiv.org/pdf/2603.05769
• Copy Paste: [[2603.05769]] Layer-wise Instance Binding for Regional and Occlusion Control in Text-to-Image Diffusion Transformers(https://arxiv.org/abs/2603.05769)
• Keywords: generation
• Abstract: Region-instructed layout control in text-to-image generation is highly practical, yet existing methods suffer from limitations: (i) training-based approaches inherit data bias and often degrade image quality, and (ii) current techniques struggle with occlusion order, limiting real-world usability. To address these issues, we propose LayerBind. By modeling regional generation as distinct layers and binding them during the generation, our method enables precise regional and occlusion controllability. Our motivation stems from the observation that spatial layout and occlusion are established at a very early denoising stage, suggesting that rearranging the early latent structure is sufficient to modify the final output. Building on this, we structure the scheme into two phases: instance initialization and subsequent semantic nursing. (1) First, leveraging the contextual sharing mechanism in multimodal joint attention, Layer-wise Instance Initialization creates per-instance branches that attend to their own regions while anchoring to the shared background. At a designated early step, these branches are fused according to the layer order to form a unified latent with a pre-established layout. (2) Then, Layer-wise Semantic Nursing reinforces regional details and maintains the occlusion order via a layer-wise attention enhancement. Specifically, a sequential layered attention path operates alongside the standard global path, with updates composited under a layer-transparency scheduler. LayerBind is training-free and plug-and-play, serving as a regional and occlusion controller across Diffusion Transformers. Beyond generation, it natively supports editable workflows, allowing for flexible modifications like changing instances or rearranging visible orders. Both qualitative and quantitative results demonstrate LayerBind's effectiveness, highlighting its strong potential for creative applications.
• 摘要：文本到图像生成中的区域指示布局控制非常实用，但现有方法存在局限性：（i）基于训练的方法会继承数据偏差并经常降低图像质量，（ii）当前技术难以解决遮挡顺序，限制了现实世界的可用性。为了解决这些问题，我们提出了 LayerBind。通过将区域生成建模为不同的层并在生成过程中绑定它们，我们的方法可以实现精确的区域和遮挡可控性。我们的动机源于观察到空间布局和遮挡是在非常早期的去噪阶段建立的，这表明重新排列早期潜在结构足以修改最终输出。在此基础上，我们将该方案分为两个阶段：实例初始化和随后的语义护理。 (1) 首先，利用多模态联合注意力中的上下文共享机制，逐层实例初始化创建每个实例的分支，这些分支关注自己的区域，同时锚定到共享背景。在指定的早期步骤中，这些分支根据层顺序融合，以形成具有预先建立的布局的统一潜在层。 （2）然后，逐层语义护理通过逐层注意增强来增强区域细节并保持遮挡顺序。具体来说，顺序分层注意力路径与标准全局路径一起运行，并在层透明度调度程序下合成更新。 LayerBind 无需训练且即插即用，可用作扩散变压器的区域和遮挡控制器。除了生成之外，它本身还支持可编辑的工作流程，允许灵活的修改，例如更改实例或重新排列可见订单。定性和定量结果都证明了 LayerBind 的有效性，凸显了其创意应用的强大潜力。

Title: Training-free Latent Inter-Frame Pruning with Attention Recovery

• Authors: Dennis Menn, Yuedong Yang, Bokun Wang, Xiwen Wei, Mustafa Munir, Feng Liang, Radu Marculescu, Chenfeng Xu, Diana Marculescu
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.05811
• Pdf URL: https://arxiv.org/pdf/2603.05811
• Copy Paste: [[2603.05811]] Training-free Latent Inter-Frame Pruning with Attention Recovery(https://arxiv.org/abs/2603.05811)
• Keywords: generation, generative
• Abstract: Current video generation models suffer from high computational latency, making real-time applications prohibitively costly. In this paper, we address this limitation by exploiting the temporal redundancy inherent in video latent patches. To this end, we propose the Latent Inter-frame Pruning with Attention Recovery (LIPAR) framework, which detects and skips recomputing duplicated latent patches. Additionally, we introduce a novel Attention Recovery mechanism that approximates the attention values of pruned tokens, thereby removing visual artifacts arising from naively applying the pruning method. Empirically, our method increases video editing throughput by $1.45\times$, on average achieving 12.2 FPS on an NVIDIA A6000 compared to the baseline 8.4 FPS. The proposed method does not compromise generation quality and can be seamlessly integrated with the model without additional training. Our approach effectively bridges the gap between traditional compression algorithms and modern generative pipelines.
• 摘要：当前的视频生成模型存在较高的计算延迟，使得实时应用程序的成本过高。在本文中，我们通过利用视频潜在补丁中固有的时间冗余来解决这一限制。为此，我们提出了带有注意力恢复的潜在帧间修剪（LIPAR）框架，该框架检测并跳过重新计算重复的潜在补丁。此外，我们引入了一种新颖的注意力恢复机制，该机制可以近似修剪标记的注意力值，从而消除因单纯应用修剪方法而产生的视觉伪影。根据经验，我们的方法将视频编辑吞吐量提高了 1.45 倍，在 NVIDIA A6000 上平均实现 12.2 FPS，而基准为 8.4 FPS。所提出的方法不会影响生成质量，并且可以与模型无缝集成，无需额外的训练。我们的方法有效地弥合了传统压缩算法和现代生成管道之间的差距。

Title: Test-Time Adaptation via Many-Shot Prompting: Benefits, Limits, and Pitfalls

• Authors: Shubhangi Upasani, Chen Wu, Jay Rainton, Bo Li, Changran Hu, Qizheng Zhang, Urmish Thakker
• Subjects: cs.LG, cs.CL
• Abstract URL: https://arxiv.org/abs/2603.05829
• Pdf URL: https://arxiv.org/pdf/2603.05829
• Copy Paste: [[2603.05829]] Test-Time Adaptation via Many-Shot Prompting: Benefits, Limits, and Pitfalls(https://arxiv.org/abs/2603.05829)
• Keywords: generation
• Abstract: Test-time adaptation enables large language models (LLMs) to modify their behavior at inference without updating model parameters. A common approach is many-shot prompting, where large numbers of in-context learning (ICL) examples are injected as an input-space test-time update. Although performance can improve as more demonstrations are added, the reliability and limits of this update mechanism remain poorly understood, particularly for open-source models. We present an empirical study of many-shot prompting across tasks and model backbones, analyzing how performance varies with update magnitude, example ordering, and selection policy. We further study Dynamic and Reinforced ICL as alternative test-time update strategies that control which information is injected and how it constrains model behavior. We find that many-shot prompting is effective for structured tasks where demonstrations provide high information gain, but is highly sensitive to selection strategy and often shows limited benefits for open-ended generation tasks. Overall, we characterize the practical limits of prompt-based test-time adaptation and outline when input-space updates are beneficial versus harmful.
• 摘要：测试时适应使大型语言模型 (LLM) 能够在推理时修改其行为，而无需更新模型参数。一种常见的方法是多次提示，其中注入大量上下文学习（ICL）示例作为输入空间测试时间更新。尽管随着添加更多演示，性能可以提高，但这种更新机制的可靠性和局限性仍然知之甚少，特别是对于开源模型。我们提出了跨任务和模型主干的多次提示的实证研究，分析了性能如何随更新幅度、示例排序和选择策略而变化。我们进一步研究动态和强化 ICL 作为替代测试时更新策略，控制注入哪些信息以及如何约束模型行为。我们发现，多次提示对于结构化任务是有效的，其中演示提供了高信息增益，但对选择策略高度敏感，并且通常对开放式生成任务显示出有限的好处。总的来说，我们描述了基于提示的测试时间适应的实际限制，并概述了输入空间更新何时有益与有害。

Title: Cog2Gen3D: Sculpturing 3D Semantic-Geometric Cognition for 3D Generation

• Authors: Haonan Wang, Hanyu Zhou, Haoyue Liu, Tao Gu, Luxin Yan
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.05845
• Pdf URL: https://arxiv.org/pdf/2603.05845
• Copy Paste: [[2603.05845]] Cog2Gen3D: Sculpturing 3D Semantic-Geometric Cognition for 3D Generation(https://arxiv.org/abs/2603.05845)
• Keywords: generation, generative
• Abstract: Generative models have achieved success in producing semantically plausible 2D images, but it remains challenging in 3D generation due to the absence of spatial geometry constraints. Typically, existing methods utilize geometric features as conditions to enhance spatial awareness. However, these methods can only model relative relationships and are prone to scale inconsistency of absolute geometry. Thus, we argue that semantic information and absolute geometry empower 3D cognition, thereby enabling controllable 3D generation for the physical world. In this work, we propose Cog2Gen3D, a 3D cognition-guided diffusion framework for 3D generation. Our model is guided by three key designs: 1) Cognitive Feature Embeddings. We encode different modalities into semantic and geometric representations and further extract logical representations. 2) 3D Latent Cognition Graph. We structure different representations into dual-stream semantic-geometric graphs and fuse them via common-based cross-attention to obtain a 3D cognition graph. 3) Cognition-Guided Latent Diffusion. We leverage the fused 3D cognition graph as the condition to guide the latent diffusion process for 3D Gaussian generation. Under this unified framework, the 3D cognition graph ensures the physical plausibility and structural rationality of 3D generation. Moreover, we construct a validation subset based on the Marble World Labs. Extensive experiments demonstrate that our Cog2Gen3D significantly outperforms existing methods in both semantic fidelity and geometric plausibility.
• 摘要：生成模型在生成语义上合理的 2D 图像方面取得了成功，但由于缺乏空间几何约束，在 3D 生成中仍然具有挑战性。通常，现有方法利用几何特征作为增强空间意识的条件。然而，这些方法只能模拟相对关系，并且容易出现绝对几何尺寸的不一致。因此，我们认为语义信息和绝对几何增强了 3D 认知，从而实现了物理世界的可控 3D 生成。在这项工作中，我们提出了 Cog2Gen3D，一种用于 3D 生成的 3D 认知引导扩散框架。我们的模型以三个关键设计为指导：1）认知特征嵌入。我们将不同的模态编码为语义和几何表示，并进一步提取逻辑表示。 2) 3D 潜在认知图。我们将不同的表示构造成双流语义几何图，并通过基于公共的交叉注意力将它们融合以获得 3D 认知图。 3）认知引导的潜在扩散。我们利用融合的 3D 认知图作为条件来指导 3D 高斯生成的潜在扩散过程。在这个统一的框架下，3D认知图保证了3D生成的物理合理性和结构合理性。此外，我们基于 Marble World Labs 构建了一个验证子集。大量实验表明，我们的 Cog2Gen3D 在语义保真度和几何合理性方面均显着优于现有方法。

Title: VS3R: Robust Full-frame Video Stabilization via Deep 3D Reconstruction

• Authors: Muhua Zhu, Xinhao Jin, Yu Zhang, Yifei Xue, Tie Ji, Yizhen Lao
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.05851
• Pdf URL: https://arxiv.org/pdf/2603.05851
• Copy Paste: [[2603.05851]] VS3R: Robust Full-frame Video Stabilization via Deep 3D Reconstruction(https://arxiv.org/abs/2603.05851)
• Keywords: generative
• Abstract: Video stabilization aims to mitigate camera shake but faces a fundamental trade-off between geometric robustness and full-frame consistency. While 2D methods suffer from aggressive cropping, 3D techniques are often undermined by fragile optimization pipelines that fail under extreme motions. To bridge this gap, we propose VS3R, a framework that synergizes feed-forward 3D reconstruction with generative video diffusion. Our pipeline jointly estimates camera parameters, depth, and masks to ensure all-scenario reliability, and introduces a Hybrid Stabilized Rendering module that fuses semantic and geometric cues for dynamic consistency. Finally, a Dual-Stream Video Diffusion Model restores disoccluded regions and rectifies artifacts by synergizing structural guidance with semantic anchors. Collectively, VS3R achieves high-fidelity, full-frame stabilization across diverse camera models and significantly outperforms state-of-the-art methods in robustness and visual quality.
• 摘要：视频稳定旨在减轻相机抖动，但面临几何鲁棒性和全帧一致性之间的根本权衡。虽然 2D 方法会受到过度裁剪的影响，但 3D 技术往往会受到脆弱的优化管道的影响，这些优化管道在极端运动下会失败。为了弥补这一差距，我们提出了 VS3R，这是一个将前馈 3D 重建与生成视频扩散相结合的框架。我们的管道联合估计相机参数、深度和掩模，以确保所有场景的可靠性，并引入混合稳定渲染模块，该模块融合语义和几何线索以实现动态一致性。最后，双流视频扩散模型通过协同结构指导与语义锚来恢复被遮挡的区域并纠正伪影。总的来说，VS3R 在不同的相机型号上实现了高保真、全帧稳定，并且在鲁棒性和视觉质量方面显着优于最先进的方法。

Title: TumorChain: Interleaved Multimodal Chain-of-Thought Reasoning for Traceable Clinical Tumor Analysis

• Authors: Sijing Li, Zhongwei Qiu, Jiang Liu, Wenqiao Zhang, Tianwei Lin, Yihan Xie, Jianxiang An, Boxiang Yun, Chenglin Yang, Jun Xiao, Guangyu Guo, Jiawen Yao, Wei Liu, Yuan Gao, Ke Yan, Weiwei Cao, Zhilin Zheng, Tony C. W. Mok, Kai Cao, Yu Shi, Jiuyu Zhang, Jian Zhou, Beng Chin Ooi, Yingda Xia, Ling Zhang
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.05867
• Pdf URL: https://arxiv.org/pdf/2603.05867
• Copy Paste: [[2603.05867]] TumorChain: Interleaved Multimodal Chain-of-Thought Reasoning for Traceable Clinical Tumor Analysis(https://arxiv.org/abs/2603.05867)
• Keywords: generation
• Abstract: Accurate tumor analysis is central to clinical radiology and precision oncology, where early detection, reliable lesion characterization, and pathology-level risk assessment guide diagnosis and treatment planning. Chain-of-Thought (CoT) reasoning is particularly important in this setting because it enables step-by-step interpretation from imaging findings to clinical impressions and pathology conclusions, improving traceability and reducing diagnostic errors. Here, we target the clinical tumor analysis task and build a large-scale benchmark that operationalizes a multimodal reasoning pipeline, spanning findings, impressions, and pathology predictions. We curate TumorCoT, a large-scale dataset of 1.5M CoT-labeled VQA instructions paired with 3D CT scans, with step-aligned rationales and cross-modal alignments along the trajectory from findings to impression to pathology, enabling evaluation of both answer accuracy and reasoning consistency. We further propose TumorChain, a multimodal interleaved reasoning framework that tightly couples 3D imaging encoders, clinical text understanding, and organ-level vision-language alignment. Through cross-modal alignment and iterative interleaved causal reasoning, TumorChain grounds visual evidence, aggregates conclusions, and issues pathology predictions after multiple rounds of self-refinement, improving traceability and reducing hallucination risk. Experiments show consistent improvements over strong baselines in lesion detection, impression generation, and pathology classification, and demonstrate strong generalization on the DeepTumorVQA benchmark. These results highlight the potential of multimodal reasoning for reliable and interpretable tumor analysis in clinical practice. Detailed information about our project can be found on our project homepage at this https URL.
• 摘要：准确的肿瘤分析是临床放射学和精准肿瘤学的核心，其中早期检测、可靠的病变特征和病理级风险评估指导诊断和治疗计划。思想链 (CoT) 推理在这种情况下尤其重要，因为它可以逐步解释从影像学发现到临床印象和病理学结论，从而提高可追溯性并减少诊断错误。在这里，我们针对临床肿瘤分析任务，并建立了一个大规模基准，可操作多模式推理管道，涵盖发现、印象和病理学预测。我们策划了 TumorCoT，这是一个由 1.5M CoT 标记的 VQA 指令组成的大规模数据集，与 3D CT 扫描配对，沿着从发现到印象到病理的轨迹，具有逐步对齐的基本原理和跨模式对齐，从而能够评估答案准确性和推理一致性。我们进一步提出了 TumorChain，一种多模态交错推理框架，它将 3D 成像编码器、临床文本理解和器官级视觉语言对齐紧密结合在一起。通过跨模态对齐和迭代交错因果推理，TumorChain 经过多轮自我完善后，根据视觉证据、汇总结论并发出病理预测，提高可追溯性并降低幻觉风险。实验表明，在病变检测、印象生成和病理分类方面比强基线有了一致的改进，并在 DeepTumorVQA 基准上展示了强大的泛化能力。这些结果凸显了多模式推理在临床实践中进行可靠且可解释的肿瘤分析的潜力。有关我们项目的详细信息可以在我们的项目主页上找到，网址为 https URL。

Title: Systematic Evaluation of Novel View Synthesis for Video Place Recognition

• Authors: Muhammad Zawad Mahmud, Samiha Islam, Damian Lyons
• Subjects: cs.CV, cs.RO
• Abstract URL: https://arxiv.org/abs/2603.05876
• Pdf URL: https://arxiv.org/pdf/2603.05876
• Copy Paste: [[2603.05876]] Systematic Evaluation of Novel View Synthesis for Video Place Recognition(https://arxiv.org/abs/2603.05876)
• Keywords: generation
• Abstract: The generation of synthetic novel views has the potential to positively impact robot navigation in several ways. In image-based navigation, a novel overhead view generated from a scene taken by a ground robot could be used to guide an aerial robot to that location. In Video Place Recognition (VPR), novel views of ground locations from the air can be added that enable a UAV to identify places seen by the ground robot, and similarly, overhead views can be used to generate novel ground views. This paper presents a systematic evaluation of synthetic novel views in VPR using five public VPR image databases and seven typical image similarity methods. We show that for small synthetic additions, novel views improve VPR recognition statistics. We find that for larger additions, the magnitude of viewpoint change is less important than the number of views added and the type of imagery in the dataset.
• 摘要：合成新颖视图的生成有可能以多种方式对机器人导航产生积极影响。在基于图像的导航中，地面机器人拍摄的场景生成的新颖俯视图可用于引导空中机器人到达该位置。在视频地点识别（VPR）中，可以添加从空中观察地面位置的新视图，使无人机能够识别地面机器人看到的位置，同样，俯视图可用于生成新的地面视图。本文使用五个公共 VPR 图像数据库和七种典型的图像相似性方法对 VPR 中的合成新颖视图进行系统评估。我们表明，对于小的合成添加，新颖的视图可以改善 VPR 识别统计数据。我们发现，对于较大的添加，视点变化的幅度不如添加的视图数量和数据集中的图像类型重要。

Title: PixARMesh: Autoregressive Mesh-Native Single-View Scene Reconstruction

• Authors: Xiang Zhang, Sohyun Yoo, Hongrui Wu, Chuan Li, Jianwen Xie, Zhuowen Tu
• Subjects: cs.CV, cs.GR, cs.LG
• Abstract URL: https://arxiv.org/abs/2603.05888
• Pdf URL: https://arxiv.org/pdf/2603.05888
• Copy Paste: [[2603.05888]] PixARMesh: Autoregressive Mesh-Native Single-View Scene Reconstruction(https://arxiv.org/abs/2603.05888)
• Keywords: generative
• Abstract: We introduce PixARMesh, a method to autoregressively reconstruct complete 3D indoor scene meshes directly from a single RGB image. Unlike prior methods that rely on implicit signed distance fields and post-hoc layout optimization, PixARMesh jointly predicts object layout and geometry within a unified model, producing coherent and artist-ready meshes in a single forward pass. Building on recent advances in mesh generative models, we augment a point-cloud encoder with pixel-aligned image features and global scene context via cross-attention, enabling accurate spatial reasoning from a single image. Scenes are generated autoregressively from a unified token stream containing context, pose, and mesh, yielding compact meshes with high-fidelity geometry. Experiments on synthetic and real-world datasets show that PixARMesh achieves state-of-the-art reconstruction quality while producing lightweight, high-quality meshes ready for downstream applications.
• 摘要：我们介绍 PixARMesh，这是一种直接从单个 RGB 图像自回归重建完整 3D 室内场景网格的方法。与依赖隐式符号距离场和事后布局优化的先前方法不同，PixARMesh 在统一模型中联合预测对象布局和几何形状，在单个前向传递中生成连贯且适合艺术家的网格。基于网格生成模型的最新进展，我们通过交叉注意力增强了具有像素对齐图像特征和全局场景上下文的点云编码器，从而能够从单个图像进行准确的空间推理。场景是从包含上下文、姿势和网格的统一标记流中自回归生成的，从而生成具有高保真几何形状的紧凑网格。对合成数据集和真实数据集的实验表明，PixARMesh 实现了最先进的重建质量，同时生成可供下游应用使用的轻量级高质量网格。

Title: InnoAds-Composer: Efficient Condition Composition for E-Commerce Poster Generation

• Authors: Yuxin Qin, Ke Cao, Haowei Liu, Ao Ma, Fengheng Li, Honghe Zhu, Zheng Zhang, Run Ling, Wei Feng, Xuanhua He, Zhanjie Zhang, Zhen Guo, Haoyi Bian, Jingjing Lv, Junjie Shen, Ching Law
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.05898
• Pdf URL: https://arxiv.org/pdf/2603.05898
• Copy Paste: [[2603.05898]] InnoAds-Composer: Efficient Condition Composition for E-Commerce Poster Generation(https://arxiv.org/abs/2603.05898)
• Keywords: generation
• Abstract: E-commerce product poster generation aims to automatically synthesize a single image that effectively conveys product information by presenting a subject, text, and a designed style. Recent diffusion models with fine-grained and efficient controllability have advanced product poster synthesis, yet they typically rely on multi-stage pipelines, and simultaneous control over subject, text, and style remains underexplored. Such naive multi-stage pipelines also show three issues: poor subject fidelity, inaccurate text, and inconsistent style. To address these issues, we propose InnoAds-Composer, a single-stage framework that enables efficient tri-conditional control tokens over subject, glyph, and style. To alleviate the quadratic overhead introduced by naive tri-conditional token concatenation, we perform importance analysis over layers and timesteps and route each condition only to the most responsive positions, thereby shortening the active token sequence. Besides, to improve the accuracy of Chinese text rendering, we design a Text Feature Enhancement Module (TFEM) that integrates features from both glyph images and glyph crops. To support training and evaluation, we also construct a high-quality e-commerce product poster dataset and benchmark, which is the first dataset that jointly contains subject, text, and style conditions. Extensive experiments demonstrate that InnoAds-Composer significantly outperforms existing product poster methods without obviously increasing inference latency.
• 摘要：电商产品海报生成旨在自动合成一张图像，通过呈现主题、文本和设计风格来有效传达产品信息。最近具有细粒度和高效可控性的扩散模型具有先进的产品海报合成，但它们通常依赖于多级管道，并且对主题、文本和风格的同步控制仍未得到充分探索。这种幼稚的多阶段管道还显示出三个问题：主题保真度差、文本不准确和风格不一致。为了解决这些问题，我们提出了 InnoAds-Composer，这是一个单阶段框架，可实现对主题、字形和样式的高效三条件控制标记。为了减轻朴素三条件令牌串联带来的二次开销，我们对层和时间步执行重要性分析，并将每个条件仅路由到最响应的位置，从而缩短活动令牌序列。此外，为了提高中文文本渲染的准确性，我们设计了一个文本特征增强模块（TFEM），它集成了字形图像和字形裁剪的特征。为了支持训练和评估，我们还构建了高质量的电子商务产品海报数据集和基准，这是第一个共同包含主题、文本和风格条件的数据集。大量实验表明，InnoAds-Composer 显着优于现有的产品海报方法，并且没有明显增加推理延迟。

Title: Pano3DComposer: Feed-Forward Compositional 3D Scene Generation from Single Panoramic Image

• Authors: Zidian Qiu, Ancong Wu
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.05908
• Pdf URL: https://arxiv.org/pdf/2603.05908
• Copy Paste: [[2603.05908]] Pano3DComposer: Feed-Forward Compositional 3D Scene Generation from Single Panoramic Image(https://arxiv.org/abs/2603.05908)
• Keywords: generation
• Abstract: Current compositional image-to-3D scene generation approaches construct 3D scenes by time-consuming iterative layout optimization or inflexible joint object-layout generation. Moreover, most methods rely on limited field-of-view perspective images, hindering the creation of complete 360-degree environments. To address these limitations, we design Pano3DComposer, an efficient feed-forward framework for panoramic images. To decouple object generation from layout estimation, we propose a plug-and-play Object-World Transformation Predictor. This module converts the 3D objects generated by off-the-shelf image-to-3D models from local to world coordinates. To achieve this, we adapt the VGGT architecture to Alignment-VGGT by using target object crop, multi-view object renderings and camera parameters to predict the transformation. The predictor is trained using pseudo-geometric supervision to address the shape discrepancy between generated and ground-truth objects. For input images from unseen domains, we further introduce a Coarse-to-Fine (C2F) alignment mechanism for Pano3DComposer that iteratively refines geometric consistency with feedback of scene rendering. Our method achieves superior geometric accuracy for image/text-to-3D tasks on synthetic and real-world datasets. It can generate a high-fidelity 3D scene in approximately 20 seconds on an RTX 4090 GPU. Project page: this https URL.
• 摘要：当前的合成图像到 3D 场景生成方法通过耗时的迭代布局优化或不灵活的联合对象布局生成来构建 3D 场景。此外，大多数方法依赖于有限视场的透视图像，阻碍了完整的 360 度环境的创建。为了解决这些限制，我们设计了 Pano3DComposer，这是一种高效的全景图像前馈框架。为了将对象生成与布局估计分离，我们提出了一种即插即用的对象世界转换预测器。该模块将现成图像生成的 3D 对象从本地坐标转换为 3D 模型。为了实现这一目标，我们通过使用目标对象裁剪、多视图对象渲染和相机参数来预测变换，从而使 VGGT 架构适应 Alignment-VGGT。使用伪几何监督对预测器进行训练，以解决生成的对象与真实对象之间的形状差异。对于来自看不见的域的输入图像，我们进一步引入了 Pano3DComposer 的粗到细（C2F）对齐机制，该机制通过场景渲染的反馈迭代地细化几何一致性。我们的方法在合成和真实数据集上的图像/文本到 3D 任务中实现了卓越的几何精度。它可以在 RTX 4090 GPU 上大约 20 秒内生成高保真 3D 场景。项目页面：此 https URL。

Title: BlackMirror: Black-Box Backdoor Detection for Text-to-Image Models via Instruction-Response Deviation

• Authors: Feiran Li, Qianqian Xu, Shilong Bao, Zhiyong Yang, Xilin Zhao, Xiaochun Cao, Qingming Huang
• Subjects: cs.CV, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.05921
• Pdf URL: https://arxiv.org/pdf/2603.05921
• Copy Paste: [[2603.05921]] BlackMirror: Black-Box Backdoor Detection for Text-to-Image Models via Instruction-Response Deviation(https://arxiv.org/abs/2603.05921)
• Keywords: generation
• Abstract: This paper investigates the challenging task of detecting backdoored text-to-image models under black-box settings and introduces a novel detection framework BlackMirror. Existing approaches typically rely on analyzing image-level similarity, under the assumption that backdoor-triggered generations exhibit strong consistency across samples. However, they struggle to generalize to recently emerging backdoor attacks, where backdoored generations can appear visually diverse. BlackMirror is motivated by an observation: across backdoor attacks, {only partial semantic patterns within the generated image are steadily manipulated, while the rest of the content remains diverse or benign. Accordingly, BlackMirror consists of two components: MirrorMatch, which aligns visual patterns with the corresponding instructions to detect semantic deviations; and MirrorVerify, which evaluates the stability of these deviations across varied prompts to distinguish true backdoor behavior from benign responses. BlackMirror is a general, training-free framework that can be deployed as a plug-and-play module in Model-as-a-Service (MaaS) applications. Comprehensive experiments demonstrate that BlackMirror achieves accurate detection across a wide range of attacks. Code is available at this https URL.
• 摘要：本文研究了在黑盒设置下检测后门文本到图像模型的挑战性任务，并介绍了一种新颖的检测框架 BlackMirror。现有方法通常依赖于分析图像级相似性，假设后门触发的生成在样本之间表现出很强的一致性。然而，他们很难推广到最近出现的后门攻击，其中后门的世代可能在视觉上表现出多样性。 BlackMirror 的动机是观察到：在后门攻击中，{只有生成的图像中的部分语义模式被稳定地操纵，而其余内容保持多样化或良性。因此，BlackMirror 由两个组件组成： MirrorMatch，将视觉模式与相应的指令对齐以检测语义偏差； MirrorVerify，它评估不同提示下这些偏差的稳定性，以区分真正的后门行为和良性响应。 BlackMirror 是一种通用的免培训框架，可以作为即插即用模块部署在模型即服务 (MaaS) 应用程序中。综合实验表明，BlackMirror 可实现对多种攻击的准确检测。代码可从此 https URL 获取。

Title: RAC: Rectified Flow Auto Coder

• Authors: Sen Fang, Yalin Feng, Yanxin Zhang, Dimitris N. Metaxas
• Subjects: cs.CV, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.05925
• Pdf URL: https://arxiv.org/pdf/2603.05925
• Copy Paste: [[2603.05925]] RAC: Rectified Flow Auto Coder(https://arxiv.org/abs/2603.05925)
• Keywords: generation, generative
• Abstract: In this paper, we propose a Rectified Flow Auto Coder (RAC) inspired by Rectified Flow to replace the traditional VAE: 1. It achieves multi-step decoding by applying the decoder to flow timesteps. Its decoding path is straight and correctable, enabling step-by-step refinement. 2. The model inherently supports bidirectional inference, where the decoder serves as the encoder through time reversal (hence Coder rather than encoder or decoder), reducing parameter count by nearly 41%. 3. This generative decoding method improves generation quality since the model can correct latent variables along the path, partially addressing the reconstruction--generation gap. Experiments show that RAC surpasses SOTA VAEs in both reconstruction and generation with approximately 70% lower computational cost.
• 摘要：在本文中，我们受到整流流的启发，提出了一种整流流自动编码器（RAC）来替代传统的VAE： 1.它通过将解码器应用于流时间步来实现多步解码。其解码路径是直接且可纠正的，可以逐步细化。 2. 该模型本质上支持双向推理，其中解码器通过时间反转充当编码器（因此是编码器而不是编码器或解码器），从而减少了近 41% 的参数数量。 3. 这种生成解码方法提高了生成质量，因为该模型可以纠正路径上的潜在变量，部分解决重建-生成差距。实验表明，RAC 在重建和生成方面均优于 SOTA VAE，计算成本降低约 70%。

Title: FTSplat: Feed-forward Triangle Splatting Network

• Authors: Xiong Jinlin, Li Can, Shen Jiawei, Qi Zhigang, Sun Lei, Zhao Dongyang
• Subjects: cs.CV, cs.RO
• Abstract URL: https://arxiv.org/abs/2603.05932
• Pdf URL: https://arxiv.org/pdf/2603.05932
• Copy Paste: [[2603.05932]] FTSplat: Feed-forward Triangle Splatting Network(https://arxiv.org/abs/2603.05932)
• Keywords: generation
• Abstract: High-fidelity three-dimensional (3D) reconstruction is essential for robotics and simulation. While Neural Radiance Fields (NeRF) and 3D Gaussian Splatting (3DGS) achieve impressive rendering quality, their reliance on time-consuming per-scene optimization limits real-time deployment. Emerging feed-forward Gaussian splatting methods improve efficiency but often lack explicit, manifold geometry required for direct simulation. To address these limitations, we propose a feed-forward framework for triangle primitive generation that directly predicts continuous triangle surfaces from calibrated multi-view images. Our method produces simulation-ready models in a single forward pass, obviating the need for per-scene optimization or post-processing. We introduce a pixel-aligned triangle generation module and incorporate relative 3D point cloud supervision to enhance geometric learning stability and consistency. Experiments demonstrate that our method achieves efficient reconstruction while maintaining seamless compatibility with standard graphics and robotic simulators.
• 摘要：高保真度三维 (3D) 重建对于机器人和仿真至关重要。虽然神经辐射场 (NeRF) 和 3D 高斯分布 (3DGS) 实现了令人印象深刻的渲染质量，但它们对耗时的每个场景优化的依赖限制了实时部署。新兴的前馈高斯喷射方法提高了效率，但通常缺乏直接模拟所需的明确的流形几何结构。为了解决这些限制，我们提出了一种用于三角形图元生成的前馈框架，该框架直接从校准的多视图图像中预测连续的三角形表面。我们的方法在一次前向传递中生成可用于仿真的模型，从而无需进行每个场景的优化或后处理。我们引入了像素对齐的三角形生成模块，并结合了相对的 3D 点云监督来增强几何学习的稳定性和一致性。实验表明，我们的方法实现了高效的重建，同时保持与标准图形和机器人模拟器的无缝兼容性。

Title: SLER-IR: Spherical Layer-wise Expert Routing for All-in-One Image Restoration

• Authors: Peng Shurui, Xin Lin, Shi Luo, Jincen Ou, Dizhe Zhang, Lu Qi, Truong Nguyen, Chao Ren
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.05940
• Pdf URL: https://arxiv.org/pdf/2603.05940
• Copy Paste: [[2603.05940]] SLER-IR: Spherical Layer-wise Expert Routing for All-in-One Image Restoration(https://arxiv.org/abs/2603.05940)
• Keywords: restoration
• Abstract: Image restoration under diverse degradations remains challenging for unified all-in-one frameworks due to feature interference and insufficient expert specialization. We propose SLER-IR, a spherical layer-wise expert routing framework that dynamically activates specialized experts across network layers. To ensure reliable routing, we introduce a Spherical Uniform Degradation Embedding with contrastive learning, which maps degradation representations onto a hypersphere to eliminate geometry bias in linear embedding spaces. In addition, a Global-Local Granularity Fusion (GLGF) module integrates global semantics and local degradation cues to address spatially non-uniform degradations and the train-test granularity gap. Experiments on three-task and five-task benchmarks demonstrate that SLER-IR achieves consistent improvements over state-of-the-art methods in both PSNR and SSIM. Code and models will be publicly released.
• 摘要：由于特征干扰和专家专业化不足，不同退化下的图像恢复对于统一的一体化框架仍然具有挑战性。我们提出了 SLER-IR，这是一种球形分层专家路由框架，可以跨网络层动态激活专业专家。为了确保可靠的路由，我们引入了具有对比学习的球形均匀退化嵌入，它将退化表示映射到超球面上，以消除线性嵌入空间中的几何偏差。此外，全局-局部粒度融合（GLGF）模块集成了全局语义和局部降级线索，以解决空间不均匀降级和训练测试粒度差距。三任务和五任务基准测试表明，SLER-IR 在 PSNR 和 SSIM 方面均比最先进的方法取得了一致的改进。代码和模型将公开发布。

Title: LucidNFT: LR-Anchored Multi-Reward Preference Optimization for Generative Real-World Super-Resolution

• Authors: Song Fei, Tian Ye, Sixiang Chen, Zhaohu Xing, Jianyu Lai, Lei Zhu
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.05947
• Pdf URL: https://arxiv.org/pdf/2603.05947
• Copy Paste: [[2603.05947]] LucidNFT: LR-Anchored Multi-Reward Preference Optimization for Generative Real-World Super-Resolution(https://arxiv.org/abs/2603.05947)
• Keywords: super-resolution, generative
• Abstract: Generative real-world image super-resolution (Real-ISR) can synthesize visually convincing details from severely degraded low-resolution (LR) inputs, yet its stochastic sampling makes a critical failure mode hard to avoid: outputs may look sharp but be unfaithful to the LR evidence (semantic and structural hallucination), while such LR-anchored faithfulness is difficult to assess without HR ground truth. Preference-based reinforcement learning (RL) is a natural fit because each LR input yields a rollout group of candidates to compare. However, effective alignment in Real-ISR is hindered by (i) the lack of a degradation-robust LR-referenced faithfulness signal, and (ii) a rollout-group optimization bottleneck where naive multi-reward scalarization followed by normalization compresses objective-wise contrasts, causing advantage collapse and weakening the reward-weighted updates in DiffusionNFT-style forward fine-tuning. Moreover, (iii) limited coverage of real degradations restricts rollout diversity and preference signal quality. We propose LucidNFT, a multi-reward RL framework for flow-matching Real-ISR. LucidNFT introduces LucidConsistency, a degradation-robust semantic evaluator that makes LR-anchored faithfulness measurable and optimizable; a decoupled advantage normalization strategy that preserves objective-wise contrasts within each LR-conditioned rollout group before fusion, preventing advantage collapse; and LucidLR, a large-scale collection of real-world degraded images to support robust RL fine-tuning. Experiments show that LucidNFT consistently improves strong flow-based Real-ISR baselines, achieving better perceptual-faithfulness trade-offs with stable optimization dynamics across diverse real-world scenarios.
• 摘要：生成式现实世界图像超分辨率（Real-ISR）可以从严重退化的低分辨率（LR）输入中合成视觉上令人信服的细节，但其随机采样使得一种关键的故障模式难以避免：输出可能看起来很清晰，但不忠实于 LR 证据（语义和结构幻觉），而这种 LR 锚定的忠实度在没有 HR 地面事实的情况下很难评估。基于偏好的强化学习 (RL) 非常适合，因为每个 LR 输入都会产生一组可供比较的候选对象。然而，Real-ISR 中的有效对齐受到以下因素的阻碍：(i) 缺乏退化稳健的 LR 参考忠实度信号，以及 (ii) 部署组优化瓶颈，其中朴素的多奖励标量化和归一化压缩了目标对比，导致优势崩溃并削弱了 DiffusionNFT 式前向微调中的奖励加权更新。此外，(iii)对实际劣化的有限覆盖限制了推出多样性和偏好信号质量。我们提出了 LucidNFT，一种用于流匹配 Real-ISR 的多奖励 RL 框架。 LucidNFT 引入了 LucidConsistency，这是一种抗退化语义评估器，使 LR 锚定的忠实度可测量和可优化；一种解耦的优势归一化策略，在融合之前保留每个 LR 条件的 rollout 组内的客观对比，防止优势崩溃； LucidLR，一个大规模的现实世界降级图像集合，支持强大的强化学习微调。实验表明，LucidNFT 持续改进基于流的 Real-ISR 基线，在不同的现实场景中通过稳定的优化动态实现更好的感知忠实度权衡。

Title: EvoESAP: Non-Uniform Expert Pruning for Sparse MoE

• Authors: Zongfang Liu, Shengkun Tang, Boyang Sun, Zhiqiang Shen, Xin Yuan
• Subjects: cs.LG
• Abstract URL: https://arxiv.org/abs/2603.06003
• Pdf URL: https://arxiv.org/pdf/2603.06003
• Copy Paste: [[2603.06003]] EvoESAP: Non-Uniform Expert Pruning for Sparse MoE(https://arxiv.org/abs/2603.06003)
• Keywords: generation
• Abstract: Sparse Mixture-of-Experts (SMoE) language models achieve strong capability at low per-token compute, yet deployment remains memory- and throughput-bound because the full expert pool must be stored and served. Post-training expert pruning reduces this cost, but most methods focus on which experts to prune within each layer and default to a uniform layer-wise sparsity allocation, even though the allocation can strongly affect performance. We decouple pruning into within-layer expert ranking and across-layer budget allocation, and introduce \textbf{E}xpected \textbf{S}peculative \textbf{A}cceptance \textbf{P}roxy (\textbf{ESAP}), a speculative-decoding-inspired, teacher-forced metric that measures how well a pruned model matches the full model. ESAP is bounded and stable, enabling cheap comparison of many candidates without costly autoregressive decoding. Building on ESAP, we propose EvoESAP, an evolutionary searching framework that optimizes a non-uniform layer-wise sparsity allocation under a fixed global budget while holding the within-layer pruning order fixed, making it a plug-and-play method with criteria such as Frequency, EAN, SEER, and REAP. Across 7B--30B SMoE LLMs at 25\% and 50\% sparsity, EvoESAP consistently discovers non-uniform allocations that improve open-ended generation (up to \textbf{+19.6\%} on MATH-500 at 50\% sparsity) while preserving competitive multiple-choice accuracy compared with uniform pruning at the same sparsity.
• 摘要：稀疏专家混合 (SMoE) 语言模型以较低的每个令牌计算量实现了强大的功能，但部署仍然受到内存和吞吐量的限制，因为必须存储和提供完整的专家池。训练后专家剪枝降低了这种成本，但大多数方法都专注于在每层内剪枝哪些专家，并默认采用统一的逐层稀疏分配，即使分配会强烈影响性能。我们将剪枝分解为层内专家排名和跨层预算分配，并引入 \textbf{E}xpected \textbf{S}peculative \textbf{A}cceptance \textbf{P}roxy (\textbf{ESAP})，这是一种受推测解码启发、教师强制的指标，用于衡量剪枝模型与完整模型的匹配程度。 ESAP 有界且稳定，可以对许多候选对象进行廉价比较，而无需昂贵的自回归解码。在 ESAP 的基础上，我们提出了 EvoESAP，这是一种进化搜索框架，可以在固定的全局预算下优化非均匀分层稀疏分配，同时保持层内剪枝顺序固定，使其成为具有频率、EAN、SEER 和 REAP 等标准的即插即用方法。在稀疏度为 25% 和 50% 的 7B--30B SMoE LLM 中，EvoESAP 一致发现非均匀分配可以改善开放式生成（在稀疏度为 50% 的 MATH-500 上高达 \textbf{+19.6\%}），同时与相同稀疏度下的均匀修剪相比，保持具有竞争力的多项选择精度。

Title: EffectMaker: Unifying Reasoning and Generation for Customized Visual Effect Creation

• Authors: Shiyuan Yang, Ruihuang Li, Jiale Tao, Shuai Shao, Qinglin Lu, Jing Liao
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.06014
• Pdf URL: https://arxiv.org/pdf/2603.06014
• Copy Paste: [[2603.06014]] EffectMaker: Unifying Reasoning and Generation for Customized Visual Effect Creation(https://arxiv.org/abs/2603.06014)
• Keywords: generation
• Abstract: Visual effects (VFX) are essential for enhancing the expressiveness and creativity of video content, yet producing high-quality effects typically requires expert knowledge and costly production pipelines. Existing AIGC systems face significant challenges in VFX generation due to the scarcity of effect-specific data and the inherent difficulty of modeling supernatural or stylized effects. Moreover, these approaches often require per-effect fine-tuning, which severely limits their scalability and generalization to novel VFX. In this work, we present EffectMaker, a unified reasoning-generation framework that enables reference-based VFX customization. EffectMaker employs a multimodal large language model to interpret high-level effect semantics and reason about how they should adapt to a target subject, while a diffusion transformer leverages in-context learning to capture fine-grained visual cues from reference videos. These two components form a semantic-visual dual-path guidance mechanism that enables accurate, controllable, and effect-consistent synthesis without per-effect fine-tuning. Furthermore, we construct EffectData, the largest high-quality synthetic dataset containing 130k videos across 3k VFX categories, to improve generalization and scalability. Experiments show that EffectMaker achieves superior visual quality and effect consistency over state-of-the-art baselines, offering a scalable and flexible paradigm for customized VFX generation. Project page: this https URL
• 摘要：视觉效果 (VFX) 对于增强视频内容的表现力和创造力至关重要，但制作高质量效果通常需要专业知识和昂贵的制作流程。由于特定效果数据的稀缺以及超自然或风格化效果建模的固有困难，现有 AIGC 系统在视觉特效生成方面面临着重大挑战。此外，这些方法通常需要对每个效果进行微调，这严重限制了它们对新颖视觉特效的可扩展性和泛化。在这项工作中，我们提出了 EffectMaker，一个统一的推理生成框架，可以实现基于参考的 VFX 定制。 EffectMaker 采用多模态大语言模型来解释高级效果语义并推理它们应如何适应目标主题，而扩散转换器则利用上下文学习从参考视频中捕获细粒度的视觉线索。这两个组件形成了语义-视觉双路径引导机制，能够实现准确、可控、效果一致的合成，而无需针对每个效果进行微调。此外，我们构建了 EffectData，这是最大的高质量合成数据集，包含 3k VFX 类别的 130k 视频，以提高泛化性和可扩展性。实验表明，EffectMaker 实现了超越最先进基线的卓越视觉质量和效果一致性，为定制 VFX 生成提供了可扩展且灵活的范例。项目页面：此 https URL

Title: StruVis: Enhancing Reasoning-based Text-to-Image Generation via Thinking with Structured Vision

• Authors: Yuanhuiyi Lyu, Kaiyu Lei, Ziqiao Weng, Xu Zheng, Lutao Jiang, Teng Li, Yangfu Li, Ziyuan Huang, Linfeng Zhang, Xuming Hu
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.06032
• Pdf URL: https://arxiv.org/pdf/2603.06032
• Copy Paste: [[2603.06032]] StruVis: Enhancing Reasoning-based Text-to-Image Generation via Thinking with Structured Vision(https://arxiv.org/abs/2603.06032)
• Keywords: generation
• Abstract: Reasoning-based text-to-image (T2I) generation requires models to interpret complex prompts accurately. Existing reasoning frameworks can be broadly categorized into two types: (1) Text-Only Reasoning, which is computationally efficient but lacks access to visual context, often resulting in the omission of critical spatial and visual elements; and (2) Text-Image Interleaved Reasoning, which leverages a T2I generator to provide visual references during the reasoning process. While this approach enhances visual grounding, it incurs substantial computational costs and constrains the reasoning capacity of MLLMs to the representational limitations of the generator. To this end, we propose StruVis, a novel framework that enhances T2I generation through Thinking with Structured Vision. Instead of relying on intermediate image generation, StruVis employs text-based structured visual representations as intermediate reasoning states, thereby enabling the MLLM to effectively "perceive" visual structure within a purely text-based reasoning process. Powered by this, the reasoning potential for T2I generation of the MLLM is unlocked through structured-vision-guided reasoning. Additionally, as a generator-agnostic reasoning framework, our proposed StruVis can be seamlessly integrated with diverse T2I generators and efficiently enhance their performance in reasoning-based T2I generation. Extensive experiments demonstrate that StruVis achieves significant performance improvements on reasoning-based T2I benchmarks, e.g., a 4.61% gain on T2I-ReasonBench and a 4% gain on WISE.
• 摘要：基于推理的文本到图像 (T2I) 生成需要模型准确解释复杂的提示。现有的推理框架大致可分为两类：（1）纯文本推理，计算效率高，但缺乏对视觉上下文的访问，常常导致关键空间和视觉元素的遗漏； (2) 文本-图像交错推理，利用 T2I 生成器在推理过程中提供视觉参考。虽然这种方法增强了视觉基础，但它会产生大量的计算成本，并将 MLLM 的推理能力限制在生成器的表征限制上。为此，我们提出了 StruVis，这是一种通过结构化视觉思考来增强 T2I 生成的新颖框架。 StruVis 不依赖中间图像生成，而是采用基于文本的结构化视觉表示作为中间推理状态，从而使 MLLM 能够在纯粹基于文本的推理过程中有效地“感知”视觉结构。在此基础上，MLLM 的 T2I 生成的推理潜力通过结构化视觉引导推理得以释放。此外，作为与生成器无关的推理框架，我们提出的 StruVis 可以与各种 T2I 生成器无缝集成，并有效增强其在基于推理的 T2I 生成中的性能。大量实验表明，StruVis 在基于推理的 T2I 基准测试上实现了显着的性能改进，例如，在 T2I-ReasonBench 上提高了 4.61%，在 WISE 上提高了 4%。

Title: FontUse: A Data-Centric Approach to Style- and Use-Case-Conditioned In-Image Typography

• Authors: Xia Xin, Yuki Endo, Yoshihiro Kanamori
• Subjects: cs.CV, cs.GR
• Abstract URL: https://arxiv.org/abs/2603.06038
• Pdf URL: https://arxiv.org/pdf/2603.06038
• Copy Paste: [[2603.06038]] FontUse: A Data-Centric Approach to Style- and Use-Case-Conditioned In-Image Typography(https://arxiv.org/abs/2603.06038)
• Keywords: generation
• Abstract: Recent text-to-image models can generate high-quality images from natural-language prompts, yet controlling typography remains challenging: requested typographic appearance is often ignored or only weakly followed. We address this limitation with a data-centric approach that trains image generation models using targeted supervision derived from a structured annotation pipeline specialized for typography. Our pipeline constructs a large-scale typography-focused dataset, FontUse, consisting of about 70K images annotated with user-friendly prompts, text-region locations, and OCR-recognized strings. The annotations are automatically produced using segmentation models and multimodal large language models (MLLMs). The prompts explicitly combine font styles (e.g., serif, script, elegant) and use cases (e.g., wedding invitations, coffee-shop menus), enabling intuitive specification even for novice users. Fine-tuning existing generators with these annotations allows them to consistently interpret style and use-case conditions as textual prompts without architectural modification. For evaluation, we introduce a Long-CLIP-based metric that measures alignment between generated typography and requested attributes. Experiments across diverse prompts and layouts show that models trained with our pipeline produce text renderings more consistent with prompts than competitive baselines. The source code for our annotation pipeline is available at this https URL.
• 摘要：最近的文本到图像模型可以根据自然语言提示生成高质量的图像，但控制排版仍然具有挑战性：所要求的排版外观经常被忽略或仅弱遵循。我们通过以数据为中心的方法解决了这一限制，该方法使用源自专门用于排版的结构化注释管道的有针对性的监督来训练图像生成模型。我们的管道构建了一个大规模的以排版为中心的数据集 FontUse，由大约 70K 个图像组成，这些图像带有用户友好的提示、文本区域位置和 OCR 识别的字符串。注释是使用分段模型和多模态大语言模型 (MLLM) 自动生成的。提示明确地结合了字体样式（例如，衬线、脚本、优雅）和用例（例如，婚礼请柬、咖啡店菜单），即使对于新手用户也能实现直观的规范。使用这些注释对现有生成器进行微调，使它们能够一致地将样式和用例条件解释为文本提示，而无需进行架构修改。为了进行评估，我们引入了一种基于 Long-CLIP 的指标，用于测量生成的排版和请求的属性之间的对齐情况。跨不同提示和布局的实验表明，使用我们的管道训练的模型产生的文本渲染比竞争基线更符合提示。我们的注释管道的源代码可在此 https URL 中找到。

Title: Learning to Generate via Understanding: Understanding-Driven Intrinsic Rewarding for Unified Multimodal Models

• Authors: Jiadong Pan, Liang Li, Yuxin Peng, Yu-Ming Tang, Shuohuan Wang, Yu Sun, Hua Wu, Qingming Huang, Haifeng Wang
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.06043
• Pdf URL: https://arxiv.org/pdf/2603.06043
• Copy Paste: [[2603.06043]] Learning to Generate via Understanding: Understanding-Driven Intrinsic Rewarding for Unified Multimodal Models(https://arxiv.org/abs/2603.06043)
• Keywords: generation, generative
• Abstract: Recently, unified multimodal models (UMMs) have made remarkable progress in integrating visual understanding and generation, demonstrating strong potential for complex text-to-image (T2I) tasks. Despite their theoretical promise, a persistent capability gap exists: UMMs typically exhibit superior visual understanding but comparatively weaker generative capabilities. This discrepancy arises largely from the intrinsic decoupling between the understanding and generation processes. While a UMM can accurately interpret fine-grained visual details, it often struggles to produce semantically coherent images from complex textual prompts. To address this challenge, we explore UMMs' internal understanding capability to enhance generation quality. We propose a token-level intrinsic text-image alignment reward mechanism, GvU, enabling the UMM to act simultaneously as teacher and student: it evaluates its own outputs using the understanding branch to guide the generations accordingly. Building upon this, we design a self-supervised reinforcement learning framework, allowing UMMs to iteratively improve their generation quality through understanding-based intrinsic reward signals--without reliance on external supervision. Experimental results show that our method substantially boosts UMMs' generation, which in turn strengthens their fine-grained visual understanding, narrowing the capability gap between UMMs' visual understanding and generation.
• 摘要：最近，统一多模态模型（UMM）在集成视觉理解和生成方面取得了显着进展，展示了复杂文本到图像（T2I）任务的强大潜力。尽管理论上有希望，但仍然存在持续的能力差距：UMM 通常表现出卓越的视觉理解能力，但生成能力相对较弱。这种差异很大程度上源于理解过程和生成过程之间的内在脱钩。虽然 UMM 可以准确地解释细粒度的视觉细节，但它通常很难从复杂的文本提示中生成语义连贯的图像。为了应对这一挑战，我们探索 UMM 的内部理解能力，以提高发电质量。我们提出了一种代币级别的内在文本图像对齐奖励机制 GvU，使 UMM 能够同时充当教师和学生：它使用理解分支评估自己的输出，以相应地指导各代。在此基础上，我们设计了一个自我监督的强化学习框架，允许 UMM 通过基于理解的内在奖励信号迭代地提高其生成质量，而无需依赖外部监督。实验结果表明，我们的方法极大地提高了UMM的生成能力，从而增强了它们的细粒度视觉理解，缩小了UMM的视觉理解和生成之间的能力差距。

Title: GenHOI: Towards Object-Consistent Hand-Object Interaction with Temporally Balanced and Spatially Selective Object Injection

• Authors: Xuan Huang, Mochu Xiang, Zhelun Shen, Jinbo Wu, Chenming Wu, Chen Zhao, Kaisiyuan Wang, Hang Zhou, Shanshan Liu, Haocheng Feng, Wei He, Jingdong Wang
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.06048
• Pdf URL: https://arxiv.org/pdf/2603.06048
• Copy Paste: [[2603.06048]] GenHOI: Towards Object-Consistent Hand-Object Interaction with Temporally Balanced and Spatially Selective Object Injection(https://arxiv.org/abs/2603.06048)
• Keywords: generation
• Abstract: Hand-Object Interaction (HOI) remains a core challenge in digital human video synthesis, where models must generate physically plausible contact and preserve object identity across frames. Although recent HOI reenactment approaches have achieved progress, they are typically trained and evaluated in-domain and fail to generalize to complex, in-the-wild scenarios. In contrast, all-in-one video editing models exhibit broader robustness but still struggle with HOI-specific issues such as inconsistent object appearance. In this paper, we present GenHOI, a lightweight augmentation to pretrained video generation models that injects reference-object information in a temporally balanced and spatially selective manner. For temporal balancing, we propose Head-Sliding RoPE, which assigns head-specific temporal offsets to reference tokens, distributing their influence evenly across frames and mitigating the temporal decay of 3D RoPE to improve long-range object consistency. For spatial selectivity, we design a two-level spatial attention gate that concentrates object-conditioned attention on HOI regions and adaptively scales its strength, preserving background realism while enhancing interaction fidelity. Extensive qualitative and quantitative evaluations on unseen, in-the-wild scenes demonstrate that GenHOI significantly outperforms state-of-the-art HOI reenactment and all-in-one video editing methods. Project page: this https URL
• 摘要：手与物体交互（HOI）仍然是数字人类视频合成中的核心挑战，其中模型必须生成物理上合理的接触并跨帧保留物体身份。尽管最近的 HOI 重演方法取得了进展，但它们通常是在域内进行训练和评估的，无法推广到复杂的野外场景。相比之下，一体化视频编辑模型表现出更广泛的鲁棒性，但仍然面临着 HOI 特有的问题，例如对象外观不一致。在本文中，我们提出了 GenHOI，这是对预训练视频生成模型的轻量级增强，它以时间平衡和空间选择性的方式注入参考对象信息。为了实现时间平衡，我们提出了 Head-Sliding RoPE，它将头部特定的时间偏移分配给参考标记，将其影响均匀地分布在帧之间，并减轻 3D RoPE 的时间衰减，以提高远程对象的一致性。对于空间选择性，我们设计了一个两级空间注意力门，将对象条件注意力集中在 HOI 区域，并自适应地缩放其强度，在保留背景真实性的同时增强交互保真度。对未见过的野外场景进行的广泛定性和定量评估表明，GenHOI 的性能显着优于最先进的 HOI 重演和一体化视频编辑方法。项目页面：此 https URL

Title: TempoSyncDiff: Distilled Temporally-Consistent Diffusion for Low-Latency Audio-Driven Talking Head Generation

• Authors: Soumya Mazumdar, Vineet Kumar Rakesh
• Subjects: cs.CV, cs.AI, cs.LG, cs.SD
• Abstract URL: https://arxiv.org/abs/2603.06057
• Pdf URL: https://arxiv.org/pdf/2603.06057
• Copy Paste: [[2603.06057]] TempoSyncDiff: Distilled Temporally-Consistent Diffusion for Low-Latency Audio-Driven Talking Head Generation(https://arxiv.org/abs/2603.06057)
• Keywords: generation
• Abstract: Diffusion models have recently advanced photorealistic human synthesis, although practical talking-head generation (THG) remains constrained by high inference latency, temporal instability such as flicker and identity drift, and imperfect audio-visual alignment under challenging speech conditions. This paper introduces TempoSyncDiff, a reference-conditioned latent diffusion framework that explores few-step inference for efficient audio-driven talking-head generation. The approach adopts a teacher-student distillation formulation in which a diffusion teacher trained with a standard noise prediction objective guides a lightweight student denoiser capable of operating with significantly fewer inference steps to improve generation stability. The framework incorporates identity anchoring and temporal regularization designed to mitigate identity drift and frame-to-frame flicker during synthesis, while viseme-based audio conditioning provides coarse lip motion control. Experiments on the LRS3 dataset report denoising-stage component-level metrics relative to VAE reconstructions and preliminary latency characterization, including CPU-only and edge computing measurements and feasibility estimates for edge deployment. The results suggest that distilled diffusion models can retain much of the reconstruction behaviour of a stronger teacher while enabling substantially lower latency inference. The study is positioned as an initial step toward practical diffusion-based talking-head generation under constrained computational settings. GitHub: this https URL
• 摘要：尽管实际的头部说话生成（THG）仍然受到高推理延迟、时间不稳定性（例如闪烁和身份漂移）以及在具有挑战性的语音条件下不完善的视听对齐的限制，但扩散模型最近已经实现了逼真的人体合成。本文介绍了 TempoSyncDiff，这是一种参考条件潜在扩散框架，它探索了高效音频驱动的头部说话的几步推理。该方法采用师生蒸馏公式，其中用标准噪声预测目标训练的扩散教师指导轻量级学生降噪器，该降噪器能够以明显更少的推理步骤进行操作，以提高生成稳定性。该框架结合了身份锚定和时间正则化，旨在减轻合成过程中的身份漂移和帧间闪烁，而基于视位的音频调节则提供粗略的嘴唇运动控制。 LRS3 数据集上的实验报告了与 VAE 重建和初步延迟表征相关的去噪阶段组件级指标，包括仅 CPU 和边缘计算测量以及边缘部署的可行性估计。结果表明，蒸馏扩散模型可以保留更强教师的大部分重建行为，同时显着降低延迟推理。该研究被定位为在受限计算设置下实现实用的基于扩散的头部说话的生成的第一步。 GitHub：此 https URL

Title: Text-Driven Emotionally Continuous Talking Face Generation

• Authors: Hao Yang, Yanyan Zhao, Tian Zheng, Hongbo Zhang, Bichen Wang, Di Wu, Xing Fu, Xuda Zhi, Yongbo Huang, Hao He
• Subjects: cs.CV, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.06071
• Pdf URL: https://arxiv.org/pdf/2603.06071
• Copy Paste: [[2603.06071]] Text-Driven Emotionally Continuous Talking Face Generation(https://arxiv.org/abs/2603.06071)
• Keywords: generation
• Abstract: Talking Face Generation (TFG) strives to create realistic and emotionally expressive digital faces. While previous TFG works have mastered the creation of naturalistic facial movements, they typically express a fixed target emotion in synthetic videos and lack the ability to exhibit continuously changing and natural expressions like humans do when conveying information. To synthesize realistic videos, we propose a novel task called Emotionally Continuous Talking Face Generation (EC-TFG), which takes a text segment and an emotion description with varying emotions as driving data, aiming to generate a video where the person speaks the text while reflecting the emotional changes within the description. Alongside this, we introduce a customized model, i.e., Temporal-Intensive Emotion Modulated Talking Face Generation (TIE-TFG), which innovatively manages dynamic emotional variations by employing Temporal-Intensive Emotion Fluctuation Modeling, allowing it to provide emotion variation sequences corresponding to the input text to drive continuous facial expression changes in synthesized videos. Extensive evaluations demonstrate our method's exceptional ability to produce smooth emotion transitions and uphold high-quality visuals and motion authenticity across diverse emotional states.
• 摘要：Talking Face Generation (TFG) 致力于创建逼真且富有情感表现力的数字面孔。虽然之前的 TFG 作品已经掌握了自然主义面部动作的创作，但它们通常在合成视频中表达固定的目标情感，缺乏像人类在传达信息时表现出不断变化的自然表情的能力。为了合成逼真的视频，我们提出了一项名为“情感连续说话脸部生成”（EC-TFG）的新颖任务，该任务将文本片段和具有不同情绪的情绪描述作为驱动数据，旨在生成一个视频，其中该人说出文本，同时反映描述中的情绪变化。除此之外，我们还引入了一种定制模型，即时间密集情绪调制说话脸部生成（TIE-TFG），它通过采用时间密集情绪波动建模来创新地管理动态情绪变化，使其能够提供与输入文本相对应的情绪变化序列，以驱动合成视频中的连续面部表情变化。广泛的评估表明，我们的方法具有卓越的能力，可以产生平滑的情绪过渡，并在不同的情绪状态下保持高质量的视觉效果和动作真实性。

Title: Cross-Resolution Distribution Matching for Diffusion Distillation

• Authors: Feiyang Chen, Hongpeng Pan, Haonan Xu, Xinyu Duan, Yang Yang, Zhefeng Wang
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.06136
• Pdf URL: https://arxiv.org/pdf/2603.06136
• Copy Paste: [[2603.06136]] Cross-Resolution Distribution Matching for Diffusion Distillation(https://arxiv.org/abs/2603.06136)
• Keywords: generation
• Abstract: Diffusion distillation is central to accelerating image and video generation, yet existing methods are fundamentally limited by the denoising process, where step reduction has largely saturated. Partial timestep low-resolution generation can further accelerate inference, but it suffers noticeable quality degradation due to cross-resolution distribution gaps. We propose Cross-Resolution Distribution Matching Distillation (RMD), a novel distillation framework that bridges cross-resolution distribution gaps for high-fidelity, few-step multi-resolution cascaded inference. Specifically, RMD divides the timestep intervals for each resolution using logarithmic signal-to-noise ratio (logSNR) curves, and introduces logSNR-based mapping to compensate for resolution-induced shifts. Distribution matching is conducted along resolution trajectories to reduce the gap between low-resolution generator distributions and the teacher's high-resolution distribution. In addition, a predicted-noise re-injection mechanism is incorporated during upsampling to stabilize training and improve synthesis quality. Quantitative and qualitative results show that RMD preserves high-fidelity generation while accelerating inference across various backbones. Notably, RMD achieves up to 33.4X speedup on SDXL and 25.6X on Wan2.1-14B, while preserving high visual fidelity.
• 摘要：扩散蒸馏对于加速图像和视频生成至关重要，但现有方法从根本上受到去噪过程的限制，其中步骤减少已基本饱和。部分时间步长低分辨率生成可以进一步加速推理，但由于跨分辨率分布差距，其质量明显下降。我们提出了跨分辨率分布匹配蒸馏（RMD），这是一种新颖的蒸馏框架，可以弥合跨分辨率分布间隙，以实现高保真、少步多分辨率级联推理。具体来说，RMD 使用对数信噪比 (logSNR) 曲线划分每个分辨率的时间步间隔，并引入基于 logSNR 的映射来补偿分辨率引起的偏移。沿着分辨率轨迹进行分布匹配，以减少低分辨率生成器分布和教师高分辨率分布之间的差距。此外，在上采样过程中还结合了预测噪声重新注入机制，以稳定训练并提高合成质量。定量和定性结果表明，RMD 保留了高保真生成，同时加速了跨不同主干网的推理。值得注意的是，RMD 在 SDXL 上实现了高达 33.4 倍的加速，在 Wan2.1-14B 上实现了 25.6 倍的加速，同时保持了高视觉保真度。

Title: Place-it-R1: Unlocking Environment-aware Reasoning Potential of MLLM for Video Object Insertion

• Authors: Bohai Gu, Taiyi Wu, Dazhao Du, Jian Liu, Shuai Yang, Xiaotong Zhao, Alan Zhao, Song Guo
• Subjects: cs.CV, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.06140
• Pdf URL: https://arxiv.org/pdf/2603.06140
• Copy Paste: [[2603.06140]] Place-it-R1: Unlocking Environment-aware Reasoning Potential of MLLM for Video Object Insertion(https://arxiv.org/abs/2603.06140)
• Keywords: generative
• Abstract: Modern video editing techniques have achieved high visual fidelity when inserting video objects. However, they focus on optimizing visual fidelity rather than physical causality, leading to edits that are physically inconsistent with their environment. In this work, we present Place-it-R$1$, an end-to-end framework for video object insertion that unlocks the environment-aware reasoning potential of Multimodal Large Language Models (MLLMs). Our framework leverages the Chain-of-Thought (CoT) reasoning of MLLMs to orchestrate video diffusion, following a Think-then-Place paradigm. To bridge cognitive reasoning and generative execution, we introduce three key innovations: First, MLLM performs physical scene understanding and interaction reasoning, generating environment-aware chain-of-thought tokens and inferring valid insertion regions to explicitly guide the diffusion toward physically plausible insertion. Then, we introduce MLLM-guided Spatial Direct Preference Optimization (DPO), where diffusion outputs are fed back to the MLLM for scoring, enabling visual naturalness. During inference, the MLLM iteratively triggers refinement cycles and elicits adaptive adjustments from the diffusion model, forming a closed-loop that progressively enhances editing quality. Furthermore, we provide two user-selectable modes: a plausibility-oriented flexible mode that permits environment modifications (\eg, generating support structures) to enhance physical plausibility, and a fidelity-oriented standard mode that preserves scene integrity for maximum fidelity, offering users explicit control over the plausibility-fidelity trade-off. Extensive experiments demonstrate Place-it-R1 achieves physically-coherent video object insertion compared with state-of-the-art solutions and commercial models.
• 摘要：现代视频编辑技术在插入视频对象时已经实现了高视觉保真度。然而，他们专注于优化视觉保真度而不是物理因果关系，从而导致编辑与他们的环境在物理上不一致。在这项工作中，我们提出了 Place-it-R$1$，这是一种用于视频对象插入的端到端框架，可释放多模态大型语言模型 (MLLM) 的环境感知推理潜力。我们的框架利用 MLLM 的思想链 (CoT) 推理来协调视频传播，遵循“先思考后放置”范式。为了连接认知推理和生成执行，我们引入了三个关键创新：首先，MLLM 执行物理场景理解和交互推理，生成环境感知的思想链标记并推断有效的插入区域，以明确引导扩散到物理上合理的插入。然后，我们引入了 MLLM 引导的空间直接偏好优化（DPO），其中扩散输出被反馈到 MLLM 进行评分，从而实现视觉自然度。在推理过程中，MLLM 迭代触发细化周期，并从扩散模型中引发自适应调整，形成闭环，逐步提高编辑质量。此外，我们提供两种用户可选择的模式：一种面向合理性的灵活模式，允许修改环境（例如，生成支撑结构）以增强物理合理性；一种面向保真度的标准模式，可保留场景完整性以获得最大保真度，为用户提供对合理性与保真度权衡的明确控制。大量实验表明，与最先进的解决方案和商业模型相比，Place-it-R1 实现了物理一致的视频对象插入。

Title: Longitudinal NSCLC Treatment Progression via Multimodal Generative Models

• Authors: Massimiliano Mantegna, Elena Mulero Ayllón, Alice Natalina Caragliano, Francesco Di Feola, Claudia Tacconi, Michele Fiore, Edy Ippolito, Carlo Greco, Sara Ramella, Philippe C. Cattin, Paolo Soda, Matteo Tortora, Valerio Guarrasi
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.06147
• Pdf URL: https://arxiv.org/pdf/2603.06147
• Copy Paste: [[2603.06147]] Longitudinal NSCLC Treatment Progression via Multimodal Generative Models(https://arxiv.org/abs/2603.06147)
• Keywords: generative
• Abstract: Predicting tumor evolution during radiotherapy is a clinically critical challenge, particularly when longitudinal changes are driven by both anatomy and treatment. In this work, we introduce a Virtual Treatment (VT) framework that formulates non-small cell lung cancer (NSCLC) progression as a dose-aware multimodal conditional image-to-image translation problem. Given a CT scan, baseline clinical variables, and a specified radiation dose increment, VT aims to synthesize plausible follow-up CT images reflecting treatment-induced anatomical changes. We evaluate the proposed framework on a longitudinal dataset of 222 stage III NSCLC patients, comprising 895 CT scans acquired during radiotherapy under irregular clinical schedules. The generative process is conditioned on delivered dose increments together with demographic and tumor-related clinical variables. Representative GAN-based and diffusion-based models are benchmarked across 2D and 2.5D configurations. Quantitative and qualitative results indicate that diffusion-based models benefit more consistently from multimodal, dose-aware conditioning and produce more stable and anatomically plausible tumor evolution trajectories than GAN-based baselines, supporting the potential of VT as a tool for in-silico treatment monitoring and adaptive radiotherapy research in NSCLC.
• 摘要：预测放疗期间肿瘤的演变是临床上的一项关键挑战，特别是当解剖学和治疗共同驱动纵向变化时。在这项工作中，我们引入了虚拟治疗（VT）框架，该框架将非小细胞肺癌（NSCLC）进展表述为剂量感知多模态条件图像到图像转换问题。给定 CT 扫描、基线临床变量和指定的辐射剂量增量，VT 旨在合成反映治疗引起的解剖变化的合理的后续 CT 图像。我们在 222 名 III 期 NSCLC 患者的纵向数据集上评估了所提出的框架，其中包括在不规则临床时间表的放疗期间获得的 895 次 CT 扫描。生成过程取决于所提供的剂量增量以及人口统计和肿瘤相关的临床变量。基于 GAN 和扩散的代表性模型在 2D 和 2.5D 配置上进行了基准测试。定量和定性结果表明，与基于 GAN 的基线相比，基于扩散的模型更一致地受益于多模式、剂量感知调节，并产生更稳定且解剖学上合理的肿瘤进化轨迹，支持 VT 作为 NSCLC 的计算机治疗监测和适应性放疗研究工具的潜力。

Title: Ensemble Graph Neural Networks for Probabilistic Sea Surface Temperature Forecasting via Input Perturbations

• Authors: Alejandro J. González-Santana, Giovanny A. Cuervo-Londoño, Javier Sánchez
• Subjects: cs.LG, cs.AI, physics.geo-ph
• Abstract URL: https://arxiv.org/abs/2603.06153
• Pdf URL: https://arxiv.org/pdf/2603.06153
• Copy Paste: [[2603.06153]] Ensemble Graph Neural Networks for Probabilistic Sea Surface Temperature Forecasting via Input Perturbations(https://arxiv.org/abs/2603.06153)
• Keywords: generation
• Abstract: Accurate regional ocean forecasting requires models that are both computationally efficient and capable of representing predictive uncertainty. This work investigates ensemble learning strategies for sea surface temperature (SST) forecasting using Graph Neural Networks (GNNs), with a focus on how input perturbation design affects forecast skill and uncertainty representation. We adapt a GNN architecture to the Canary Islands region in the North Atlantic and implement a homogeneous ensemble approach inspired by bagging, where diversity is introduced during inference by perturbing initial ocean states rather than retraining multiple models. Several noise-based ensemble generation strategies are evaluated, including Gaussian noise, Perlin noise, and fractal Perlin noise, with systematic variation of noise intensity and spatial structure. Ensemble forecasts are assessed over a 15-day horizon using deterministic metrics (RMSE and bias) and probabilistic metrics, including the Continuous Ranked Probability Score (CRPS) and the Spread-skill ratio. Results show that, while deterministic skill remains comparable to the single-model forecast, the type and structure of input perturbations strongly influence uncertainty representation, particularly at longer lead times. Ensembles generated with spatially coherent perturbations, such as low-resolution Perlin noise, achieve better calibration and lower CRPS than purely random Gaussian perturbations. These findings highlight the critical role of noise structure and scale in ensemble GNN design and demonstrate that carefully constructed input perturbations can yield well-calibrated probabilistic forecasts without additional training cost, supporting the feasibility of ensemble GNNs for operational regional ocean prediction.
• 摘要：准确的区域海洋预测需要模型既具有计算效率又能够表示预测的不确定性。这项工作研究了使用图神经网络（GNN）进行海面温度（SST）预测的集成学习策略，重点是输入扰动设计如何影响预测技能和不确定性表示。我们将 GNN 架构应用于北大西洋加那利群岛地区，并实施受 bagging 启发的同质集成方法，其中通过扰动初始海洋状态而不是重新训练多个模型在推理过程中引入多样性。评估了几种基于噪声的集成生成策略，包括高斯噪声、Perlin 噪声和分形 Perlin 噪声，以及噪声强度和空间结构的系统变化。使用确定性指标（RMSE 和偏差）和概率指标（包括连续排名概率得分 (CRPS) 和传播技能比率）对 15 天的整体预测进行评估。结果表明，虽然确定性技能仍然与单模型预测相当，但输入扰动的类型和结构强烈影响不确定性表示，特别是在较长的交付周期内。与纯随机高斯扰动相比，利用空间相干扰动（例如低分辨率柏林噪声）生成的系综可以实现更好的校准和更低的 CRPS。这些发现强调了噪声结构和尺度在集合 GNN 设计中的关键作用，并证明精心构建的输入扰动可以产生经过良好校准的概率预测，而无需额外的训练成本，支持集合 GNN 用于操作区域海洋预测的可行性。

Title: Reflective Flow Sampling Enhancement

• Authors: Zikai Zhou, Muyao Wang, Shitong Shao, Lichen Bai, Haoyi Xiong, Bo Han, Zeke Xie
• Subjects: cs.CV, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.06165
• Pdf URL: https://arxiv.org/pdf/2603.06165
• Copy Paste: [[2603.06165]] Reflective Flow Sampling Enhancement(https://arxiv.org/abs/2603.06165)
• Keywords: generation, generative
• Abstract: The growing demand for text-to-image generation has led to rapid advances in generative modeling. Recently, text-to-image diffusion models trained with flow matching algorithms, such as FLUX, have achieved remarkable progress and emerged as strong alternatives to conventional diffusion models. At the same time, inference-time enhancement strategies have been shown to improve the generation quality and text-prompt alignment of text-to-image diffusion models. However, these techniques are mainly applicable to conventional diffusion models and usually fail to perform well on flow models. To bridge this gap, we propose Reflective Flow Sampling (RF-Sampling), a theoretically-grounded and training-free inference enhancement framework explicitly designed for flow models, especially for the CFG-distilled variants (i.e., models distilled from CFG guidance techniques), like FLUX. Departing from heuristic interpretations, we provide a formal derivation proving that RF-Sampling implicitly performs gradient ascent on the text-image alignment score. By leveraging a linear combination of textual representations and integrating them with flow inversion, RF-Sampling allows the model to explore noise spaces that are more consistent with the input prompt. Extensive experiments across multiple benchmarks demonstrate that RF-Sampling consistently improves both generation quality and prompt alignment. Moreover, RF-Sampling is also the first inference enhancement method that can exhibit test-time scaling ability to some extent on FLUX.
• 摘要：对文本到图像生成的需求不断增长，导致生成建模的快速发展。最近，使用流匹配算法（例如 FLUX）训练的文本到图像扩散模型取得了显着的进展，并成为传统扩散模型的有力替代品。同时，推理时间增强策略已被证明可以提高文本到图像扩散模型的生成质量和文本提示对齐。然而，这些技术主要适用于传统的扩散模型，通常在流动模型上表现不佳。为了弥补这一差距，我们提出了反射流采样（RF-Sampling），这是一种基于理论且无需训练的推理增强框架，专门为流模型设计，特别是针对 CFG 蒸馏变体（即从 CFG 制导技术蒸馏的模型），如 FLUX。与启发式解释不同，我们提供了一个正式的推导，证明 RF 采样隐式地对文本图像对齐分数执行梯度上升。通过利用文本表示的线性组合并将其与流反演集成，RF 采样允许模型探索与输入提示更一致的噪声空间。跨多个基准的大量实验表明，射频采样能够持续提高生成质量和及时调整。此外，RF-Sampling也是第一个能够在FLUX上表现出一定程度的测试时间缩放能力的推理增强方法。

Title: FreeOcc: Training-free Panoptic Occupancy Prediction via Foundation Models

• Authors: Andrew Caunes, Thierry Chateau, Vincent Fremont
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.06166
• Pdf URL: https://arxiv.org/pdf/2603.06166
• Copy Paste: [[2603.06166]] FreeOcc: Training-free Panoptic Occupancy Prediction via Foundation Models(https://arxiv.org/abs/2603.06166)
• Keywords: generation
• Abstract: Semantic and panoptic occupancy prediction for road scene analysis provides a dense 3D representation of the ego vehicle's surroundings. Current camera-only approaches typically rely on costly dense 3D supervision or require training models on data from the target domain, limiting deployment in unseen environments. We propose FreeOcc, a training-free pipeline that leverages pretrained foundation models to recover both semantics and geometry from multi-view images. FreeOcc extracts per-view panoptic priors with a promptable foundation segmentation model and prompt-to-taxonomy rules, and reconstructs metric 3D points with a reconstruction foundation model. Depth- and confidence- aware filtering lifts reliable labels into 3D, which are fused over time and voxelized with a deterministic refinement stack. For panoptic occupancy, instances are recovered by fitting and merging robust current-view 3D box candidates, enabling instance-aware occupancy without any learned 3D model. On Occ3D-nuScenes, FreeOcc achieves 16.9 mIoU and 16.5 RayIoU train-free, on par with state-of-the-art weakly supervised methods. When employed as a pseudo-label generation pipeline for training downstream models, it achieves 21.1 RayIoU, surpassing the previous state-of-the-art weakly supervised baseline. Furthermore, FreeOcc sets new baselines for both train-free and weakly supervised panoptic occupancy prediction, achieving 3.1 RayPQ and 3.9 RayPQ, respectively. These results highlight foundation-model-driven perception as a practical route to training-free 3D scene understanding.
• 摘要：用于道路场景分析的语义和全景占用预测提供了自我车辆周围环境的密集 3D 表示。当前仅使用摄像头的方法通常依赖于昂贵的密集 3D 监督，或者需要对来自目标域的数据进行训练模型，从而限制了在看不见的环境中的部署。我们提出了 FreeOcc，这是一种免训练管道，利用预训练的基础模型从多视图图像中恢复语义和几何。 FreeOcc 使用可提示的基础分割模型和提示分类规则提取每个视图的全景先验，并使用重建基础模型重建度量 3D 点。深度和置信度感知过滤将可靠的标签提升为 3D，这些标签随着时间的推移而融合，并通过确定性细化堆栈进行体素化。对于全景占用，通过拟合和合并强大的当前视图 3D 框候选来恢复实例，从而无需任何学习的 3D 模型即可实现实例感知占用。在 Occ3D-nuScenes 上，FreeOcc 无需训练即可达到 16.9 mIoU 和 16.5 RayIoU，与最先进的弱监督方法相当。当用作训练下游模型的伪标签生成管道时，它实现了 21.1 RayIoU，超越了之前最先进的弱监督基线。此外，FreeOcc 为无训练和弱监督全景占用预测设定了新的基线，分别达到 3.1 RayPQ 和 3.9 RayPQ。这些结果强调了基础模型驱动的感知是免训练 3D 场景理解的实用途径。

Title: A Semi-Supervised Framework for Breast Ultrasound Segmentation with Training-Free Pseudo-Label Generation and Label Refinement

• Authors: Ruili Li, Jiayi Ding, Ruiyu Li, Yilun Jin, Shiwen Ge, Yuwen Zeng, Xiaoyong Zhang, Eichi Takaya, Jan Vrba, Noriyasu Homma
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.06167
• Pdf URL: https://arxiv.org/pdf/2603.06167
• Copy Paste: [[2603.06167]] A Semi-Supervised Framework for Breast Ultrasound Segmentation with Training-Free Pseudo-Label Generation and Label Refinement(https://arxiv.org/abs/2603.06167)
• Keywords: generation
• Abstract: Semi-supervised learning (SSL) has emerged as a promising paradigm for breast ultrasound (BUS) image segmentation, but it often suffers from unstable pseudo labels under extremely limited annotations, leading to inaccurate supervision and degraded performance. Recent vision-language models (VLMs) provide a new opportunity for pseudo-label generation, yet their effectiveness on BUS images remains limited because domain-specific prompts are difficult to transfer. To address this issue, we propose a semi-supervised framework with training-free pseudo-label generation and label refinement. By leveraging simple appearance-based descriptions (e.g., dark oval), our method enables cross-domain structural transfer between natural and medical images, allowing VLMs to generate structurally consistent pseudo labels. These pseudo labels are used to warm up a static teacher that captures global structural priors of breast lesions. Combined with an exponential moving average teacher, we further introduce uncertainty entropy weighted fusion and adaptive uncertainty-guided reverse contrastive learning to improve boundary discrimination. Experiments on four BUS datasets demonstrate that our method achieves performance comparable to fully supervised models even with only 2.5% labeled data, significantly outperforming existing SSL approaches. Moreover, the proposed paradigm is readily extensible: for other imaging modalities or diseases, only a global appearance description is required to obtain reliable pseudo supervision, enabling scalable semi-supervised medical image segmentation under limited annotations.
• 摘要：半监督学习（SSL）已成为乳腺超声（BUS）图像分割的一种有前途的范例，但它经常在极其有限的注释下遇到不稳定的伪标签，导致监督不准确和性能下降。最近的视觉语言模型（VLM）为伪标签生成提供了新的机会，但它们在 BUS 图像上的有效性仍然有限，因为特定领域的提示难以传输。为了解决这个问题，我们提出了一个半监督框架，具有免训练的伪标签生成和标签细化。通过利用简单的基于外观的描述（例如，深色椭圆形），我们的方法能够实现自然图像和医学图像之间的跨域结构转移，从而允许 VLM 生成结构一致的伪标签。这些伪标签用于预热静态教师，捕捉乳房病变的全局结构先验。结合指数移动平均教师，我们进一步引入不确定性熵加权融合和自适应不确定性引导反向对比学习来提高边界辨别力。对四个 BUS 数据集的实验表明，即使只有 2.5% 的标记数据，我们的方法也能实现与完全监督模型相当的性能，显着优于现有的 SSL 方法。此外，所提出的范例很容易扩展：对于其他成像模式或疾病，只需要全局外观描述即可获得可靠的伪监督，从而在有限的注释下实现可扩展的半监督医学图像分割。

Title: Optimizing 3D Diffusion Models for Medical Imaging via Multi-Scale Reward Learning

• Authors: Yueying Tian, Xudong Han, Meng Zhou, Rodrigo Aviles-Espinosa, Rupert Young, Philip Birch
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.06173
• Pdf URL: https://arxiv.org/pdf/2603.06173
• Copy Paste: [[2603.06173]] Optimizing 3D Diffusion Models for Medical Imaging via Multi-Scale Reward Learning(https://arxiv.org/abs/2603.06173)
• Keywords: generation, generative
• Abstract: Diffusion models have emerged as powerful tools for 3D medical image generation, yet bridging the gap between standard training objectives and clinical relevance remains a challenge. This paper presents a method to enhance 3D diffusion models using Reinforcement Learning (RL) with multi-scale feedback. We first pretrain a 3D diffusion model on MRI volumes to establish a robust generative prior. Subsequently, we fine-tune the model using Proximal Policy Optimization (PPO), guided by a novel reward system that integrates both 2D slice-wise assessments and 3D volumetric analysis. This combination allows the model to simultaneously optimize for local texture details and global structural coherence. We validate our framework on the BraTS 2019 and OASIS-1 datasets. Our results indicate that incorporating RL feedback effectively steers the generation process toward higher quality distributions. Quantitative analysis reveals significant improvements in Fréchet Inception Distance (FID) and, crucially, the synthetic data demonstrates enhanced utility in downstream tumor and disease classification tasks compared to non-optimized baselines.
• 摘要：扩散模型已成为 3D 医学图像生成的强大工具，但弥合标准训练目标和临床相关性之间的差距仍然是一个挑战。本文提出了一种使用具有多尺度反馈的强化学习 (RL) 来增强 3D 扩散模型的方法。我们首先在 MRI 体积上预训练 3D 扩散模型，以建立强大的生成先验。随后，我们在集成了 2D 切片评估和 3D 体积分析的新颖奖励系统的指导下，使用近端策略优化 (PPO) 来微调模型。这种组合允许模型同时优化局部纹理细节和全局结构一致性。我们在 BraTS 2019 和 OASIS-1 数据集上验证了我们的框架。我们的结果表明，结合强化学习反馈可以有效引导生成过程走向更高质量的分布。定量分析揭示了 Fréchet 起始距离 (FID) 的显着改进，更重要的是，与非优化基线相比，合成数据表明在下游肿瘤和疾病分类任务中的实用性增强。

Title: Making Training-Free Diffusion Segmentors Scale with the Generative Power

• Authors: Benyuan Meng, Qianqian Xu, Zitai Wang, Xiaochun Cao, Longtao Huang, Qingming Huang
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.06178
• Pdf URL: https://arxiv.org/pdf/2603.06178
• Copy Paste: [[2603.06178]] Making Training-Free Diffusion Segmentors Scale with the Generative Power(https://arxiv.org/abs/2603.06178)
• Keywords: generative
• Abstract: As powerful generative models, text-to-image diffusion models have recently been explored for discriminative tasks. A line of research focuses on adapting a pre-trained diffusion model to semantic segmentation without any further training, leading to what training-free diffusion segmentors. These methods typically rely on cross-attention maps from the model's attention layers, which are assumed to capture semantic relationships between image pixels and text tokens. Ideally, such approaches should benefit from more powerful diffusion models, i.e., stronger generative capability should lead to better segmentation. However, we observe that existing methods often fail to scale accordingly. To understand this issue, we identify two underlying gaps: (i) cross-attention is computed across multiple heads and layers, but there exists a discrepancy between these individual attention maps and a unified global representation. (ii) Even when a global map is available, it does not directly translate to accurate semantic correlation for segmentation, due to score imbalances among different text tokens. To bridge these gaps, we propose two techniques: auto aggregation and per-pixel rescaling, which together enable training-free segmentation to better leverage generative capability. We evaluate our approach on standard semantic segmentation benchmarks and further integrate it into a generative technique, demonstrating both improved performance broad applicability. Codes are at this https URL.
• 摘要：作为强大的生成模型，文本到图像的扩散模型最近被探索用于判别任务。一系列研究的重点是使预训练的扩散模型适应语义分割，而无需任何进一步的训练，从而产生免训练的扩散分割器。这些方法通常依赖于模型注意力层的交叉注意力图，假设这些图能够捕获图像像素和文本标记之间的语义关系。理想情况下，此类方法应该受益于更强大的扩散模型，即更强的生成能力应该导致更好的分割。然而，我们观察到现有的方法往往无法相应地扩展。为了理解这个问题，我们确定了两个潜在的差距：（i）跨多个头和层计算交叉注意力，但这些单独的注意力图和统一的全局表示之间存在差异。 (ii) 即使全局地图可用，由于不同文本标记之间的分数不平衡，它也不能直接转化为准确的语义相关性以进行分割。为了弥补这些差距，我们提出了两种技术：自动聚合和每像素重新缩放，它们共同实现了免训练分割，以更好地利用生成能力。我们在标准语义分割基准上评估我们的方法，并将其进一步集成到生成技术中，展示了改进的性能和广泛的适用性。代码位于此 https URL。

Title: Towards Motion Turing Test: Evaluating Human-Likeness in Humanoid Robots

• Authors: Mingzhe Li, Mengyin Liu, Zekai Wu, Xincheng Lin, Junsheng Zhang, Ming Yan, Zengye Xie, Changwang Zhang, Chenglu Wen, Lan Xu, Siqi Shen, Cheng Wang
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.06181
• Pdf URL: https://arxiv.org/pdf/2603.06181
• Copy Paste: [[2603.06181]] Towards Motion Turing Test: Evaluating Human-Likeness in Humanoid Robots(https://arxiv.org/abs/2603.06181)
• Keywords: generation
• Abstract: Humanoid robots have achieved significant progress in motion generation and control, exhibiting movements that appear increasingly natural and human-like. Inspired by the Turing Test, we propose the Motion Turing Test, a framework that evaluates whether human observers can discriminate between humanoid robot and human poses using only kinematic information. To facilitate this evaluation, we present the Human-Humanoid Motion (HHMotion) dataset, which consists of 1,000 motion sequences spanning 15 action categories, performed by 11 humanoid models and 10 human subjects. All motion sequences are converted into SMPL-X representations to eliminate the influence of visual appearance. We recruited 30 annotators to rate the human-likeness of each pose on a 0-5 scale, resulting in over 500 hours of annotation. Analysis of the collected data reveals that humanoid motions still exhibit noticeable deviations from human movements, particularly in dynamic actions such as jumping, boxing, and running. Building on HHMotion, we formulate a human-likeness evaluation task that aims to automatically predict human-likeness scores from motion data. Despite recent progress in multimodal large language models, we find that they remain inadequate for assessing motion human-likeness. To address this, we propose a simple baseline model and demonstrate that it outperforms several contemporary LLM-based methods. The dataset, code, and benchmark will be publicly released to support future research in the community.
• 摘要：人形机器人在运动生成和控制方面取得了重大进展，表现出越来越自然和像人类的运动。受图灵测试的启发，我们提出了运动图灵测试，这是一个评估人类观察者是否可以仅使用运动学信息区分人形机器人和人类姿势的框架。为了促进这一评估，我们提出了人类-类人运动 (HHMotion) 数据集，该数据集由涵盖 15 个动作类别的 1,000 个运动序列组成，由 11 个类人模型和 10 个人类受试者执行。所有运动序列都转换为 SMPL-X 表示形式，以消除视觉外观的影响。我们招募了 30 名注释者，以 0-5 的等级对每个姿势的人类相似性进行评分，最终进行了 500 多个小时的注释。对收集的数据的分析表明，人形动作仍然表现出与人类动作的明显偏差，特别是在跳跃、拳击和跑步等动态动作中。在 HHMotion 的基础上，我们制定了一个人类相似度评估任务，旨在根据运动数据自动预测人类相似度分数。尽管多模态大语言模型最近取得了进展，但我们发现它们仍然不足以评估运动与人类的相似度。为了解决这个问题，我们提出了一个简单的基线模型，并证明它优于当代几种基于法学硕士的方法。数据集、代码和基准将公开发布，以支持社区未来的研究。

Title: VG3S: Visual Geometry Grounded Gaussian Splatting for Semantic Occupancy Prediction

• Authors: Xiaoyang Yan, Muleilan Pei, Shaojie Shen
• Subjects: cs.CV, cs.RO
• Abstract URL: https://arxiv.org/abs/2603.06210
• Pdf URL: https://arxiv.org/pdf/2603.06210
• Copy Paste: [[2603.06210]] VG3S: Visual Geometry Grounded Gaussian Splatting for Semantic Occupancy Prediction(https://arxiv.org/abs/2603.06210)
• Keywords: generation
• Abstract: 3D semantic occupancy prediction has become a crucial perception task for comprehensive scene understanding in autonomous driving. While recent advances have explored 3D Gaussian splatting for occupancy modeling to substantially reduce computational overhead, the generation of high-quality 3D Gaussians relies heavily on accurate geometric cues, which are often insufficient in purely vision-centric paradigms. To bridge this gap, we advocate for injecting the strong geometric grounding capability from Vision Foundation Models (VFMs) into occupancy prediction. In this regard, we introduce Visual Geometry Grounded Gaussian Splatting (VG3S), a novel framework that empowers Gaussian-based occupancy prediction with cross-view 3D geometric grounding. Specifically, to fully exploit the rich 3D geometric priors from a frozen VFM, we propose a plug-and-play hierarchical geometric feature adapter, which can effectively transform generic VFM tokens via feature aggregation, task-specific alignment, and multi-scale restructuring. Extensive experiments on the nuScenes occupancy benchmark demonstrate that VG3S achieves remarkable improvements of 12.6% in IoU and 7.5% in mIoU over the baseline. Furthermore, we show that VG3S generalizes seamlessly across diverse VFMs, consistently enhancing occupancy prediction accuracy and firmly underscoring the immense value of integrating priors derived from powerful, pre-trained geometry-grounded VFMs.
• 摘要：3D 语义占用预测已成为自动驾驶中全面场景理解的关键感知任务。虽然最近的进展已经探索了用于占用建模的 3D 高斯分布，以大幅减少计算开销，但高质量 3D 高斯的生成在很大程度上依赖于精确的几何线索，这在纯粹以视觉为中心的范例中通常是不够的。为了弥补这一差距，我们主张将视觉基础模型（VFM）强大的几何基础能力注入到占用率预测中。在这方面，我们引入了 Visual Geometry Grounded Gaussian Splatting (VG3S)，这是一种新颖的框架，可通过跨视图 3D 几何基础实现基于高斯的占用率预测。具体来说，为了充分利用冻结 VFM 中丰富的 3D 几何先验，我们提出了一种即插即用的分层几何特征适配器，它可以通过特征聚合、特定于任务的对齐和多尺度重组来有效地转换通用 VFM 标记。对 nuScenes 占用率基准的大量实验表明，VG3S 的 IoU 和 mIoU 较基线分别提高了 12.6% 和 7.5%。此外，我们还表明 VG3S 可以无缝地推广到不同的 VFM，持续提高占用率预测的准确性，并坚定地强调了集成源自强大的、预先训练的基于几何的 VFM 的先验的巨大价值。

Title: NOVA: Next-step Open-Vocabulary Autoregression for 3D Multi-Object Tracking in Autonomous Driving

• Authors: Kai Luo, Xu Wang, Rui Fan, Kailun Yang
• Subjects: cs.CV, cs.RO, eess.IV
• Abstract URL: https://arxiv.org/abs/2603.06254
• Pdf URL: https://arxiv.org/pdf/2603.06254
• Copy Paste: [[2603.06254]] NOVA: Next-step Open-Vocabulary Autoregression for 3D Multi-Object Tracking in Autonomous Driving(https://arxiv.org/abs/2603.06254)
• Keywords: generative
• Abstract: Generalizing across unknown targets is critical for open-world perception, yet existing 3D Multi-Object Tracking (3D MOT) pipelines remain limited by closed-set assumptions and ``semantic-blind'' heuristics. To address this, we propose Next-step Open-Vocabulary Autoregression (NOVA), an innovative paradigm that shifts 3D tracking from traditional fragmented distance-based matching toward generative spatio-temporal semantic modeling. NOVA reformulates 3D trajectories as structured spatio-temporal semantic sequences, enabling the simultaneous encoding of physical motion continuity and deep linguistic priors. By leveraging the autoregressive capabilities of Large Language Models (LLMs), we transform the tracking task into a principled process of next-step sequence completion. This mechanism allows the model to explicitly utilize the hierarchical structure of language space to resolve fine-grained semantic ambiguities and maintain identity consistency across complex long-range sequences through high-level commonsense reasoning. Extensive experiments on nuScenes, V2X-Seq-SPD, and KITTI demonstrate the superior performance of NOVA. Notably, on the nuScenes dataset, NOVA achieves an AMOTA of 22.41% for Novel categories, yielding a significant 20.21% absolute improvement over the baseline. These gains are realized through a compact 0.5B autoregressive model. Code will be available at this https URL.
• 摘要：泛化未知目标对于开放世界感知至关重要，但现有 3D 多对象跟踪 (3D MOT) 管道仍然受到封闭集假设和“语义盲”启发法的限制。为了解决这个问题，我们提出了下一步开放词汇自回归（NOVA），这是一种创新范例，它将 3D 跟踪从传统的基于碎片距离的匹配转变为生成时空语义建模。 NOVA 将 3D 轨迹重新表述为结构化时空语义序列，从而能够同时编码物理运动连续性和深层语言先验。通过利用大型语言模型（LLM）的自回归功能，我们将跟踪任务转变为下一步序列完成的原则过程。这种机制允许模型显式地利用语言空间的层次结构来解决细粒度的语义歧义，并通过高级常识推理来维持复杂的远程序列之间的身份一致性。 nuScenes、V2X-Seq-SPD 和 KITTI 上的大量实验证明了 NOVA 的优越性能。值得注意的是，在 nuScenes 数据集上，NOVA 在小说类别上的 AMOTA 达到了 22.41%，比基线显着提高了 20.21% 的绝对值。这些增益是通过紧凑的 0.5B 自回归模型实现的。代码将在此 https URL 中提供。

Title: Spectral and Trajectory Regularization for Diffusion Transformer Super-Resolution

• Authors: Jingkai Wang, Yixin Tang, Jue Gong, Jiatong Li, Shu Li, Libo Liu, Jianliang Lan, Yutong Liu, Yulun Zhang
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.06275
• Pdf URL: https://arxiv.org/pdf/2603.06275
• Copy Paste: [[2603.06275]] Spectral and Trajectory Regularization for Diffusion Transformer Super-Resolution(https://arxiv.org/abs/2603.06275)
• Keywords: super-resolution
• Abstract: Diffusion transformer (DiT) architectures show great potential for real-world image super-resolution (Real-ISR). However, their computationally expensive iterative sampling necessitates one-step distillation. Existing one-step distillation methods struggle with Real-ISR on DiT. They suffer from fundamental trajectory mismatch and generate severe grid-like periodic artifacts. To tackle these challenges, we propose StrSR, a novel one-step adversarial distillation framework featuring spectral and trajectory regularization. Specifically, we propose an asymmetric discriminative distillation architecture to bridge the trajectory gap. Additionally, we design a frequency distribution matching strategy to effectively suppress DiT-specific periodic artifacts caused by high-frequency spectral leakage. Extensive experiments demonstrate that StrSR achieves state-of-the-art performance in Real-ISR, across both quantitative metrics and visual perception. The code and models will be released at this https URL .
• 摘要：扩散变压器 (DiT) 架构在现实世界图像超分辨率 (Real-ISR) 方面显示出巨大潜力。然而，其计算成本昂贵的迭代采样需要一步蒸馏。现有的一步蒸馏方法很难与 DiT 上的 Real-ISR 相媲美。它们遭受基本轨迹不匹配的影响，并产生严重的网格状周期性伪影。为了应对这些挑战，我们提出了 StrSR，一种新颖的一步对抗性蒸馏框架，具有谱和轨迹正则化功能。具体来说，我们提出了一种不对称判别蒸馏架构来弥合轨迹差距。此外，我们设计了一种频率分布匹配策略来有效抑制由高频频谱泄漏引起的 DiT 特定周期性伪影。大量实验表明，StrSR 在 Real-ISR 中在定量指标和视觉感知方面均实现了最先进的性能。代码和模型将在此 https URL 发布。

Title: Attribute Distribution Modeling and Semantic-Visual Alignment for Generative Zero-shot Learning

• Authors: Haojie Pu, Zhuoming Li, Yongbiao Gao, Yuheng Jia
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.06281
• Pdf URL: https://arxiv.org/pdf/2603.06281
• Copy Paste: [[2603.06281]] Attribute Distribution Modeling and Semantic-Visual Alignment for Generative Zero-shot Learning(https://arxiv.org/abs/2603.06281)
• Keywords: generative
• Abstract: Generative zero-shot learning (ZSL) synthesizes features for unseen classes, leveraging semantic conditions to transfer knowledge from seen classes. However, it also introduces two intrinsic challenges: (1) class-level attributes fails to capture instance-specific visual appearances due to substantial intra-class variability, thus causing the class-instance gap; (2) the substantial mismatch between semantic and visual feature distributions, manifested in inter-class correlations, gives rise to the semantic-visual domain gap. To address these challenges, we propose an Attribute Distribution Modeling and Semantic-Visual Alignment (ADiVA) approach, jointly modeling attribute distributions and performing explicit semantic-visual alignment. Specifically, our ADiVA consists of two modules: an Attribute Distribution Modeling (ADM) module that learns a transferable attribute distribution for each class and samples instance-level attributes for unseen classes, and a Visual-Guided Alignment (VGA) module that refines semantic representations to better reflect visual structures. Experiments on three widely used benchmark datasets demonstrate that ADiVA significantly outperforms state-of-the-art methods (e.g., achieving gains of 4.7% and 6.1% on AWA2 and SUN, respectively). Moreover, our approach can serve as a plugin to enhance existing generative ZSL methods.
• 摘要：生成零样本学习（ZSL）综合未见类的特征，利用语义条件从已见类中转移知识。然而，它也带来了两个内在的挑战：（1）由于类内差异很大，类级属性无法捕获实例特定的视觉外观，从而导致类实例差距； （2）语义和视觉特征分布之间的严重不匹配，表现为类间相关性，导致语义-视觉领域差距。为了应对这些挑战，我们提出了一种属性分布建模和语义视觉对齐（ADiVA）方法，联合建模属性分布并执行显式语义视觉对齐。具体来说，我们的ADiVA由两个模块组成：属性分布建模（ADM）模块，用于学习每个类的可转移属性分布，并对未见过的类的实例级属性进行采样；以及视觉引导对齐（VGA）模块，用于细化语义表示以更好地反映视觉结构。在三个广泛使用的基准数据集上进行的实验表明，ADiVA 的性能显着优于最先进的方法（例如，在 AWA2 和 SUN 上分别实现了 4.7% 和 6.1% 的增益）。此外，我们的方法可以作为插件来增强现有的生成 ZSL 方法。

Title: 3D CBCT Artefact Removal Using Perpendicular Score-Based Diffusion Models

• Authors: Susanne Schaub, Florentin Bieder, Matheus L. Oliveira, Yulan Wang, Dorothea Dagassan-Berndt, Michael M. Bornstein, Philippe C. Cattin
• Subjects: cs.CV, cs.LG
• Abstract URL: https://arxiv.org/abs/2603.06300
• Pdf URL: https://arxiv.org/pdf/2603.06300
• Copy Paste: [[2603.06300]] 3D CBCT Artefact Removal Using Perpendicular Score-Based Diffusion Models(https://arxiv.org/abs/2603.06300)
• Keywords: generation
• Abstract: Cone-beam computed tomography (CBCT) is a widely used 3D imaging technique in dentistry, offering high-resolution images while minimising radiation exposure for patients. However, CBCT is highly susceptible to artefacts arising from high-density objects such as dental implants, which can compromise image quality and diagnostic accuracy. To reduce artefacts, implant inpainting in the sequence of projections plays a crucial role in many artefact reduction approaches. Recently, diffusion models have achieved state-of-the-art results in image generation and have widely been applied to image inpainting tasks. However, to our knowledge, existing diffusion-based methods for implant inpainting operate on independent 2D projections. This approach neglects the correlations among individual projections, resulting in inconsistencies in the reconstructed images. To address this, we propose a 3D dental implant inpainting approach based on perpendicular score-based diffusion models, each trained in two different planes and operating in the projection domain. The 3D distribution of the projection series is modelled by combining the two 2D score-based diffusion models in the sampling scheme. Our results demonstrate the method's effectiveness in producing high-quality, artefact-reduced 3D CBCT images, making it a promising solution for improving clinical imaging.
• 摘要：锥形束计算机断层扫描 (CBCT) 是牙科领域广泛使用的 3D 成像技术，可提供高分辨率图像，同时最大限度地减少患者的辐射暴露。然而，CBCT 非常容易受到牙种植体等高密度物体产生的伪影的影响，这可能会影响图像质量和诊断准确性。为了减少伪影，投影序列中的种植体修复在许多伪影减少方法中起着至关重要的作用。最近，扩散模型在图像生成方面取得了最先进的成果，并广泛应用于图像修复任务。然而，据我们所知，现有的基于扩散的种植体修复方法是在独立的二维投影上运行的。这种方法忽略了各个投影之间的相关性，导致重建图像的不一致。为了解决这个问题，我们提出了一种基于垂直分数扩散模型的 3D 牙种植体修复方法，每个模型在两个不同的平面中进行训练并在投影域中操作。投影序列的 3D 分布是通过结合采样方案中的两个基于分数的 2D 扩散模型来建模的。我们的结果证明了该方法在生成高质量、减少伪影的 3D CBCT 图像方面的有效性，使其成为改善临床成像的有前途的解决方案。

Title: DEX-AR: A Dynamic Explainability Method for Autoregressive Vision-Language Models

• Authors: Walid Bousselham, Angie Boggust, Hendrik Strobelt, Hilde Kuehne
• Subjects: cs.CV, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.06302
• Pdf URL: https://arxiv.org/pdf/2603.06302
• Copy Paste: [[2603.06302]] DEX-AR: A Dynamic Explainability Method for Autoregressive Vision-Language Models(https://arxiv.org/abs/2603.06302)
• Keywords: generation
• Abstract: As Vision-Language Models (VLMs) become increasingly sophisticated and widely used, it becomes more and more crucial to understand their decision-making process. Traditional explainability methods, designed for classification tasks, struggle with modern autoregressive VLMs due to their complex token-by-token generation process and intricate interactions between visual and textual modalities. We present DEX-AR (Dynamic Explainability for AutoRegressive models), a novel explainability method designed to address these challenges by generating both per-token and sequence-level 2D heatmaps highlighting image regions crucial for the model's textual responses. The proposed method offers to interpret autoregressive VLMs-including varying importance of layers and generated tokens-by computing layer-wise gradients with respect to attention maps during the token-by-token generation process. DEX-AR introduces two key innovations: a dynamic head filtering mechanism that identifies attention heads focused on visual information, and a sequence-level filtering approach that aggregates per-token explanations while distinguishing between visually-grounded and purely linguistic tokens. Our evaluation on ImageNet, VQAv2, and PascalVOC, shows a consistent improvement in both perturbation-based metrics, using a novel normalized perplexity measure, as well as segmentation-based metrics.
• 摘要：随着视觉语言模型 (VLM) 变得越来越复杂和广泛使用，了解其决策过程变得越来越重要。为分类任务而设计的传统可解释性方法，由于其复杂的逐个标记生成过程以及视觉和文本模态之间复杂的交互，与现代自回归 VLM 相矛盾。我们提出了 DEX-AR（自回归模型的动态可解释性），这是一种新颖的可解释性方法，旨在通过生成每个标记和序列级的 2D 热图来解决这些挑战，突出显示对模型文本响应至关重要的图像区域。所提出的方法通过在逐个令牌生成过程中计算相对于注意图的逐层梯度来解释自回归 VLM，包括层和生成令牌的不同重要性。 DEX-AR 引入了两项关键创新：动态头部过滤机制，可识别专注于视觉信息的注意力头；序列级过滤方法，可聚合每个标记的解释，同时区分基于视觉的标记和纯语言标记。我们对 ImageNet、VQAv2 和 PascalVOC 的评估表明，使用新颖的归一化困惑度度量，基于扰动的指标以及基于分割的指标都得到了一致的改进。

Title: Latent Transfer Attack: Adversarial Examples via Generative Latent Spaces

• Authors: Eitan Shaar, Ariel Shaulov, Yalcin Tur, Gal Chechik, Ravid Shwartz-Ziv
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.06311
• Pdf URL: https://arxiv.org/pdf/2603.06311
• Copy Paste: [[2603.06311]] Latent Transfer Attack: Adversarial Examples via Generative Latent Spaces(https://arxiv.org/abs/2603.06311)
• Keywords: generative
• Abstract: Adversarial attacks are a central tool for probing the robustness of modern vision models, yet most methods optimize perturbations directly in pixel space under $\ell_\infty$ or $\ell_2$ constraints. While effective in white-box settings, pixel-space optimization often produces high-frequency, texture-like noise that is brittle to common preprocessing (e.g., resizing and cropping) and transfers poorly across architectures. We propose $\textbf{LTA}$ ($\textbf{L}$atent $\textbf{T}$ransfer $\textbf{A}$ttack), a transfer-based attack that instead optimizes perturbations in the latent space of a pretrained Stable Diffusion VAE. Given a clean image, we encode it into a latent code and optimize the latent representation to maximize a surrogate classifier loss, while softly enforcing a pixel-space $\ell_\infty$ budget after decoding. To improve robustness to resolution mismatch and standard input pipelines, we incorporate Expectation Over Transformations (EOT) via randomized resizing, interpolation, and cropping, and apply periodic latent Gaussian smoothing to suppress emerging artifacts and stabilize optimization. Across a suite of CNN and vision-transformer targets, LTA achieves strong transfer attack success while producing spatially coherent, predominantly low-frequency perturbations that differ qualitatively from pixel-space baselines and occupy a distinct point in the transfer-quality trade-off. Our results highlight pretrained generative latent spaces as an effective and structured domain for adversarial optimization, bridging robustness evaluation with modern generative priors.
• 摘要：对抗性攻击是探测现代视觉模型鲁棒性的核心工具，但大多数方法在 $\ell_\infty$ 或 $\ell_2$ 约束下直接在像素空间中优化扰动。虽然在白盒设置中有效，但像素空间优化通常会产生高频、类似纹理的噪声，这些噪声对于常见的预处理（例如调整大小和裁剪）来说很脆弱，并且在架构之间传输很差。我们提出 $\textbf{LTA}$ ($\textbf{L}$atent $\textbf{T}$ransfer $\textbf{A}$tack)，这是一种基于转移的攻击，它优化预训练稳定扩散 VAE 的潜在空间中的扰动。给定一个干净的图像，我们将其编码为潜在代码并优化潜在表示以最大化代理分类器损失，同时在解码后温和地强制执行像素空间 $\ell_\infty$ 预算。为了提高对分辨率不匹配和标准输入管道的鲁棒性，我们通过随机调整大小、插值和裁剪合并期望变换 (EOT)，并应用周期性潜在高斯平滑来抑制新出现的伪影并稳定优化。在一系列 CNN 和视觉变换器目标中，LTA 取得了巨大的传输攻击成功，同时产生了空间相干的、主要是低频的扰动，这些扰动与像素空间基线在质量上有所不同，并在传输质量权衡中占据了一个独特的点。我们的结果强调了预训练的生成潜在空间作为对抗性优化的有效和结构化领域，将鲁棒性评估与现代生成先验联系起来。

Title: Dynamic Chunking Diffusion Transformer

• Authors: Akash Haridas, Utkarsh Saxena, Parsa Ashrafi Fashi, Mehdi Rezagholizadeh, Vikram Appia, Emad Barsoum
• Subjects: cs.CV, cs.AI, cs.LG
• Abstract URL: https://arxiv.org/abs/2603.06351
• Pdf URL: https://arxiv.org/pdf/2603.06351
• Copy Paste: [[2603.06351]] Dynamic Chunking Diffusion Transformer(https://arxiv.org/abs/2603.06351)
• Keywords: generation
• Abstract: Diffusion Transformers process images as fixed-length sequences of tokens produced by a static $\textit{patchify}$ operation. While effective, this design spends uniform compute on low- and high-information regions alike, ignoring that images contain regions of varying detail and that the denoising process progresses from coarse structure at early timesteps to fine detail at late timesteps. We introduce the Dynamic Chunking Diffusion Transformer (DC-DiT), which augments the DiT backbone with a learned encoder-router-decoder scaffold that adaptively compresses the 2D input into a shorter token sequence in a data-dependent manner using a chunking mechanism learned end-to-end with diffusion training. The mechanism learns to compress uniform background regions into fewer tokens and detail-rich regions into more tokens, with meaningful visual segmentations emerging without explicit supervision. Furthermore, it also learns to adapt its compression across diffusion timesteps, using fewer tokens at noisy stages and more tokens as fine details emerge. On class-conditional ImageNet $256{\times}256$, DC-DiT consistently improves FID and Inception Score over both parameter-matched and FLOP-matched DiT baselines across $4{\times}$ and $16{\times}$ compression, showing this is a promising technique with potential further applications to pixel-space, video and 3D generation. Beyond accuracy, DC-DiT is practical: it can be upcycled from pretrained DiT checkpoints with minimal post-training compute (up to $8{\times}$ fewer training steps) and composes with other dynamic computation methods to further reduce generation FLOPs.
• 摘要：扩散变压器将图像处理为由静态 $\textit{patchify}$ 操作生成的固定长度的标记序列。虽然有效，但这种设计在低信息和高信息区域上花费了统一的计算，忽略了图像包含不同细节的区域，以及去噪过程从早期时间步长的粗结构发展到后期时间步长的精细细节。我们引入了动态分块扩散变压器（DC-DiT），它通过学习的编码器-路由器-解码器支架增强了 DiT 主干，该支架使用通过扩散训练端到端学习的分块机制，以数据依赖的方式自适应地将 2D 输入压缩为更短的令牌序列。该机制学习将均匀的背景区域压缩为更少的标记，将细节丰富的区域压缩为更多的标记，并且在没有明确监督的情况下出现有意义的视觉分割。此外，它还学习在扩散时间步长中调整其压缩，在噪声阶段使用更少的标记，并在细节出现时使用更多的标记。在类条件 ImageNet $256{\times}256$ 上，DC-DiT 在 $4{\times}$ 和 $16{\times}$ 压缩范围内始终比参数匹配和 FLOP 匹配的 DiT 基线提高 FID 和 Inception Score，表明这是一种有前景的技术，有可能进一步应用于像素空间、视频和 3D 生成。除了准确性之外，DC-DiT 还很实用：它可以通过最少的训练后计算（最多减少 8{\times}$ 训练步骤）从预训练的 DiT 检查点进行升级，并与其他动态计算方法组合以进一步减少生成 FLOP。

Title: LATO: 3D Mesh Flow Matching with Structured TOpology Preserving LAtents

• Authors: Tianhao Zhao, Youjia Zhang, Hang Long, Jinshen Zhang, Wenbing Li, Yang Yang, Gongbo Zhang, Jozef Hladký, Matthias Nießner, Wei Yang
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.06357
• Pdf URL: https://arxiv.org/pdf/2603.06357
• Copy Paste: [[2603.06357]] LATO: 3D Mesh Flow Matching with Structured TOpology Preserving LAtents(https://arxiv.org/abs/2603.06357)
• Keywords: generation, generative
• Abstract: In this paper, we introduce LATO, a novel topology-preserving latent representation that enables scalable, flow matching-based synthesis of explicit 3D meshes. LATO represents a mesh as a Vertex Displacement Field (VDF) anchored on surface, incorporating a sparse voxel Variational Autoencoder (VAE) to compress this explicit signal into a structured, topology-aware voxel latent. To decapsulate the mesh, the VAE decoder progressively subdivides and prunes latent voxels to instantiate precise vertex locations. In the end, a dedicated connection head queries the voxel latent to predict edge connectivity between vertex pairs directly, allowing mesh topology to be recovered without isosurface extraction or heuristic meshing. For generative modeling, LATO adopts a two-stage flow matching process, first synthesizing the structure voxels and subsequently refining the voxel-wise topology features. Compared to prior isosurface/triangle-based diffusion models and autoregressive generation approaches, LATO generates meshes with complex geometry, well-formed topology while being highly efficient in inference.
• 摘要：在本文中，我们介绍了 LATO，这是一种新颖的保留拓扑的潜在表示，可以实现可扩展、基于流匹配的显式 3D 网格合成。 LATO 将网格表示为锚定在表面上的顶点位移场 (VDF)，并结合稀疏体素变分自动编码器 (VAE) 将此显式信号压缩为结构化的、拓扑感知的潜在体素。为了解封装网格，VAE 解码器逐步细分和修剪潜在体素以实例化精确的顶点位置。最后，专用连接头查询潜在体素，以直接预测顶点对之间的边缘连接性，从而无需等值面提取或启发式网格划分即可恢复网格拓扑。对于生成建模，LATO 采用两阶段流匹配过程，首先合成结构体素，然后细化体素方式的拓扑特征。与之前基于等值面/三角形的扩散模型和自回归生成方法相比，LATO 生成的网格具有复杂的几何形状、良好的拓扑结构，同时推理效率很高。

Title: CHMv2: Improvements in Global Canopy Height Mapping using DINOv3

• Authors: John Brandt, Seungeun Yi, Jamie Tolan, Xinyuan Li, Peter Potapov, Jessica Ertel, Justine Spore, Huy V. Vo, Michaël Ramamonjisoa, Patrick Labatut, Piotr Bojanowski, Camille Couprie
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.06382
• Pdf URL: https://arxiv.org/pdf/2603.06382
• Copy Paste: [[2603.06382]] CHMv2: Improvements in Global Canopy Height Mapping using DINOv3(https://arxiv.org/abs/2603.06382)
• Keywords: restoration
• Abstract: Accurate canopy height information is essential for quantifying forest carbon, monitoring restoration and degradation, and assessing habitat structure, yet high-fidelity measurements from airborne laser scanning (ALS) remain unevenly available globally. Here we present CHMv2, a global, meter-resolution canopy height map derived from high-resolution optical satellite imagery using a depth-estimation model built on DINOv3 and trained against ALS canopy height models. Compared to existing products, CHMv2 substantially improves accuracy, reduces bias in tall forests, and better preserves fine-scale structure such as canopy edges and gaps. These gains are enabled by a large expansion of geographically diverse training data, automated data curation and registration, and a loss formulation and data sampling strategy tailored to canopy height distributions. We validate CHMv2 against independent ALS test sets and against tens of millions of GEDI and ICESat-2 observations, demonstrating consistent performance across major forest biomes.
• 摘要：准确的树冠高度信息对于量化森林碳、监测恢复和退化以及评估栖息地结构至关重要，但机载激光扫描 (ALS) 的高保真测量结果在全球范围内的可用性仍然不均衡。在这里，我们展示了 CHMv2，这是一种全球米级分辨率的树冠高度图，它使用基于 DINOv3 构建的深度估计模型从高分辨率光学卫星图像中导出，并针对 ALS 树冠高度模型进行训练。与现有产品相比，CHMv2 大幅提高了准确性，减少了高大森林中的偏差，并更好地保留了树冠边缘和间隙等精细尺度结构。这些成果是通过大量扩展地理上不同的训练数据、自动数据管理和注册，以及针对树冠高度分布定制的损失公式和数据采样策略来实现的。我们根据独立的 ALS 测试集以及数千万个 GEDI 和 ICESat-2 观测值验证 CHMv2，证明了主要森林生物群落的一致性能。

Title: REACT++: Efficient Cross-Attention for Real-Time Scene Graph Generation

• Authors: Maëlic Neau, Zoe Falomir
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.06386
• Pdf URL: https://arxiv.org/pdf/2603.06386
• Copy Paste: [[2603.06386]] REACT++: Efficient Cross-Attention for Real-Time Scene Graph Generation(https://arxiv.org/abs/2603.06386)
• Keywords: generation
• Abstract: Scene Graph Generation (SGG) is a task that encodes visual relationships between objects in images as graph structures. SGG shows significant promise as a foundational component for downstream tasks, such as reasoning for embodied agents. To enable real-time applications, SGG must address the trade-off between performance and inference speed. However, current methods tend to focus on one of the following: (1) improving relation prediction accuracy, (2) enhancing object detection accuracy, or (3) reducing latency, without aiming to balance all three objectives simultaneously. To address this limitation, we build on the powerful Real-time Efficiency and Accuracy Compromise for Tradeoffs in Scene Graph Generation (REACT) architecture and propose REACT++, a new state-of-the-art model for real-time SGG. By leveraging efficient feature extraction and subject-to-object cross-attention within the prototype space, REACT++ balances latency and representational power. REACT++ achieves the highest inference speed among existing SGG models, improving relation prediction accuracy without sacrificing object detection performance. Compared to the previous REACT version, REACT++ is 20% faster with a gain of 10% in relation prediction accuracy on average. The code is available at this https URL.
• 摘要：场景图生成（SGG）是将图像中对象之间的视觉关系编码为图结构的任务。 SGG 作为下游任务的基础组件显示出巨大的前景，例如实体代理的推理。为了实现实时应用程序，SGG 必须解决性能和推理速度之间的权衡。然而，当前的方法往往侧重于以下之一：（1）提高关系预测准确性，（2）提高对象检测准确性，或（3）减少延迟，而不是同时平衡所有三个目标。为了解决这个限制，我们建立在场景图生成（REACT）架构中强大的实时效率和准确性折衷权衡的基础上，并提出了 REACT++，这是一种新的最先进的实时 SGG 模型。通过在原型空间中利用高效的特征提取和主体到客体的交叉注意力，REACT++ 平衡了延迟和表征能力。 REACT++实现了现有SGG模型中最高的推理速度，在不牺牲目标检测性能的情况下提高了关系预测的准确性。与之前的 REACT 版本相比，REACT++ 速度提高了 20%，关系预测准确率平均提高了 10%。该代码可从此 https URL 获取。

Title: DiffInf: Influence-Guided Diffusion for Supervision Alignment in Facial Attribute Learning

• Authors: Basudha Pal, Rama Chellappa
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.06399
• Pdf URL: https://arxiv.org/pdf/2603.06399
• Copy Paste: [[2603.06399]] DiffInf: Influence-Guided Diffusion for Supervision Alignment in Facial Attribute Learning(https://arxiv.org/abs/2603.06399)
• Keywords: generative
• Abstract: Facial attribute classification relies on large-scale annotated datasets in which many traits, such as age and expression, are inherently ambiguous and continuous but are discretized into categorical labels. Annotation inconsistencies arise from subjectivity and visual confounders such as pose, illumination, expression, and demographic variation, creating mismatch between images and assigned labels. These inconsistencies introduce supervision errors that impair representation learning and degrade downstream prediction. We introduce DiffInf, a self-influence--guided diffusion framework for mitigating annotation inconsistencies in facial attribute learning. We first train a baseline classifier and compute sample-wise self-influence scores using a practical first-order approximation to identify training instances that disproportionately destabilize optimization. Instead of discarding these influential samples, we apply targeted generative correction via a latent diffusion autoencoder to better align visual content with assigned labels while preserving identity and realism. To enable differentiable guidance during correction, we train a lightweight predictor of high-influence membership and use it as a surrogate influence regularizer. The edited samples replace the originals, yielding an influence-refined dataset of unchanged size. Across multi-class facial attribute classification, DiffInf consistently improves generalization compared with standard noisy-label training, robust optimization baselines, and influence-based filtering. Our results demonstrate that repairing influential annotation inconsistencies at the image level enhances downstream facial attribute classification without sacrificing distributional coverage.
• 摘要：面部属性分类依赖于大规模注释数据集，其中许多特征（例如年龄和表情）本质上是模糊且连续的，但被离散化为分类标签。注释不一致是由主观性和视觉混杂因素（例如姿势、照明、表情和人口统计变化）引起的，导致图像和分配的标签之间不匹配。这些不一致会引入监督错误，从而损害表示学习并降低下游预测。我们引入了 DiffInf，一种自我影响引导的扩散框架，用于减轻面部属性学习中的注释不一致。我们首先训练一个基线分类器，并使用实用的一阶近似计算样本的自我影响分数，以识别不成比例地破坏优化稳定性的训练实例。我们没有丢弃这些有影响力的样本，而是通过潜在扩散自动编码器应用有针对性的生成校正，以更好地将视觉内容与指定的标签对齐，同时保留身份和真实性。为了在校正过程中实现可微分指导，我们训练了一个高影响力成员资格的轻量级预测器，并将其用作替代影响正则化器。编辑后的样本替换原始样本，产生大小不变的影响细化数据集。在多类别面部属性分类中，与标准噪声标签训练、稳健的优化基线和基于影响的过滤相比，DiffInf 始终如一地提高了泛化能力。我们的结果表明，修复图像级别有影响的注释不一致可以增强下游面部属性分类，而不会牺牲分布覆盖范围。

Title: Physical Simulator In-the-Loop Video Generation

• Authors: Lin Geng Foo, Mark He Huang, Alexandros Lattas, Stylianos Moschoglou, Thabo Beeler, Christian Theobalt
• Subjects: cs.CV, cs.AI, cs.GR
• Abstract URL: https://arxiv.org/abs/2603.06408
• Pdf URL: https://arxiv.org/pdf/2603.06408
• Copy Paste: [[2603.06408]] Physical Simulator In-the-Loop Video Generation(https://arxiv.org/abs/2603.06408)
• Keywords: generation
• Abstract: Recent advances in diffusion-based video generation have achieved remarkable visual realism but still struggle to obey basic physical laws such as gravity, inertia, and collision. Generated objects often move inconsistently across frames, exhibit implausible dynamics, or violate physical constraints, limiting the realism and reliability of AI-generated videos. We address this gap by introducing Physical Simulator In-the-loop Video Generation (PSIVG), a novel framework that integrates a physical simulator into the video diffusion process. Starting from a template video generated by a pre-trained diffusion model, PSIVG reconstructs the 4D scene and foreground object meshes, initializes them within a physical simulator, and generates physically consistent trajectories. These simulated trajectories are then used to guide the video generator toward spatio-temporally physically coherent motion. To further improve texture consistency during object movement, we propose a Test-Time Texture Consistency Optimization (TTCO) technique that adapts text and feature embeddings based on pixel correspondences from the simulator. Comprehensive experiments demonstrate that PSIVG produces videos that better adhere to real-world physics while preserving visual quality and diversity. Project Page: this https URL
• 摘要：基于扩散的视频生成的最新进展已经实现了显着的视觉真实感，但仍然难以遵守重力、惯性和碰撞等基本物理定律。生成的对象通常在帧之间移动不一致、表现出令人难以置信的动态或违反物理约束，从而限制了人工智能生成视频的真实性和可靠性。我们通过引入物理模拟器环路视频生成（PSIVG）来解决这一差距，这是一种将物理模拟器集成到视频传播过程中的新颖框架。从预先训练的扩散模型生成的模板视频开始，PSIVG 重建 4D 场景和前景对象网格，在物理模拟器中初始化它们，并生成物理一致的轨迹。然后，使用这些模拟轨迹引导视频生成器进行时空物理相干运动。为了进一步提高对象移动过程中的纹理一致性，我们提出了一种测试时纹理一致性优化（TTCO）技术，该技术根据模拟器的像素对应来调整文本和特征嵌入。综合实验表明，PSIVG 制作的视频能够更好地遵循现实世界的物理原理，同时保留视觉质量和多样性。项目页面：此 https URL

Title: Toward Generative Quantum Utility via Correlation-Complexity Map

• Authors: Chen-Yu Liu, Leonardo Placidi, Eric Brunner, Enrico Rinaldi
• Subjects: cs.LG, quant-ph
• Abstract URL: https://arxiv.org/abs/2603.06440
• Pdf URL: https://arxiv.org/pdf/2603.06440
• Copy Paste: [[2603.06440]] Toward Generative Quantum Utility via Correlation-Complexity Map(https://arxiv.org/abs/2603.06440)
• Keywords: generative
• Abstract: We propose a Correlation-Complexity Map as a practical diagnostic tool for determining when real-world data distributions are structurally aligned with IQP-type quantum generative models. Characterized by two complementary indicators: (i) a Quantum Correlation-Likeness Indicator (QCLI), computed from the dataset's correlation-order (Walsh-Hadamard/Fourier) power spectrum aggregated by interaction order and quantified via Jensen-Shannon divergence from an i.i.d. binomial reference; and (ii) a Classical Correlation-Complexity Indicator (CCI), defined as the fraction of total correlation not captured by the optimal Chow-Liu tree approximation, normalized by total correlation. We provide theoretical support by relating QCLI to a support-mismatch mechanism, for fixed-architecture IQP families trained with an MMD objective, higher QCLI implies a smaller irreducible approximation floor. Using the map, we identify the classical turbulence data as both IQP-compatible and classically complex (high QCLI/high CCI). Guided by this placement, we use an invertible float-to-bitstring representation and a latent-parameter adaptation scheme that reuses a compact IQP circuit over a temporal sequence by learning and interpolating a low-dimensional latent trajectory. In comparative evaluations against classical models such as Restricted Boltzmann Machine (RBM) and Deep Convolutional Generative Adversarial Networks (DCGAN), the IQP approach achieves competitive distributional alignment while using substantially fewer training snapshots and a small latent block, supporting the use of QCLI/CCI as practical indicators for locating IQP-aligned domains and advancing generative quantum utility.
• 摘要：我们提出了一个相关复杂度图作为实用的诊断工具，用于确定现实世界的数据分布何时在结构上与 IQP 型量子生成模型一致。具有两个互补指标的特征：(i) 量子相关性指标 (QCLI)，根据数据集的相关阶 (Walsh-Hadamard/Fourier) 功率谱计算得出，该功率谱按交互阶聚合，并通过 i.i.d. 的 Jensen-Shannon 散度进行量化。二项式参考； (ii) 经典相关性复杂度指标 (CCI)，定义为最佳 Chow-Liu 树近似未捕获的总相关性分数，并通过总相关性进行归一化。我们通过将 QCLI 与支持失配机制相关联来提供理论支持，对于使用 MMD 目标训练的固定架构 IQP 系列，较高的 QCLI 意味着较小的不可约近似下限。使用该图，我们将经典湍流数据识别为 IQP 兼容且经典复杂（高 QCLI/高 CCI）。在这种布局的指导下，我们使用可逆的浮点到位串表示和潜在参数适应方案，通过学习和插值低维潜在轨迹，在时间序列上重用紧凑的 IQP 电路。在与受限玻尔兹曼机 (RBM) 和深度卷积生成对抗网络 (DCGAN) 等经典模型的比较评估中，IQP 方法实现了竞争性分布对齐，同时使用更少的训练快照和较小的潜在块，支持使用 QCLI/CCI 作为定位 IQP 对齐域和提高生成量子效用的实用指标。

Title: CaTok: Taming Mean Flows for One-Dimensional Causal Image Tokenization

• Authors: Yitong Chen, Zuxuan Wu, Xipeng Qiu, Yu-Gang Jiang
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.06449
• Pdf URL: https://arxiv.org/pdf/2603.06449
• Copy Paste: [[2603.06449]] CaTok: Taming Mean Flows for One-Dimensional Causal Image Tokenization(https://arxiv.org/abs/2603.06449)
• Keywords: generation
• Abstract: Autoregressive (AR) language models rely on causal tokenization, but extending this paradigm to vision remains non-trivial. Current visual tokenizers either flatten 2D patches into non-causal sequences or enforce heuristic orderings that misalign with the "next-token prediction" pattern. Recent diffusion autoencoders similarly fall short: conditioning the decoder on all tokens lacks causality, while applying nested dropout mechanism introduces imbalance. To address these challenges, we present CaTok, a 1D causal image tokenizer with a MeanFlow decoder. By selecting tokens over time intervals and binding them to the MeanFlow objective, as illustrated in Fig. 1, CaTok learns causal 1D representations that support both fast one-step generation and high-fidelity multi-step sampling, while naturally capturing diverse visual concepts across token intervals. To further stabilize and accelerate training, we propose a straightforward regularization REPA-A, which aligns encoder features with Vision Foundation Models (VFMs). Experiments demonstrate that CaTok achieves state-of-the-art results on ImageNet reconstruction, reaching 0.75 FID, 22.53 PSNR and 0.674 SSIM with fewer training epochs, and the AR model attains performance comparable to leading approaches.
• 摘要：自回归（AR）语言模型依赖于因果标记化，但将这种范式扩展到视觉仍然很重要。当前的视觉标记器要么将 2D 补丁展平为非因果序列，要么强制执行与“下一个标记预测”模式不一致的启发式排序。最近的扩散自动编码器同​​样存在不足：在所有标记上调节解码器缺乏因果关系，而应用嵌套丢失机制会引入不平衡。为了应对这些挑战，我们推出了 CaTok，一种带有 MeanFlow 解码器的一维因果图像标记器。通过按时间间隔选择标记并将其绑定到 MeanFlow 目标（如图 1 所示），CaTok 学习支持快速单步生成和高保真多步采样的因果一维表示，同时自然地捕获跨标记间隔的不同视觉概念。为了进一步稳定和加速训练，我们提出了一种简单的正则化 REPA-A，它将编码器功能与视觉基础模型 (VFM) 结合起来。实验表明，CaTok 在 ImageNet 重建方面取得了最先进的结果，以更少的训练次数达到了 0.75 FID、22.53 PSNR 和 0.674 SSIM，并且 AR 模型获得了与领先方法相当的性能。

Title: Pinterest Canvas: Large-Scale Image Generation at Pinterest

• Authors: Yu Wang, Eric Tzeng, Raymond Shiau, Jie Yang, Dmitry Kislyuk, Charles Rosenberg
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.06453
• Pdf URL: https://arxiv.org/pdf/2603.06453
• Copy Paste: [[2603.06453]] Pinterest Canvas: Large-Scale Image Generation at Pinterest(https://arxiv.org/abs/2603.06453)
• Keywords: generation
• Abstract: While recent image generation models demonstrate a remarkable ability to handle a wide variety of image generation tasks, this flexibility makes them hard to control via prompting or simple inference adaptation alone, rendering them unsuitable for use cases with strict product requirements. In this paper, we introduce Pinterest Canvas, our large-scale image generation system built to support image editing and enhancement use cases at Pinterest. Canvas is first trained on a diverse, multimodal dataset to produce a foundational diffusion model with broad image-editing capabilities. However, rather than relying on one generic model to handle every downstream task, we instead rapidly fine-tune variants of this base model on task-specific datasets, producing specialized models for individual use cases. We describe key components of Canvas and summarize our best practices for dataset curation, training, and inference. We also showcase task-specific variants through case studies on background enhancement and aspect-ratio outpainting, highlighting how we tackle their specific product requirements. Online A/B experiments demonstrate that our enhanced images receive a significant 18.0% and 12.5% engagement lift, respectively, and comparisons with human raters further validate that our models outperform third-party models on these tasks. Finally, we showcase other Canvas variants, including multi-image scene synthesis and image-to-video generation, demonstrating that our approach can generalize to a wide variety of potential downstream tasks.
• 摘要：虽然最近的图像生成模型表现出处理各种图像生成任务的卓越能力，但这种灵活性使得它们很难仅通过提示或简单的推理适应来控制，从而使它们不适合具有严格产品要求的用例。在本文中，我们介绍了 Pinterest Canvas，这是我们为支持 Pinterest 的图像编辑和增强用例而构建的大型图像生成系统。 Canvas 首先在多样化的多模式数据集上进行训练，以生成具有广泛图像编辑功能的基础扩散模型。然而，我们并不是依赖一个通用模型来处理每个下游任务，而是在特定于任务的数据集上快速微调该基本模型的变体，为各个用例生成专门的模型。我们描述了 Canvas 的关键组件，并总结了我们在数据集管理、训练和推理方面的最佳实践。我们还通过背景增强和纵横比外涂的案例研究展示特定于任务的变体，强调我们如何满足他们的特定产品要求。在线 A/B 实验表明，我们的增强图像的参与度分别显着提高了 18.0% 和 12.5%，并且与人类评分者的比较进一步验证了我们的模型在这些任务上优于第三方模型。最后，我们展示了其他 Canvas 变体，包括多图像场景合成和图像到视频生成，证明我们的方法可以推广到各种潜在的下游任务。

Title: Training Flow Matching: The Role of Weighting and Parameterization

• Authors: Anne Gagneux, Ségolène Martin, Rémi Gribonval, Mathurin Massias
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.06454
• Pdf URL: https://arxiv.org/pdf/2603.06454
• Copy Paste: [[2603.06454]] Training Flow Matching: The Role of Weighting and Parameterization(https://arxiv.org/abs/2603.06454)
• Keywords: generative
• Abstract: We study the training objectives of denoising-based generative models, with a particular focus on loss weighting and output parameterization, including noise-, clean image-, and velocity-based formulations. Through a systematic numerical study, we analyze how these training choices interact with the intrinsic dimensionality of the data manifold, model architecture, and dataset size. Our experiments span synthetic datasets with controlled geometry as well as image data, and compare training objectives using quantitative metrics for denoising accuracy (PSNR across noise levels) and generative quality (FID). Rather than proposing a new method, our goal is to disentangle the various factors that matter when training a flow matching model, in order to provide practical insights on design choices.
• 摘要：我们研究基于去噪的生成模型的训练目标，特别关注损失权重和输出参数化，包括基于噪声、干净图像和速度的公式。通过系统的数值研究，我们分析了这些训练选择如何与数据流形、模型架构和数据集大小的内在维度相互作用。我们的实验涵盖具有受控几何形状的合成数据集以及图像数据，并使用量化指标来比较训练目标，以实现去噪精度（跨噪声水平的 PSNR）和生成质量 (FID)。我们的目标不是提出一种新方法，而是理清训练流匹配模型时重要的各种因素，以便为设计选择提供实用的见解。

Title: Do Foundation Models Know Geometry? Probing Frozen Features for Continuous Physical Measurement

• Authors: Yakov Pyotr Shkolnikov
• Subjects: cs.CV, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.06459
• Pdf URL: https://arxiv.org/pdf/2603.06459
• Copy Paste: [[2603.06459]] Do Foundation Models Know Geometry? Probing Frozen Features for Continuous Physical Measurement(https://arxiv.org/abs/2603.06459)
• Keywords: generation
• Abstract: Vision-language models encode continuous geometry that their text pathway fails to express: a 6,000-parameter linear probe extracts hand joint angles at 6.1 degrees MAE from frozen features, while the best text output achieves only 20.0 degrees -- a 3.3x bottleneck. LoRA fine-tuning (r=16, 2,000 images) narrows this gap to 6.5 degrees, providing evidence for a pathway-training deficit rather than a representational one. Training objective determines accuracy more than architecture: five encoders spanning self-supervised, contrastive, and hybrid paradigms converge to statistically equivalent accuracy (R^2 approximately 0.55, TOST-equivalent at delta=0.03) despite sharing as little as CKA=0.41 representational similarity -- functional convergence without representational convergence. Autoregressive generation damages geometric fidelity, but the damage originates in the generation process, not in language alignment: Qwen2.5-VL's LLM layers actually improve probe accuracy over its raw vision encoder. Layer-wise analysis reveals a universal mid-network accuracy peak across all architectures, with attention heads in layers 18-22 carrying disproportionate geometric signal. These findings enable a single frozen backbone to function as a multi-task geometric sensor through lightweight probes, without fine-tuning or text generation.
• 摘要：视觉语言模型对文本路径无法表达的连续几何体进行编码：6000 个参数的线性探针从冻结特征中提取 6.1 度 MAE 的手关节角度，而最佳文本输出仅达到 20.0 度——这是 3.3 倍的瓶颈。 LoRA 微调（r=16，2,000 张图像）将这一差距缩小到 6.5 度，为路径训练缺陷而非代表性缺陷提供了证据。训练目标比架构更决定精度：跨越自监督、对比和混合范式的五个编码器收敛到统计上等效的精度（R^2 大约 0.55，TOST 等效于 delta=0.03），尽管共享的表示相似性只有 CKA=0.41——功能收敛而没有表示收敛。自回归生成会损害几何保真度，但损害源于生成过程，而不是语言对齐：Qwen2.5-VL 的 LLM 层实际上提高了其原始视觉编码器的探测精度。逐层分析揭示了所有架构中普遍存在的中网络精度峰值，第 18-22 层中的注意力头携带不成比例的几何信号。这些发现使得单个冻结主干能够通过轻量级探针充当多任务几何传感器，而无需微调或文本生成。

Title: Self-Supervised Flow Matching for Scalable Multi-Modal Synthesis

• Authors: Hila Chefer, Patrick Esser, Dominik Lorenz, Dustin Podell, Vikash Raja, Vinh Tong, Antonio Torralba, Robin Rombach
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.06507
• Pdf URL: https://arxiv.org/pdf/2603.06507
• Copy Paste: [[2603.06507]] Self-Supervised Flow Matching for Scalable Multi-Modal Synthesis(https://arxiv.org/abs/2603.06507)
• Keywords: generation, generative
• Abstract: Strong semantic representations improve the convergence and generation quality of diffusion and flow models. Existing approaches largely rely on external models, which require separate training, operate on misaligned objectives, and exhibit unexpected scaling behavior. We argue that this dependence arises from the model's training objective, which poses a denoising task with little incentive to learn semantic representations. We introduce Self-Flow: a self-supervised flow matching paradigm that integrates representation learning within the generative framework. Our key mechanism, Dual-Timestep Scheduling, applies heterogeneous noise levels across tokens, creating an information asymmetry that forces the model to infer missing information from corrupted inputs. This drives learning strong representations alongside generative capabilities without external supervision. Our method generalizes across modalities and enables multi-modal training while following expected scaling laws, achieving superior image, video, and audio generation.
• 摘要：强大的语义表示提高了扩散和流动模型的收敛和生成质量。现有的方法在很大程度上依赖于外部模型，这些模型需要单独的训练，针对不一致的目标进行操作，并表现出意想不到的扩展行为。我们认为这种依赖性源于模型的训练目标，该目标提出了去噪任务，而几乎没有学习语义表示的动力。我们介绍自流：一种自我监督的流匹配范式，它将表示学习集成到生成框架中。我们的关键机制“双时间步调度”在令牌之间应用异构噪声水平，从而产生信息不对称，迫使模型从损坏的输入中推断出丢失的信息。这推动了在没有外部监督的情况下学习强大的表征和生成能力。我们的方法概括了各种模式，并在遵循预期的缩放定律的同时实现了多模式训练，从而实现了卓越的图像、视频和音频生成。

Title: When One Modality Rules Them All: Backdoor Modality Collapse in Multimodal Diffusion Models

• Authors: Qitong Wang, Haoran Dai, Haotian Zhang, Christopher Rasmussen, Binghui Wang
• Subjects: cs.LG
• Abstract URL: https://arxiv.org/abs/2603.06508
• Pdf URL: https://arxiv.org/pdf/2603.06508
• Copy Paste: [[2603.06508]] When One Modality Rules Them All: Backdoor Modality Collapse in Multimodal Diffusion Models(https://arxiv.org/abs/2603.06508)
• Keywords: generation
• Abstract: While diffusion models have revolutionized visual content generation, their rapid adoption has underscored the critical need to investigate vulnerabilities, e.g., to backdoor attacks. In multimodal diffusion models, it is natural to expect that attacking multiple modalities simultaneously (e.g., text and image) would yield complementary effects and strengthen the overall backdoor. In this paper, we challenge this assumption by investigating the phenomenon of Backdoor Modality Collapse, a scenario where the backdoor mechanism degenerates to rely predominantly on a subset of modalities, rendering others redundant. To rigorously quantify this behavior, we introduce two novel metrics: Trigger Modality Attribution (TMA) and Cross-Trigger Interaction (CTI). Through extensive experiments across diverse training configurations in multimodal conditional diffusion, we consistently observe a ``winner-takes-all'' dynamic in backdoor behavior. Our results reveal that (1) attacks often collapse into subset-modality dominance, and (2) cross-modal interaction is negligible or even negative, contradicting the intuition of synergistic vulnerability. These findings highlight a critical blind spot in current assessments, suggesting that high attack success rates often mask a fundamental reliance on a subset of modalities. This establishes a principled foundation for mechanistic analysis and future defense development.
• 摘要：虽然扩散模型彻底改变了视觉内容的生成，但它们的快速采用凸显了调查漏洞（例如后门攻击）的迫切需要。在多模态扩散模型中，很自然地期望同时攻击多种模态（例如文本和图像）会产生互补效应并加强整体后门。在本文中，我们通过调查后门模态崩溃现象来挑战这一假设，在这种情况下，后门机制退化为主要依赖于模态子集，从而使其他模态变得多余。为了严格量化这种行为，我们引入了两个新颖的指标：触发模态归因（TMA）和交叉触发交互（CTI）。通过在多模式条件扩散中对不同训练配置进行广泛的实验，我们始终观察到后门行为中的“赢者通吃”动态。我们的结果表明，（1）攻击通常会陷入子集模态主导地位，（2）跨模态交互可以忽略不计甚至是负面的，这与协同脆弱性的直觉相矛盾。这些发现凸显了当前评估中的一个关键盲点，表明高攻击成功率往往掩盖了对部分模式的根本依赖。这为机械分析和未来国防发展奠定了原则基础。

Title: NEGATE: Constrained Semantic Guidance for Linguistic Negation in Text-to-Video Diffusion

• Authors: Taewon Kang, Ming C. Lin
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.06533
• Pdf URL: https://arxiv.org/pdf/2603.06533
• Copy Paste: [[2603.06533]] NEGATE: Constrained Semantic Guidance for Linguistic Negation in Text-to-Video Diffusion(https://arxiv.org/abs/2603.06533)
• Keywords: generation, generative
• Abstract: Negation is a fundamental linguistic operator, yet it remains inadequately modeled in diffusion-based generative systems. In this work, we present a formal treatment of linguistic negation in diffusion-based generative models by modeling it as a structured feasibility constraint on semantic guidance within diffusion dynamics. Rather than introducing heuristics or retraining model parameters, we reinterpret classifier-free guidance as defining a semantic update direction and enforce negation by projecting the update onto a convex constraint set derived from linguistic structure. This novel formulation provides a unified framework for handling diverse negation phenomena, including object absence, graded non-inversion semantics, multi-negation composition, and scope-sensitive disambiguation. Our approach is training-free, compatible with pretrained diffusion backbones, and naturally extends from image generation to temporally evolving video trajectories. In addition, we introduce a structured negation-centric benchmark suite that isolates distinct linguistic failure modes in generative systems, to further research in this area. Experiments demonstrate that our method achieves robust negation compliance while preserving visual fidelity and structural coherence, establishing the first unified formulation of linguistic negation in diffusion-based generative models beyond representation-level evaluation.
• 摘要：否定是一种基本的语言运算符，但它在基于扩散的生成系统中仍然没有得到充分的建模。在这项工作中，我们通过将其建模为扩散动力学中语义指导的结构化可行性约束，提出了基于扩散的生成模型中语言否定的正式处理。我们没有引入启发式或重新训练模型参数，而是将无分类器指导重新解释为定义语义更新方向，并通过将更新投影到从语言结构派生的凸约束集上来强制否定。这种新颖的表述为处理不同的否定现象提供了一个统一的框架，包括宾语缺失、分级非反转语义、多重否定组合和范围敏感消歧。我们的方法是免训练的，与预训练的扩散主干兼容，并且自然地从图像生成扩展到时间演变的视频轨迹。此外，我们引入了一个结构化的以否定为中心的基准套件，它隔离了生成系统中不同的语言故障模式，以进一步研究该领域。实验表明，我们的方法在保持视觉保真度和结构连贯性的同时实现了强大的否定合规性，在超越表示级别评估的基于扩散的生成模型中建立了第一个统一的语言否定表述。

Title: Modeling and Measuring Redundancy in Multisource Multimodal Data for Autonomous Driving

• Authors: Yuhan Zhou, Mehri Sattari, Haihua Chen, Kewei Sha
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.06544
• Pdf URL: https://arxiv.org/pdf/2603.06544
• Copy Paste: [[2603.06544]] Modeling and Measuring Redundancy in Multisource Multimodal Data for Autonomous Driving(https://arxiv.org/abs/2603.06544)
• Keywords: generation
• Abstract: Next-generation autonomous vehicles (AVs) rely on large volumes of multisource and multimodal ($M^2$) data to support real-time decision-making. In practice, data quality (DQ) varies across sources and modalities due to environmental conditions and sensor limitations, yet AV research has largely prioritized algorithm design over DQ analysis. This work focuses on redundancy as a fundamental but underexplored DQ issue in AV datasets. Using the nuScenes and Argoverse 2 (AV2) datasets, we model and measure redundancy in multisource camera data and multimodal image-LiDAR data, and evaluate how removing redundant labels affects the YOLOv8 object detection task. Experimental results show that selectively removing redundant multisource image object labels from cameras with shared fields of view improves detection. In nuScenes, mAP${50}$ gains from $0.66$ to $0.70$, $0.64$ to $0.67$, and from $0.53$ to $0.55$, on three representative overlap regions, while detection on other overlapping camera pairs remains at the baseline even under stronger pruning. In AV2, $4.1$-$8.6\%$ of labels are removed, and mAP${50}$ stays near the $0.64$ baseline. Multimodal analysis also reveals substantial redundancy between image and LiDAR data. These findings demonstrate that redundancy is a measurable and actionable DQ factor with direct implications for AV performance. This work highlights the role of redundancy as a data quality factor in AV perception and motivates a data-centric perspective for evaluating and improving AV datasets. Code, data, and implementation details are publicly available at: this https URL
• 摘要：下一代自动驾驶汽车 (AV) 依赖大量多源和多模式 ($M^2$) 数据来支持实时决策。在实践中，由于环境条件和传感器限制，数据质量 (DQ) 因来源和模式而异，但自动驾驶研究在很大程度上优先考虑算法设计而不是 DQ 分析。这项工作的重点是冗余作为 AV 数据集中一个基本但尚未充分研究的 DQ 问题。使用 nuScenes 和 Argoverse 2 (AV2) 数据集，我们对多源相机数据和多模态图像 LiDAR 数据中的冗余进行建模和测量，并评估删除冗余标签如何影响 YOLOv8 对象检测任务。实验结果表明，有选择地从具有共享视场的相机中删除冗余的多源图像对象标签可以改善检测。在 nuScenes 中，三个代表性重叠区域的 mAP${50}$ 从 0.66$ 增加到 0.70$、0.64$ 到 0.67$、从 0.53$ 增加到 0.55$，而其他重叠相机对的检测即使在更强的修剪下也仍保持在基线。在 AV2 中，$4.1$-$8.6\%$ 的标签被删除，mAP${50}$ 保持在 $0.64$ 基线附近。多模态分析还揭示了图像和激光雷达数据之间的大量冗余。这些发现表明，冗余是一个可测量且可操作的 DQ 因素，对 AV 性能有直接影响。这项工作强调了冗余作为自动驾驶感知中数据质量因素的作用，并激发了以数据为中心的视角来评估和改进自动驾驶数据集。代码、数据和实现细节可在以下位置公开获取：此 https URL

Title: Omni-Diffusion: Unified Multimodal Understanding and Generation with Masked Discrete Diffusion

• Authors: Lijiang Li, Zuwei Long, Yunhang Shen, Heting Gao, Haoyu Cao, Xing Sun, Caifeng Shan, Ran He, Chaoyou Fu
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.06577
• Pdf URL: https://arxiv.org/pdf/2603.06577
• Copy Paste: [[2603.06577]] Omni-Diffusion: Unified Multimodal Understanding and Generation with Masked Discrete Diffusion(https://arxiv.org/abs/2603.06577)
• Keywords: generation
• Abstract: While recent multimodal large language models (MLLMs) have made impressive strides, they predominantly employ a conventional autoregressive architecture as their backbone, leaving significant room to explore effective and efficient alternatives in architectural design. Concurrently, recent studies have successfully applied discrete diffusion models to various domains, such as visual understanding and image generation, revealing their considerable potential as a promising backbone for multimodal systems. Drawing inspiration from these pioneering research, we introduce Omni-Diffusion, the first any-to-any multimodal language model built entirely on mask-based discrete diffusion models, which unifies understanding and generation across text, speech, and images. Omni-Diffusion employs a unified mask-based discrete diffusion model to directly capture the joint distribution over discrete multimodal tokens. This approach supports not only bimodal tasks but also more complex scenarios involving multiple modalities. On a diverse set of benchmarks, our method outperforms or performs on par with existing multimodal systems that process two or more modalities, highlighting the significant promise of diffusion models in powering the next generation of multimodal foundation models. Project webpage: this https URL.
• 摘要：虽然最近的多模态大语言模型（MLLM）取得了令人印象深刻的进步，但它们主要采用传统的自回归架构作为其支柱，为探索架构设计中有效和高效的替代方案留下了巨大的空间。同时，最近的研究已成功地将离散扩散模型应用于各个领域，例如视觉理解和图像生成，揭示了它们作为多模态系统的有前途的支柱的巨大潜力。受这些开创性研究的启发，我们推出了 Omni-Diffusion，这是第一个完全基于基于掩模的离散扩散模型构建的任意多模态语言模型，它统一了文本、语音和图像的理解和生成。 Omni-Diffusion 采用统一的基于掩模的离散扩散模型来直接捕获离散多模态标记上的联合分布。这种方法不仅支持双模态任务，还支持涉及多种模态的更复杂的场景。在一组不同的基准上，我们的方法优于或与处理两种或多种模态的现有多模态系统相当，凸显了扩散模型在为下一代多模态基础模型提供动力方面的重大前景。项目网页：此 https URL。