2026-02-26

Title: Uncertainty-Aware Diffusion Model for Multimodal Highway Trajectory Prediction via DDIM Sampling

• Authors: Marion Neumeier, Niklas Roßberg, Michael Botsch, Wolfgang Utschick
• Subjects: cs.LG, cs.CV, cs.RO
• Abstract URL: https://arxiv.org/abs/2602.21319
• Pdf URL: https://arxiv.org/pdf/2602.21319
• Copy Paste: [[2602.21319]] Uncertainty-Aware Diffusion Model for Multimodal Highway Trajectory Prediction via DDIM Sampling(https://arxiv.org/abs/2602.21319)
• Keywords: generation, generative
• Abstract: Accurate and uncertainty-aware trajectory prediction remains a core challenge for autonomous driving, driven by complex multi-agent interactions, diverse scene contexts and the inherently stochastic nature of future motion. Diffusion-based generative models have recently shown strong potential for capturing multimodal futures, yet existing approaches such as cVMD suffer from slow sampling, limited exploitation of generative diversity and brittle scenario encodings. This work introduces cVMDx, an enhanced diffusion-based trajectory prediction framework that improves efficiency, robustness and multimodal predictive capability. Through DDIM sampling, cVMDx achieves up to a 100x reduction in inference time, enabling practical multi-sample generation for uncertainty estimation. A fitted Gaussian Mixture Model further provides tractable multimodal predictions from the generated trajectories. In addition, a CVQ-VAE variant is evaluated for scenario encoding. Experiments on the publicly available highD dataset show that cVMDx achieves higher accuracy and significantly improved efficiency over cVMD, enabling fully stochastic, multimodal trajectory prediction.
• 摘要：在复杂的多智能体交互、多样化的场景环境以及未来运动固有的随机性的推动下，准确且具有不确定性的轨迹预测仍然是自动驾驶的核心挑战。基于扩散的生成模型最近显示出捕获多模态未来的强大潜力，但 cVMD 等现有方法存在采样缓慢、生成多样性利用有限以及场景编码脆弱等问题。这项工作引入了 cVMDx，这是一种增强的基于扩散的轨迹预测框架，可提高效率、鲁棒性和多模态预测能力。通过 DDIM 采样，cVMDx 将推理时间缩短了 100 倍，从而实现了实际的多样本生成以进行不确定性估计。拟合的高斯混合模型进一步根据生成的轨迹提供易于处理的多模态预测。此外，还评估了 CVQ-VAE 变体的场景编码。在公开可用的 highD 数据集上进行的实验表明，cVMDx 比 cVMD 具有更高的精度并显着提高了效率，从而实现了完全随机的多模态轨迹预测。

Title: HorizonForge: Driving Scene Editing with Any Trajectories and Any Vehicles

• Authors: Yifan Wang, Francesco Pittaluga, Zaid Tasneem, Chenyu You, Manmohan Chandraker, Ziyu Jiang
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.21333
• Pdf URL: https://arxiv.org/pdf/2602.21333
• Copy Paste: [[2602.21333]] HorizonForge: Driving Scene Editing with Any Trajectories and Any Vehicles(https://arxiv.org/abs/2602.21333)
• Keywords: generation
• Abstract: Controllable driving scene generation is critical for realistic and scalable autonomous driving simulation, yet existing approaches struggle to jointly achieve photorealism and precise control. We introduce HorizonForge, a unified framework that reconstructs scenes as editable Gaussian Splats and Meshes, enabling fine-grained 3D manipulation and language-driven vehicle insertion. Edits are rendered through a noise-aware video diffusion process that enforces spatial and temporal consistency, producing diverse scene variations in a single feed-forward pass without per-trajectory optimization. To standardize evaluation, we further propose HorizonSuite, a comprehensive benchmark spanning ego- and agent-level editing tasks such as trajectory modifications and object manipulation. Extensive experiments show that Gaussian-Mesh representation delivers substantially higher fidelity than alternative 3D representations, and that temporal priors from video diffusion are essential for coherent synthesis. Combining these findings, HorizonForge establishes a simple yet powerful paradigm for photorealistic, controllable driving simulation, achieving an 83.4% user-preference gain and a 25.19% FID improvement over the second best state-of-the-art method. Project page: this https URL .
• 摘要：可控驾驶场景生成对于真实且可扩展的自动驾驶模拟至关重要，但现有方法很难同时实现照片真实感和精确控制。我们推出了 Horizo​​nForge，这是一个统一的框架，可将场景重建为可编辑的高斯图和网格，从而实现细粒度的 3D 操作和语言驱动的车辆插入。编辑是通过噪声感知视频扩散过程进行渲染的，该过程强制执行空间和时间一致性，在单个前馈通道中产生不同的场景变化，而无需每个轨迹优化。为了标准化评估，我们进一步提出了 Horizo​​nSuite，这是一个涵盖自我和代理级别编辑任务（例如轨迹修改和对象操作）的综合基准。大量实验表明，高斯网格表示比其他 3D 表示具有更高的保真度，并且视频扩散的时间先验对于相干合成至关重要。结合这些发现，Horizo​​nForge 建立了一个简单而强大的范例，用于逼真、可控的驾驶模拟，与第二最佳的最先进方法相比，实现了 83.4% 的用户偏好增益和 25.19% 的 FID 改进。项目页面：此 https URL 。

Title: Archetypal Graph Generative Models: Explainable and Identifiable Communities via Anchor-Dominant Convex Hulls

• Authors: Nikolaos Nakis, Chrysoula Kosma, Panagiotis Promponas, Michail Chatzianastasis, Giannis Nikolentzos
• Subjects: cs.LG, stat.ML
• Abstract URL: https://arxiv.org/abs/2602.21342
• Pdf URL: https://arxiv.org/pdf/2602.21342
• Copy Paste: [[2602.21342]] Archetypal Graph Generative Models: Explainable and Identifiable Communities via Anchor-Dominant Convex Hulls(https://arxiv.org/abs/2602.21342)
• Keywords: generative
• Abstract: Representation learning has been essential for graph machine learning tasks such as link prediction, community detection, and network visualization. Despite recent advances in achieving high performance on these downstream tasks, little progress has been made toward self-explainable models. Understanding the patterns behind predictions is equally important, motivating recent interest in explainable machine learning. In this paper, we present GraphHull, an explainable generative model that represents networks using two levels of convex hulls. At the global level, the vertices of a convex hull are treated as archetypes, each corresponding to a pure community in the network. At the local level, each community is refined by a prototypical hull whose vertices act as representative profiles, capturing community-specific variation. This two-level construction yields clear multi-scale explanations: a node's position relative to global archetypes and its local prototypes directly accounts for its edges. The geometry is well-behaved by design, while local hulls are kept disjoint by construction. To further encourage diversity and stability, we place principled priors, including determinantal point processes, and fit the model under MAP estimation with scalable subsampling. Experiments on real networks demonstrate the ability of GraphHull to recover multi-level community structure and to achieve competitive or superior performance in link prediction and community detection, while naturally providing interpretable predictions.
• 摘要：表示学习对于链接预测、社区检测和网络可视化等图机器学习任务至关重要。尽管最近在这些下游任务上实现高性能方面取得了进展，但在可自我解释的模型方面进展甚微。理解预测背后的模式同样重要，它激发了人们对可解释机器学习的兴趣。在本文中，我们提出了 GraphHull，这是一种可解释的生成模型，它使用两层凸包表示网络。在全局层面，凸包的顶点被视为原型，每个顶点对应于网络中的一个纯社区。在局部层面，每个社区都通过原型外壳进行细化，其顶点充当代表性轮廓，捕获社区特定的变化。这种两级构造产生了清晰的多尺度解释：节点相对于全局原型的位置及其局部原型直接说明了其边缘。几何形状在设计上表现良好，而局部船体在构造上保持脱节。为了进一步鼓励多样性和稳定性，我们放置了原则性先验，包括行列式点过程，并通过可扩展的子采样在 MAP 估计下拟合模型。真实网络上的实验证明了 GraphHull 能够恢复多级社区结构，并在链接预测和社区检测方面实现有竞争力或优越的性能，同时自然地提供可解释的预测。

Title: Defensive Generation

• Authors: Gabriele Farina, Juan Carlos Perdomo
• Subjects: cs.LG, stat.ML
• Abstract URL: https://arxiv.org/abs/2602.21390
• Pdf URL: https://arxiv.org/pdf/2602.21390
• Copy Paste: [[2602.21390]] Defensive Generation(https://arxiv.org/abs/2602.21390)
• Keywords: generation, generative
• Abstract: We study the problem of efficiently producing, in an online fashion, generative models of scalar, multiclass, and vector-valued outcomes that cannot be falsified on the basis of the observed data and a pre-specified collection of computational tests. Our contributions are twofold. First, we expand on connections between online high-dimensional multicalibration with respect to an RKHS and recent advances in expected variational inequality problems, enabling efficient algorithms for the former. We then apply this algorithmic machinery to the problem of outcome indistinguishability. Our procedure, Defensive Generation, is the first to efficiently produce online outcome indistinguishable generative models of non-Bernoulli outcomes that are unfalsifiable with respect to infinite classes of tests, including those that examine higher-order moments of the generated distributions. Furthermore, our method runs in near-linear time in the number of samples and achieves the optimal, vanishing T^{-1/2} rate for generation error.
• 摘要：我们研究以在线方式有效生成标量、多类和向量值结果的生成模型的问题，这些模型不能根据观察到的数据和预先指定的计算测试集合进行伪造。我们的贡献是双重的。首先，我们扩展了 RKHS 在线高维多重校准与预期变分不等式问题的最新进展之间的联系，从而为前者提供了有效的算法。然后，我们将这种算法机制应用于结果不可区分性的问题。我们的程序“防御生成”是第一个有效地生成在线结果不可区分的非伯努利结果的生成模型的程序，这些模型对于无限类别的测试（包括检查生成分布的高阶矩的测试）是不可证伪的。此外，我们的方法在样本数量方面以近线性时间运行，并实现了生成误差的最佳 T^{-1/2} 消失率。

Title: FlowFixer: Towards Detail-Preserving Subject-Driven Generation

• Authors: Jinyoung Jun, Won-Dong Jang, Wenbin Ouyang, Raghudeep Gadde, Jungbeom Lee
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.21402
• Pdf URL: https://arxiv.org/pdf/2602.21402
• Copy Paste: [[2602.21402]] FlowFixer: Towards Detail-Preserving Subject-Driven Generation(https://arxiv.org/abs/2602.21402)
• Keywords: generation
• Abstract: We present FlowFixer, a refinement framework for subject-driven generation (SDG) that restores fine details lost during generation caused by changes in scale and perspective of a subject. FlowFixer proposes direct image-to-image translation from visual references, avoiding ambiguities in language prompts. To enable image-to-image training, we introduce a one-step denoising scheme to generate self-supervised training data, which automatically removes high-frequency details while preserving global structure, effectively simulating real-world SDG errors. We further propose a keypoint matching-based metric to properly assess fidelity in details beyond semantic similarities usually measured by CLIP or DINO. Experimental results demonstrate that FlowFixer outperforms state-of-the-art SDG methods in both qualitative and quantitative evaluations, setting a new benchmark for high-fidelity subject-driven generation.
• 摘要：我们提出了 FlowFixer，这是一个主题驱动生成（SDG）的细化框架，它可以恢复生成过程中由于主题的规模和视角变化而丢失的精细细节。 FlowFixer 提出从视觉参考直接进行图像到图像的翻译，避免语言提示中的歧义。为了实现图像到图像的训练，我们引入了一种一步去噪方案来生成自监督训练数据，该方案自动去除高频细节，同时保留全局结构，有效模拟现实世界的 SDG 误差。我们进一步提出了一种基于关键点匹配的度量，以正确评估细节的保真度，超出通常由 CLIP 或 DINO 测量的语义相似性。实验结果表明，FlowFixer 在定性和定量评估方面均优于最先进的 SDG 方法，为高保真主题驱动生成树立了新基准。

Title: Generative Bayesian Computation as a Scalable Alternative to Gaussian Process Surrogates

• Authors: Nick Polson, Vadim Sokolov
• Subjects: cs.LG, stat.AP, stat.CO, stat.ME, stat.ML
• Abstract URL: https://arxiv.org/abs/2602.21408
• Pdf URL: https://arxiv.org/pdf/2602.21408
• Copy Paste: [[2602.21408]] Generative Bayesian Computation as a Scalable Alternative to Gaussian Process Surrogates(https://arxiv.org/abs/2602.21408)
• Keywords: generative
• Abstract: Gaussian process (GP) surrogates are the default tool for emulating expensive computer experiments, but cubic cost, stationarity assumptions, and Gaussian predictive distributions limit their reach. We propose Generative Bayesian Computation (GBC) via Implicit Quantile Networks (IQNs) as a surrogate framework that targets all three limitations. GBC learns the full conditional quantile function from input--output pairs; at test time, a single forward pass per quantile level produces draws from the predictive distribution. Across fourteen benchmarks we compare GBC to four GP-based methods. GBC improves CRPS by 11--26\% on piecewise jump-process benchmarks, by 14\% on a ten-dimensional Friedman function, and scales linearly to 90,000 training points where dense-covariance GPs are infeasible. A boundary-augmented variant matches or outperforms Modular Jump GPs on two-dimensional jump datasets (up to 46\% CRPS improvement). In active learning, a randomized-prior IQN ensemble achieves nearly three times lower RMSE than deep GP active learning on Rocket LGBB. Overall, GBC records a favorable point estimate in 12 of 14 comparisons. GPs retain an edge on smooth surfaces where their smoothness prior provides effective regularization.
• 摘要：高斯过程 (GP) 代理是模拟昂贵的计算机实验的默认工具，但立方成本、平稳性假设和高斯预测分布限制了它们的范围。我们提出通过隐式分位数网络（IQN）的生成贝叶斯计算（GBC）作为针对所有三个限制的替代框架。 GBC 从输入-输出对中学习完整的条件分位数函数；在测试时，每个分位数水平的一次前向传递会从预测分布中得出结论。我们通过 14 个基准测试将 GBC 与四种基于 GP 的方法进行比较。 GBC 在分段跳跃过程基准上将 CRPS 提高了 11--26%，在十维 Friedman 函数上将 CRPS 提高了 14%，并且线性扩展至 90,000 个训练点，其中密集协方差 GP 不可行。边界增强变体在二维跳跃数据集上匹配或优于模块化跳跃 GP（高达 46% CRPS 改进）。在主动学习中，随机先验 IQN 集成在 Rocket LGBB 上实现的 RMSE 比深度 GP 主动学习低近三倍。总体而言，GBC 在 14 次比较中的 12 次中记录了有利的点估计。 GP 在光滑表面上保留边缘，其光滑度先验提供了有效的正则化。

Title: Benchmarking State Space Models, Transformers, and Recurrent Networks for US Grid Forecasting

• Authors: Sunki Hong, Jisoo Lee, Yuanyuan Shi
• Subjects: cs.LG, eess.SY
• Abstract URL: https://arxiv.org/abs/2602.21415
• Pdf URL: https://arxiv.org/pdf/2602.21415
• Copy Paste: [[2602.21415]] Benchmarking State Space Models, Transformers, and Recurrent Networks for US Grid Forecasting(https://arxiv.org/abs/2602.21415)
• Keywords: generation
• Abstract: Selecting the right deep learning model for power grid forecasting is challenging, as performance heavily depends on the data available to the operator. This paper presents a comprehensive benchmark of five modern neural architectures: two state space models (PowerMamba, S-Mamba), two Transformers (iTransformer, PatchTST), and a traditional LSTM. We evaluate these models on hourly electricity demand across six diverse US power grids for forecast windows between 24 and 168 hours. To ensure a fair comparison, we adapt each model with specialized temporal processing and a modular layer that cleanly integrates weather covariates. Our results reveal that there is no single best model for all situations. When forecasting using only historical load, PatchTST and the state space models provide the highest accuracy. However, when explicit weather data is added to the inputs, the rankings reverse: iTransformer improves its accuracy three times more efficiently than PatchTST. By controlling for model size, we confirm that this advantage stems from the architecture's inherent ability to mix information across different variables. Extending our evaluation to solar generation, wind power, and wholesale prices further demonstrates that model rankings depend on the forecast task: PatchTST excels on highly rhythmic signals like solar, while state space models are better suited for the chaotic fluctuations of wind and price. Ultimately, this benchmark provides grid operators with actionable guidelines for selecting the optimal forecasting architecture based on their specific data environments.
• 摘要：为电网预测选择正确的深度学习模型具有挑战性，因为性能在很大程度上取决于操作员可用的数据。本文提出了五种现代神经架构的综合基准：两个状态空间模型（PowerMamba、S-Mamba）、两个 Transformer（iTransformer、PatchTST）和一个传统的 LSTM。我们根据美国六个不同电网的每小时电力需求评估这些模型，预测窗口范围为 24 至 168 小时。为了确保公平的比较，我们使用专门的时间处理和干净地集成天气协变量的模块化层来调整每个模型。我们的结果表明，不存在适用于所有情况的单一最佳模型。仅使用历史负载进行预测时，PatchTST 和状态空间模型可提供最高的准确度。然而，当将明确的天气数据添加到输入中时，排名就会相反：iTransformer 提高准确性的效率是 PatchTST 的三倍。通过控制模型大小，我们确认这一优势源于该架构混合不同变量信息的固有能力。将我们的评估扩展到太阳能发电、风电和批发价格，进一步表明模型排名取决于预测任务：PatchTST 擅长处理太阳能等高度节奏性信号，而状态空间模型更适合风电和价格的混沌波动。最终，该基准为电网运营商提供了可操作的指南，用于根据其特定的数据环境选择最佳的预测架构。

Title: WildSVG: Towards Reliable SVG Generation Under Real-Word Conditions

• Authors: Marco Terral, Haotian Zhang, Tianyang Zhang, Meng Lin, Xiaoqing Xie, Haoran Dai, Darsh Kaushik, Pai Peng, Nicklas Scharpff, David Vazquez, Joan Rodriguez
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.21416
• Pdf URL: https://arxiv.org/pdf/2602.21416
• Copy Paste: [[2602.21416]] WildSVG: Towards Reliable SVG Generation Under Real-Word Conditions(https://arxiv.org/abs/2602.21416)
• Keywords: generation
• Abstract: We introduce the task of SVG extraction, which consists in translating specific visual inputs from an image into scalable vector graphics. Existing multimodal models achieve strong results when generating SVGs from clean renderings or textual descriptions, but they fall short in real-world scenarios where natural images introduce noise, clutter, and domain shifts. A central challenge in this direction is the lack of suitable benchmarks. To address this need, we introduce the WildSVG Benchmark, formed by two complementary datasets: Natural WildSVG, built from real images containing company logos paired with their SVG annotations, and Synthetic WildSVG, which blends complex SVG renderings into real scenes to simulate difficult conditions. Together, these resources provide the first foundation for systematic benchmarking SVG extraction. We benchmark state-of-the-art multimodal models and find that current approaches perform well below what is needed for reliable SVG extraction in real scenarios. Nonetheless, iterative refinement methods point to a promising path forward, and model capabilities are steadily improving
• 摘要：我们介绍 SVG 提取的任务，其中包括将图像中的特定视觉输入转换为可缩放矢量图形。现有的多模态模型在从干净的渲染或文本描述生成 SVG 时取得了很好的结果，但在自然图像引入噪声、杂波和域偏移的现实场景中，它们却表现不佳。这个方向的一个主要挑战是缺乏合适的基准。为了满足这一需求，我们引入了 WildSVG 基准，它由两个互补的数据集组成：Natural WildSVG，由包含公司徽标及其 SVG 注释的真实图像构建；Synthetic WildSVG，它将复杂的 SVG 渲染混合到真实场景中以模拟困难的条件。这些资源共同为 SVG 提取的系统基准测试奠定了第一个基础。我们对最先进的多模态模型进行了基准测试，发现当前方法的性能远远低于实际场景中可靠的 SVG 提取所需的性能。尽管如此，迭代细化方法指明了一条充满希望的前进道路，并且模型能力正在稳步提高

Title: Overconfident Errors Need Stronger Correction: Asymmetric Confidence Penalties for Reinforcement Learning

• Authors: Yuanda Xu, Hejian Sang, Zhengze Zhou, Ran He, Zhipeng Wang
• Subjects: cs.LG, cs.AI
• Abstract URL: https://arxiv.org/abs/2602.21420
• Pdf URL: https://arxiv.org/pdf/2602.21420
• Copy Paste: [[2602.21420]] Overconfident Errors Need Stronger Correction: Asymmetric Confidence Penalties for Reinforcement Learning(https://arxiv.org/abs/2602.21420)
• Keywords: generation
• Abstract: Reinforcement Learning with Verifiable Rewards (RLVR) has become the leading paradigm for enhancing reasoning in Large Language Models (LLMs). However, standard RLVR algorithms suffer from a well-documented pathology: while they improve Pass@1 accuracy through sharpened sampling, they simultaneously narrow the model's reasoning boundary and reduce generation diversity. We identify a root cause that existing methods overlook: the uniform penalization of errors. Current approaches -- whether data-filtering methods that select prompts by difficulty, or advantage normalization schemes -- treat all incorrect rollouts within a group identically. We show that this uniformity allows overconfident errors (incorrect reasoning paths that the RL process has spuriously reinforced) to persist and monopolize probability mass, ultimately suppressing valid exploratory trajectories. To address this, we propose the Asymmetric Confidence-aware Error Penalty (ACE). ACE introduces a per-rollout confidence shift metric, c_i = log(pi_theta(y_i|x) / pi_ref(y_i|x)), to dynamically modulate negative advantages. Theoretically, we demonstrate that ACE's gradient can be decomposed into the gradient of a selective regularizer restricted to overconfident errors, plus a well-characterized residual that partially moderates the regularizer's strength. We conduct extensive experiments fine-tuning Qwen2.5-Math-7B, Qwen3-8B-Base, and Llama-3.1-8B-Instruct on the DAPO-Math-17K dataset using GRPO and DAPO within the VERL framework. Evaluated on MATH-500 and AIME 2025, ACE composes seamlessly with existing methods and consistently improves the full Pass@k spectrum across all three model families and benchmarks.
• 摘要：具有可验证奖励的强化学习 (RLVR) 已成为增强大型语言模型 (LLM) 推理的领先范例。然而，标准 RLVR 算法存在有据可查的病态：虽然它们通过锐化采样提高了 Pass@1 精度，但同时缩小了模型的推理边界并减少了生成多样性。我们确定了现有方法忽视的根本原因：对错误的统一惩罚。当前的方法——无论是按难度选择提示的数据过滤方法，还是优势标准化方案——都会同等对待组内所有不正确的展示。我们证明，这种一致性允许过度自信的错误（强化学习过程虚假强化的不正确推理路径）持续存在并垄断概率质量，最终抑制有效的探索轨迹。为了解决这个问题，我们提出了非对称置信感知错误惩罚（ACE）。 ACE 引入了每次推出的置信度偏移指标 c_i = log(pi_theta(y_i|x) / pi_ref(y_i|x))，以动态调节负面优势。理论上，我们证明 ACE 的梯度可以分解为限制过度自信误差的选择性正则化器的梯度，加上部分调节正则化器强度的良好表征的残差。我们在 VERL 框架内使用 GRPO 和 DAPO 在 DAPO-Math-17K 数据集上进行了广泛的实验，对 Qwen2.5-Math-7B、Qwen3-8B-Base 和 Llama-3.1-8B-Instruct 进行了微调。在 MATH-500 和 AIME 2025 上进行评估，ACE 与现有方法无缝组合，并持续改进所有三个模型系列和基准的完整 Pass@k 谱。

Title: Provably Safe Generative Sampling with Constricting Barrier Functions

• Authors: Darshan Gadginmath, Ahmed Allibhoy, Fabio Pasqualetti
• Subjects: cs.LG, cs.AI, eess.SY, math.OC
• Abstract URL: https://arxiv.org/abs/2602.21429
• Pdf URL: https://arxiv.org/pdf/2602.21429
• Copy Paste: [[2602.21429]] Provably Safe Generative Sampling with Constricting Barrier Functions(https://arxiv.org/abs/2602.21429)
• Keywords: generation, generative
• Abstract: Flow-based generative models, such as diffusion models and flow matching models, have achieved remarkable success in learning complex data distributions. However, a critical gap remains for their deployment in safety-critical domains: the lack of formal guarantees that generated samples will satisfy hard constraints. We address this by proposing a safety filtering framework that acts as an online shield for any pre-trained generative model. Our key insight is to cooperate with the generative process rather than override it. We define a constricting safety tube that is relaxed at the initial noise distribution and progressively tightens to the target safe set at the final data distribution, mirroring the coarse-to-fine structure of the generative process itself. By characterizing this tube via Control Barrier Functions (CBFs), we synthesize a feedback control input through a convex Quadratic Program (QP) at each sampling step. As the tube is loosest when noise is high and intervention is cheapest in terms of control energy, most constraint enforcement occurs when it least disrupts the model's learned structure. We prove that this mechanism guarantees safe sampling while minimizing the distributional shift from the original model at each sampling step, as quantified by the KL divergence. Our framework applies to any pre-trained flow-based generative scheme requiring no retraining or architectural modifications. We validate the approach across constrained image generation, physically-consistent trajectory sampling, and safe robotic manipulation policies, achieving 100% constraint satisfaction while preserving semantic fidelity.
• 摘要：基于流的生成模型，例如扩散模型和流匹配模型，在学习复杂数据分布方面取得了显着的成功。然而，它们在安全关键领域的部署仍然存在一个关键差距：缺乏生成的样本将满足硬约束的正式保证。我们通过提出一个安全过滤框架来解决这个问题，该框架充当任何预训练生成模型的在线防护罩。我们的主要见解是与生成过程合作而不是超越它。我们定义了一个收缩安全管，它在初始噪声分布时放松，并在最终数据分布时逐渐收紧到目标安全集，反映了生成过程本身从粗到细的结构。通过控制势垒函数 (CBF) 表征该管，我们在每个采样步骤通过凸二次规划 (QP) 合成反馈控制输入。由于当噪声高时管子最松，并且干预在控制能量方面最便宜，因此大多数约束执行发生在对模型的学习结构破坏最少的情况下。我们证明，这种机制保证了安全采样，同时最大限度地减少了每个采样步骤中与原始模型的分布偏移（通过 KL 散度进行量化）。我们的框架适用于任何预先训练的基于流程的生成方案，无需重新训练或架构修改。我们通过约束图像生成、物理一致的轨迹采样和安全的机器人操作策略来验证该方法，实现 100% 的约束满足，同时保持语义保真度。

Title: Synergizing Understanding and Generation with Interleaved Analyzing-Drafting Thinking

• Authors: Shengqiong Wu, Bobo Li, Xinkai Wang, Xiangtai Li, Lei Cui, Furu Wei, Shuicheng Yan, Hao Fei, Tat-seng Chua
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.21435
• Pdf URL: https://arxiv.org/pdf/2602.21435
• Copy Paste: [[2602.21435]] Synergizing Understanding and Generation with Interleaved Analyzing-Drafting Thinking(https://arxiv.org/abs/2602.21435)
• Keywords: generation
• Abstract: Unified Vision-Language Models (UVLMs) aim to advance multimodal learning by supporting both understanding and generation within a single framework. However, existing approaches largely focus on architectural unification while overlooking the need for explicit interaction between the two capabilities during task solving. As a result, current models treat understanding and generation as parallel skills rather than synergistic processes. To achieve real synergy, we introduce the interleaved Analyzing-Drafting problem-solving loop (AD-Loop), a new think paradigm that dynamically alternates between analytic and drafting operations. By interleaving textual thoughts with visual thoughts, AD-Loop enables models to iteratively refine both comprehension and outputs, fostering genuine synergy. To train this mechanism, we design a two-stage strategy: supervised learning on interleaved thought data to initialize alternation, followed by reinforcement learning to promote adaptive and autonomous control. Extensive experiments demonstrate that AD-Loop consistently improves performance across standard benchmarks for both understanding and generation, with strong transferability to various UVLMs architectures. Visual analyses further validate the effectiveness of implicit visual thoughts. These results highlight AD-Loop as a principled and broadly applicable strategy for synergizing comprehension and creation. The project page is at this https URL.
• 摘要：统一视觉语言模型 (UVLM) 旨在通过支持单一框架内的理解和生成来推进多模式学习。然而，现有方法主要关注架构统一，而忽视了任务解决过程中两种功能之间显式交互的需要。因此，当前的模型将理解和生成视为并行技能，而不是协同过程。为了实现真正的协同作用，我们引入了交错的分析-绘图问题解决循环（AD-Loop），这是一种新的思维范式，可以在分析和绘图操作之间动态交替。通过将文本思维与视觉思维交织在一起，AD-Loop 使模型能够迭代地完善理解和输出，从而促进真正的协同作用。为了训练这种机制，我们设计了一个两阶段策略：对交错思维数据进行监督学习以初始化交替，然后进行强化学习以促进自适应和自主控制。大量实验表明，AD-Loop 能够持续提高理解和生成标准基准的性能，并且具有向各种 UVLM 架构的强大可移植性。视觉分析进一步验证了内隐视觉思维的有效性。这些结果凸显了 AD-Loop 是一种有原则且广泛适用的协同理解和创造策略。项目页面位于此 https URL。

Title: Causal Decoding for Hallucination-Resistant Multimodal Large Language Models

• Authors: Shiwei Tan, Hengyi Wang, Weiyi Qin, Qi Xu, Zhigang Hua, Hao Wang
• Subjects: cs.LG, cs.AI, cs.CV
• Abstract URL: https://arxiv.org/abs/2602.21441
• Pdf URL: https://arxiv.org/pdf/2602.21441
• Copy Paste: [[2602.21441]] Causal Decoding for Hallucination-Resistant Multimodal Large Language Models(https://arxiv.org/abs/2602.21441)
• Keywords: generation
• Abstract: Multimodal Large Language Models (MLLMs) deliver detailed responses on vision-language tasks, yet remain susceptible to object hallucination (introducing objects not present in the image), undermining reliability in practice. Prior efforts often rely on heuristic penalties, post-hoc correction, or generic decoding tweaks, which do not directly intervene in the mechanisms that trigger object hallucination and thus yield limited gains. To address this challenge, we propose a causal decoding framework that applies targeted causal interventions during generation to curb spurious object mentions. By reshaping the decoding dynamics to attenuate spurious dependencies, our approach reduces false object tokens while maintaining descriptive quality. Across captioning and QA benchmarks, our framework substantially lowers object-hallucination rates and achieves state-of-the-art faithfulness without degrading overall output quality.
• 摘要：多模态大语言模型（MLLM）可以对视觉语言任务提供详细的响应，但仍然容易产生物体幻觉（引入图像中不存在的物体），从而破坏了实践中的可靠性。先前的努力通常依赖于启发式惩罚、事后纠正或通用解码调整，这些方法不会直接干预触发物体幻觉的机制，从而产生有限的收益。为了应对这一挑战，我们提出了一个因果解码框架，该框架在生成过程中应用有针对性的因果干预来遏制虚假对象提及。通过重塑解码动态以减弱虚假依赖性，我们的方法减少了错误的对象标记，同时保持了描述质量。在字幕和质量保证基准方面，我们的框架大大降低了物体幻觉率，并在不降低整体输出质量的情况下实现了最先进的忠实度。

Title: D-Flow SGLD: Source-Space Posterior Sampling for Scientific Inverse Problems with Flow Matching

• Authors: Meet Hemant Parikh, Yaqin Chen, Jian-Xun Wang
• Subjects: cs.LG
• Abstract URL: https://arxiv.org/abs/2602.21469
• Pdf URL: https://arxiv.org/pdf/2602.21469
• Copy Paste: [[2602.21469]] D-Flow SGLD: Source-Space Posterior Sampling for Scientific Inverse Problems with Flow Matching(https://arxiv.org/abs/2602.21469)
• Keywords: generation
• Abstract: Data assimilation and scientific inverse problems require reconstructing high-dimensional physical states from sparse and noisy observations, ideally with uncertainty-aware posterior samples that remain faithful to learned priors and governing physics. While training-free conditional generation is well developed for diffusion models, corresponding conditioning and posterior sampling strategies for Flow Matching (FM) priors remain comparatively under-explored, especially on scientific benchmarks where fidelity must be assessed beyond measurement misfit. In this work, we study training-free conditional generation for scientific inverse problems under FM priors and organize existing inference-time strategies by where measurement information is injected: (i) guided transport dynamics that perturb sampling trajectories using likelihood information, and (ii) source-distribution inference that performs posterior inference over the source variable while keeping the learned transport fixed. Building on the latter, we propose D-Flow SGLD, a source-space posterior sampling method that augments differentiable source inference with preconditioned stochastic gradient Langevin dynamics, enabling scalable exploration of the source posterior induced by new measurement operators without retraining the prior or modifying the learned FM dynamics. We benchmark representative methods from both families on a hierarchy of problems: 2D toy posteriors, chaotic Kuramoto-Sivashinsky trajectories, and wall-bounded turbulence reconstruction. Across these settings, we quantify trade-offs among measurement assimilation, posterior diversity, and physics/statistics fidelity, and establish D-Flow SGLD as a practical FM-compatible posterior sampler for scientific inverse problems.
• 摘要：数据同化和科学逆问题需要从稀疏和嘈杂的观察中重建高维物理状态，理想情况下使用能够忠实于所学先验和控制物理的不确定性感知后验样本。虽然免训练条件生成对于扩散模型来说已经得到了很好的发展，但流匹配（FM）先验的相应条件和后采样策略仍然相对未得到充分探索，特别是在必须评估保真度超出测量失配范围的科学基准上。在这项工作中，我们研究了 FM 先验下科学逆问题的免训练条件生成，并通过注入测量信息来组织现有的推理时间策略：（i）使用似然信息扰乱采样轨迹的引导传输动力学，以及（ii）源分布推理，对源变量执行后验推理，同时保持学习的传输固定。在后者的基础上，我们提出了 D-Flow SGLD，这是一种源空间后验采样方法，它通过预处理随机梯度 Langevin 动力学增强可微源推断，从而能够对新测量算子引起的源后验进行可扩展的探索，而无需重新训练先验或修改学习的 FM 动力学。我们在一系列问题上对这两个家族的代表性方法进行基准测试：2D 玩具后验、混沌 Kuramoto-Sivashinsky 轨迹和壁界湍流重建。在这些设置中，我们量化了测量同化、后验多样性和物理/统计保真度之间的权衡，并将 D-Flow SGLD 建立为用于科学逆问题的实用的 FM 兼容后验采样器。

Title: The Design Space of Tri-Modal Masked Diffusion Models

• Authors: Louis Bethune, Victor Turrisi, Bruno Kacper Mlodozeniec, Pau Rodriguez Lopez, Lokesh Boominathan, Nikhil Bhendawade, Amitis Shidani, Joris Pelemans, Theo X. Olausson, Devon Hjelm, Paul Dixon, Joao Monteiro, Pierre Ablin, Vishnu Banna, Arno Blaas, Nick Henderson, Kari Noriy, Dan Busbridge, Josh Susskind, Marco Cuturi, Irina Belousova, Luca Zappella, Russ Webb, Jason Ramapuram
• Subjects: cs.LG
• Abstract URL: https://arxiv.org/abs/2602.21472
• Pdf URL: https://arxiv.org/pdf/2602.21472
• Copy Paste: [[2602.21472]] The Design Space of Tri-Modal Masked Diffusion Models(https://arxiv.org/abs/2602.21472)
• Keywords: generation
• Abstract: Discrete diffusion models have emerged as strong alternatives to autoregressive language models, with recent work initializing and fine-tuning a base unimodal model for bimodal generation. Diverging from previous approaches, we introduce the first tri-modal masked diffusion model pretrained from scratch on text, image-text, and audio-text data. We systematically analyze multimodal scaling laws, modality mixing ratios, noise schedules, and batch-size effects, and we provide optimized inference sampling defaults. Our batch-size analysis yields a novel stochastic differential equation (SDE)-based reparameterization that eliminates the need for tuning the optimal batch size as reported in recent work. This reparameterization decouples the physical batch size, often chosen based on compute constraints (GPU saturation, FLOP efficiency, wall-clock time), from the logical batch size, chosen to balance gradient variance during stochastic optimization. Finally, we pretrain a preliminary 3B-parameter tri-modal model on 6.4T tokens, demonstrating the capabilities of a unified design and achieving strong results in text generation, text-to-image tasks, and text-to-speech tasks. Our work represents the largest-scale systematic open study of multimodal discrete diffusion models conducted to date, providing insights into scaling behaviors across multiple modalities.
• 摘要：离散扩散模型已成为自回归语言模型的有力替代品，最近的工作初始化并微调了双峰生成的基本单峰模型。与以前的方法不同，我们引入了第一个在文本、图像文本和音频文本数据上从头开始预训练的三模态掩蔽扩散模型。我们系统地分析多模态缩放定律、模态混合比、噪声调度和批量大小效应，并提供优化的推理采样默认值。我们的批量大小分析产生了一种新颖的基于随机微分方程（SDE）的重新参数化，无需像最近的工作中报告的那样调整最佳批量大小。这种重新参数化将物理批量大小（通常根据计算约束（GPU 饱和度、FLOP 效率、挂钟时间）选择）与逻辑批量大小（选择用于在随机优化期间平衡梯度方差）解耦。最后，我们在 6.4T 代币上预训练了初步的 3B 参数三模态模型，展示了统一设计的能力，并在文本生成、文本转图像任务和文本转语音任务中取得了良好的结果。我们的工作代表了迄今为止对多模式离散扩散模型进行的最大规模的系统开放研究，提供了对跨多种模式的扩展行为的见解。

Title: See It, Say It, Sorted: An Iterative Training-Free Framework for Visually-Grounded Multimodal Reasoning in LVLMs

• Authors: Yongchang Zhang, Xianzheng Ma, Tianyi Liu, Guangquan Zhou, Yang Chen
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.21497
• Pdf URL: https://arxiv.org/pdf/2602.21497
• Copy Paste: [[2602.21497]] See It, Say It, Sorted: An Iterative Training-Free Framework for Visually-Grounded Multimodal Reasoning in LVLMs(https://arxiv.org/abs/2602.21497)
• Keywords: generation
• Abstract: Recent large vision-language models (LVLMs) have demonstrated impressive reasoning ability by generating long chain-of-thought (CoT) responses. However, CoT reasoning in multimodal contexts is highly vulnerable to visual hallucination propagation: once an intermediate reasoning step becomes inconsistent with the visual evidence, subsequent steps-even if logically valid-can still lead to incorrect final answers. Existing solutions attempt to mitigate this issue by training models to "think with images" via reinforcement learning (RL). While effective, these methods are costly, model-specific, and difficult to generalize across architectures. Differently, we present a lightweight method that bypasses RL training and provides an iterative, training-free, plug-and-play framework for visually-grounded multimodal reasoning. Our key idea is to supervise each reasoning step at test time with visual evidence, ensuring that every decoded token is justified by corresponding visual cues. Concretely, we construct a textual visual-evidence pool that guides the model's reasoning generation. When existing evidence is insufficient, a visual decider module dynamically extracts additional relevant evidence from the image based on the ongoing reasoning context, expanding the pool until the model achieves sufficient visual certainty to terminate reasoning and produce the final answer. Extensive experiments on multiple LVLM backbones and benchmarks demonstrate the effectiveness of our approach. Our method achieves 16.5%-29.5% improvements on TreeBench and 13.7% RH-AUC gains on RH-Bench, substantially reducing hallucination rates while improving reasoning accuracy without additional training.
• 摘要：最近的大型视觉语言模型（LVLM）通过生成长思维链（CoT）响应而表现出令人印象深刻的推理能力。然而，多模态环境中的 CoT 推理非常容易受到视觉幻觉传播的影响：一旦中间推理步骤与视觉证据不一致，后续步骤（即使逻辑上有效）仍然可能导致错误的最终答案。现有的解决方案试图通过强化学习（RL）训练模型“用图像思考”来缓解这个问题。虽然有效，但这些方法成本高昂、特定于模型并且难以跨架构推广。不同的是，我们提出了一种绕过强化学习训练的轻量级方法，并为基于视觉的多模态推理提供迭代、免训练、即插即用的框架。我们的关键思想是在测试时用视觉证据监督每个推理步骤，确保每个解码的令牌都通过相应的视觉线索来证明是合理的。具体来说，我们构建了一个文本视觉证据池来指导模型的推理生成。当现有证据不足时，视觉决策器模块会根据正在进行的推理上下文从图像中动态提取额外的相关证据，扩大证据池，直到模型获得足够的视觉确定性来终止推理并产生最终答案。对多个 LVLM 主干和基准的广泛实验证明了我们方法的有效性。我们的方法在 TreeBench 上实现了 16.5%-29.5% 的改进，在 RH-Bench 上实现了 13.7% 的 RH-AUC 增益，显着降低了幻觉率，同时在无需额外训练的情况下提高了推理准确性。

Title: Easy3E: Feed-Forward 3D Asset Editing via Rectified Voxel Flow

• Authors: Shimin Hu, Yuanyi Wei, Fei Zha, Yudong Guo, Juyong Zhang
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.21499
• Pdf URL: https://arxiv.org/pdf/2602.21499
• Copy Paste: [[2602.21499]] Easy3E: Feed-Forward 3D Asset Editing via Rectified Voxel Flow(https://arxiv.org/abs/2602.21499)
• Keywords: generation, generative
• Abstract: Existing 3D editing methods rely on computationally intensive scene-by-scene iterative optimization and suffer from multi-view inconsistency. We propose an effective and fully feedforward 3D editing framework based on the TRELLIS generative backbone, capable of modifying 3D models from a single editing view. Our framework addresses two key issues: adapting training-free 2D editing to structured 3D representations, and overcoming the bottleneck of appearance fidelity in compressed 3D features. To ensure geometric consistency, we introduce Voxel FlowEdit, an edit-driven flow in the sparse voxel latent space that achieves globally consistent 3D deformation in a single pass. To restore high-fidelity details, we develop a normal-guided single to multi-view generation module as an external appearance prior, successfully recovering high-frequency textures. Experiments demonstrate that our method enables fast, globally consistent, and high-fidelity 3D model editing.
• 摘要：现有的 3D 编辑方法依赖于计算密集型的逐场景迭代优化，并且存在多视图不一致的问题。我们提出了一种基于 TRELLIS 生成主干的有效且完全前馈的 3D 编辑框架，能够从单个编辑视图修改 3D 模型。我们的框架解决了两个关键问题：使免训练 2D 编辑适应结构化 3D 表示，以及克服压缩 3D 特征中外观保真度的瓶颈。为了确保几何一致性，我们引入了 Voxel FlowEdit，这是稀疏体素潜在空间中的编辑驱动流，可在单次传递中实现全局一致的 3D 变形。为了恢复高保真细节，我们开发了法线引导的单视图到多视图生成模块作为外观先验，成功恢复了高频纹理。实验表明，我们的方法可以实现快速、全局一致且高保真的 3D 模型编辑。

Title: WaterVIB: Learning Minimal Sufficient Watermark Representations via Variational Information Bottleneck

• Authors: Haoyuan He, Yu Zheng, Jie Zhou, Jiwen Lu
• Subjects: cs.LG, cs.CR, cs.CV
• Abstract URL: https://arxiv.org/abs/2602.21508
• Pdf URL: https://arxiv.org/pdf/2602.21508
• Copy Paste: [[2602.21508]] WaterVIB: Learning Minimal Sufficient Watermark Representations via Variational Information Bottleneck(https://arxiv.org/abs/2602.21508)
• Keywords: generation, generative
• Abstract: Robust watermarking is critical for intellectual property protection, whereas existing methods face a severe vulnerability against regeneration-based AIGC attacks. We identify that existing methods fail because they entangle the watermark with high-frequency cover texture, which is susceptible to being rewritten during generative purification. To address this, we propose WaterVIB, a theoretically grounded framework that reformulates the encoder as an information sieve via the Variational Information Bottleneck. Instead of overfitting to fragile cover details, our approach forces the model to learn a Minimal Sufficient Statistic of the message. This effectively filters out redundant cover nuances prone to generative shifts, retaining only the essential signal invariant to regeneration. We theoretically prove that optimizing this bottleneck is a necessary condition for robustness against distribution-shifting attacks. Extensive experiments demonstrate that WaterVIB significantly outperforms state-of-the-art methods, achieving superior zero-shot resilience against unknown diffusion-based editing.
• 摘要：强大的水印对于知识产权保护至关重要，而现有方法面临着针对基于再生的 AIGC 攻击的严重漏洞。我们发现现有方法失败是因为它们将水印与高频覆盖纹理纠缠在一起，而高频覆盖纹理很容易在生成纯化过程中被重写。为了解决这个问题，我们提出了 WaterVIB，这是一个基于理论的框架，它通过变分信息瓶颈将编码器重新表述为信息筛。我们的方法不会过度拟合脆弱的封面细节，而是迫使模型学习消息的最小充分统计量。这有效地过滤掉了容易产生生成变化的冗余覆盖细微差别，仅保留对再生不变的基本信号。我们从理论上证明，优化这个瓶颈是抵御分布转移攻击的鲁棒性的必要条件。大量实验表明，WaterVIB 的性能显着优于最先进的方法，针对未知的基于扩散的编辑实现了卓越的零样本恢复能力。

Title: Pseudo-View Enhancement via Confidence Fusion for Unposed Sparse-View Reconstruction

• Authors: Beizhen Zhao, Sicheng Yu, Guanzhi Ding, Yu Hu, Hao Wang
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.21535
• Pdf URL: https://arxiv.org/pdf/2602.21535
• Copy Paste: [[2602.21535]] Pseudo-View Enhancement via Confidence Fusion for Unposed Sparse-View Reconstruction(https://arxiv.org/abs/2602.21535)
• Keywords: restoration
• Abstract: 3D scene reconstruction under unposed sparse viewpoints is a highly challenging yet practically important problem, especially in outdoor scenes due to complex lighting and scale variation. With extremely limited input views, directly utilizing diffusion model to synthesize pseudo frames will introduce unreasonable geometry, which will harm the final reconstruction quality. To address these issues, we propose a novel framework for sparse-view outdoor reconstruction that achieves high-quality results through bidirectional pseudo frame restoration and scene perception Gaussian management. Specifically, we introduce a bidirectional pseudo frame restoration method that restores missing content by diffusion-based synthesis guided by adjacent frames with a lightweight pseudo-view deblur model and confidence mask inference algorithm. Then we propose a scene perception Gaussian management strategy that optimize Gaussians based on joint depth-density information. These designs significantly enhance reconstruction completeness, suppress floating artifacts and improve overall geometric consistency under extreme view sparsity. Experiments on outdoor benchmarks demonstrate substantial gains over existing methods in both fidelity and stability.
• 摘要：非已知稀疏视点下的 3D 场景重建是一个极具挑战性但实际上很重要的问题，特别是在由于复杂的光照和尺度变化的室外场景中。在输入视图极其有限的情况下，直接利用扩散模型合成伪帧会引入不合理的几何结构，从而损害最终的重建质量。为了解决这些问题，我们提出了一种新颖的稀疏视图室外重建框架，通过双向伪帧恢复和场景感知高斯管理来实现高质量的结果。具体来说，我们引入了一种双向伪帧恢复方法，该方法通过由相邻帧引导的基于扩散的合成，使用轻量级伪视图去模糊模型和置信掩模推理算法来恢复丢失的内容。然后，我们提出了一种基于联合深度密度信息优化高斯的场景感知高斯管理策略。这些设计显着增强了重建完整性，抑制了浮动伪影，并提高了极端视图稀疏条件下的整体几何一致性。户外基准实验表明，在保真度和稳定性方面均优于现有方法。

Title: Training-free Composition of Pre-trained GFlowNets for Multi-Objective Generation

• Authors: Seokwon Yoon, Youngbin Choi, Seunghyuk Cho, Seungbeom Lee, MoonJeong Park, Dongwoo Kim
• Subjects: cs.LG
• Abstract URL: https://arxiv.org/abs/2602.21565
• Pdf URL: https://arxiv.org/pdf/2602.21565
• Copy Paste: [[2602.21565]] Training-free Composition of Pre-trained GFlowNets for Multi-Objective Generation(https://arxiv.org/abs/2602.21565)
• Keywords: generation, generative
• Abstract: Generative Flow Networks (GFlowNets) learn to sample diverse candidates in proportion to a reward function, making them well-suited for scientific discovery, where exploring multiple promising solutions is crucial. Further extending GFlowNets to multi-objective settings has attracted growing interest since real-world applications often involve multiple, conflicting objectives. However, existing approaches require additional training for each set of objectives, limiting their applicability and incurring substantial computational overhead. We propose a training-free mixing policy that composes pre-trained GFlowNets at inference time, enabling rapid adaptation without finetuning or retraining. Importantly, our framework is flexible, capable of handling diverse reward combinations ranging from linear scalarization to complex non-linear logical operators, which are often handled separately in previous literature. We prove that our method exactly recovers the target distribution for linear scalarization and quantify the approximation quality for nonlinear operators through a distortion factor. Experiments on a synthetic 2D grid and real-world molecule-generation tasks demonstrate that our approach achieves performance comparable to baselines that require additional training.
• 摘要：生成流网络（GFlowNets）学习按照奖励函数的比例对不同的候选者进行采样，使它们非常适合科学发现，其中探索多种有前途的解决方案至关重要。进一步将 GFlowNets 扩展到多目标设置引起了越来越多的兴趣，因为现实世界的应用程序通常涉及多个相互冲突的目标。然而，现有的方法需要对每组目标进行额外的训练，限制了它们的适用性并产生大量的计算开销。我们提出了一种免训练混合策略，该策略在推理时组成预先训练的 GFlowNet，从而无需微调或重新训练即可快速适应。重要的是，我们的框架是灵活的，能够处理从线性标量到复杂的非线性逻辑运算符的各种奖励组合，这些组合在以前的文献中通常是单独处理的。我们证明我们的方法准确地恢复了线性标量化的目标分布，并通过失真因子量化了非线性算子的近似质量。合成二维网格和现实世界分子生成任务的实验表明，我们的方法实现了与需要额外训练的基线相当的性能。

Title: MultiAnimate: Pose-Guided Image Animation Made Extensible

• Authors: Yingcheng Hu, Haowen Gong, Chuanguang Yang, Zhulin An, Yongjun Xu, Songhua Liu
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.21581
• Pdf URL: https://arxiv.org/pdf/2602.21581
• Copy Paste: [[2602.21581]] MultiAnimate: Pose-Guided Image Animation Made Extensible(https://arxiv.org/abs/2602.21581)
• Keywords: generation
• Abstract: Pose-guided human image animation aims to synthesize realistic videos of a reference character driven by a sequence of poses. While diffusion-based methods have achieved remarkable success, most existing approaches are limited to single-character animation. We observe that naively extending these methods to multi-character scenarios often leads to identity confusion and implausible occlusions between characters. To address these challenges, in this paper, we propose an extensible multi-character image animation framework built upon modern Diffusion Transformers (DiTs) for video generation. At its core, our framework introduces two novel components-Identifier Assigner and Identifier Adapter - which collaboratively capture per-person positional cues and inter-person spatial relationships. This mask-driven scheme, along with a scalable training strategy, not only enhances flexibility but also enables generalization to scenarios with more characters than those seen during training. Remarkably, trained on only a two-character dataset, our model generalizes to multi-character animation while maintaining compatibility with single-character cases. Extensive experiments demonstrate that our approach achieves state-of-the-art performance in multi-character image animation, surpassing existing diffusion-based baselines.
• 摘要：姿势引导的人体图像动画旨在合成由一系列姿势驱动的参考角色的逼真视频。虽然基于扩散的方法取得了显着的成功，但大多数现有方法仅限于单角色动画。我们观察到，天真地将这些方法扩展到多角色场景通常会导致角色之间的身份混乱和令人难以置信的遮挡。为了解决这些挑战，在本文中，我们提出了一种基于现代扩散变压器（DiT）的可扩展多字符图像动画框架，用于视频生成。我们的框架的核心引入了两个新颖的组件——标识符分配器和标识符适配器——它们协作捕获每个人的位置线索和人与人之间的空间关系。这种掩码驱动的方案以及可扩展的训练策略不仅增强了灵活性，而且还能够泛化到比训练期间看到的字符更多的场景。值得注意的是，我们的模型仅在两个字符数据集上进行训练，可推广到多字符动画，同时保持与单字符情况的兼容性。大量的实验表明，我们的方法在多字符图像动画中实现了最先进的性能，超越了现有的基于扩散的基线。

Title: CADC: Content Adaptive Diffusion-Based Generative Image Compression

• Authors: Xihua Sheng, Lingyu Zhu, Tianyu Zhang, Dong Liu, Shiqi Wang, Jing Wang
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.21591
• Pdf URL: https://arxiv.org/pdf/2602.21591
• Copy Paste: [[2602.21591]] CADC: Content Adaptive Diffusion-Based Generative Image Compression(https://arxiv.org/abs/2602.21591)
• Keywords: generative
• Abstract: Diffusion-based generative image compression has demonstrated remarkable potential for achieving realistic reconstruction at ultra-low bitrates. The key to unlocking this potential lies in making the entire compression process content-adaptive, ensuring that the encoder's representation and the decoder's generative prior are dynamically aligned with the semantic and structural characteristics of the input image. However, existing methods suffer from three critical limitations that prevent effective content adaptation. First, isotropic quantization applies a uniform quantization step, failing to adapt to the spatially varying complexity of image content and creating a misalignment with the diffusion model's noise-dependent prior. Second, the information concentration bottleneck -- arising from the dimensional mismatch between the high-dimensional noisy latent and the diffusion decoder's fixed input -- prevents the model from adaptively preserving essential semantic information in the primary channels. Third, existing textual conditioning strategies either need significant textual bitrate overhead or rely on generic, content-agnostic textual prompts, thereby failing to provide adaptive semantic guidance efficiently. To overcome these limitations, we propose a content-adaptive diffusion-based image codec with three technical innovations: 1) an Uncertainty-Guided Adaptive Quantization method that learns spatial uncertainty maps to adaptively align quantization distortion with content characteristics; 2) an Auxiliary Decoder-Guided Information Concentration method that uses a lightweight auxiliary decoder to enforce content-aware information preservation in the primary latent channels; and 3) a Bitrate-Free Adaptive Textual Conditioning method that derives content-aware textual descriptions from the auxiliary reconstructed image, enabling semantic guidance without bitrate cost.
• 摘要：基于扩散的生成图像压缩已显示出以超低比特率实现真实重建的巨大潜力。释放这一潜力的关键在于使整个压缩过程内容自适应，确保编码器的表示和解码器的生成先验与输入图像的语义和结构特征动态对齐。然而，现有方法存在三个严重限制，阻碍了有效的内容适应。首先，各向同性量化应用统一的量化步骤，无法适应图像内容的空间变化复杂性，并与扩散模型的噪声相关先验产生偏差。其次，信息集中瓶颈——由高维噪声潜伏和扩散解码器的固定输入之间的维度不匹配引起——阻止模型自适应地保留主要通道中的基本语义信息。第三，现有的文本调节策略要么需要大量的文本比特率开销，要么依赖通用的、与内容无关的文本提示，从而无法有效地提供自适应语义指导。为了克服这些限制，我们提出了一种基于内容自适应扩散的图像编解码器，具有三项技术创新：1）不确定性引导自适应量化方法，该方法学习空间不确定性图，以自适应地将量化失真与内容特征对齐； 2) 辅助解码器引导信息集中方法，使用轻量级辅助解码器在主要潜在通道中强制保存内容感知信息； 3）无比特率自适应文本调节方法，从辅助重建图像中导出内容感知文本描述，从而无需比特率成本即可实现语义指导。

Title: Breaking Semantic-Aware Watermarks via LLM-Guided Coherence-Preserving Semantic Injection

• Authors: Zheng Gao, Xiaoyu Li, Zhicheng Bao, Xiaoyan Feng, Jiaojiao Jiang
• Subjects: cs.LG, cs.CR, cs.CV
• Abstract URL: https://arxiv.org/abs/2602.21593
• Pdf URL: https://arxiv.org/pdf/2602.21593
• Copy Paste: [[2602.21593]] Breaking Semantic-Aware Watermarks via LLM-Guided Coherence-Preserving Semantic Injection(https://arxiv.org/abs/2602.21593)
• Keywords: generative
• Abstract: Generative images have proliferated on Web platforms in social media and online copyright distribution scenarios, and semantic watermarking has increasingly been integrated into diffusion models to support reliable provenance tracking and forgery prevention for web content. Traditional noise-layer-based watermarking, however, remains vulnerable to inversion attacks that can recover embedded signals. To mitigate this, recent content-aware semantic watermarking schemes bind watermark signals to high-level image semantics, constraining local edits that would otherwise disrupt global coherence. Yet, large language models (LLMs) possess structured reasoning capabilities that enable targeted exploration of semantic spaces, allowing locally fine-grained but globally coherent semantic alterations that invalidate such bindings. To expose this overlooked vulnerability, we introduce a Coherence-Preserving Semantic Injection (CSI) attack that leverages LLM-guided semantic manipulation under embedding-space similarity constraints. This alignment enforces visual-semantic consistency while selectively perturbing watermark-relevant semantics, ultimately inducing detector misclassification. Extensive empirical results show that CSI consistently outperforms prevailing attack baselines against content-aware semantic watermarking, revealing a fundamental security weakness of current semantic watermark designs when confronted with LLM-driven semantic perturbations.
• 摘要：生成图像在社交媒体和在线版权分发场景的网络平台上激增，语义水印越来越多地集成到传播模型中，以支持网络内容的可靠来源跟踪和防伪造。然而，传统的基于噪声层的水印仍然容易受到可以恢复嵌入信号的反转攻击。为了缓解这个问题，最近的内容感知语义水印方案将水印信号绑定到高级图像语义，限制本地编辑，否则会破坏全局一致性。然而，大型语言模型（LLM）拥有结构化推理功能，可以有针对性地探索语义空间，允许局部细粒度但全局连贯的语义更改，从而使此类绑定无效。为了暴露这个被忽视的漏洞，我们引入了一种保持连贯语义注入（CSI）攻击，该攻击在嵌入空间相似性约束下利用 LLM 引导的语义操作。这种对齐增强了视觉语义的一致性，同时选择性地扰乱与水印相关的语义，最终导致检测器错误分类。大量的实证结果表明，针对内容感知语义水印，CSI 始终优于主流的攻击基线，揭示了当前语义水印设计在面对 LLM 驱动的语义扰动时的基本安全弱点。

Title: A Hidden Semantic Bottleneck in Conditional Embeddings of Diffusion Transformers

• Authors: Trung X. Pham, Kang Zhang, Ji Woo Hong, Chang D. Yoo
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.21596
• Pdf URL: https://arxiv.org/pdf/2602.21596
• Copy Paste: [[2602.21596]] A Hidden Semantic Bottleneck in Conditional Embeddings of Diffusion Transformers(https://arxiv.org/abs/2602.21596)
• Keywords: generation
• Abstract: Diffusion Transformers have achieved state-of-the-art performance in class-conditional and multimodal generation, yet the structure of their learned conditional embeddings remains poorly understood. In this work, we present the first systematic study of these embeddings and uncover a notable redundancy: class-conditioned embeddings exhibit extreme angular similarity, exceeding 99\% on ImageNet-1K, while continuous-condition tasks such as pose-guided image generation and video-to-audio generation reach over 99.9\%. We further find that semantic information is concentrated in a small subset of dimensions, with head dimensions carrying the dominant signal and tail dimensions contributing minimally. By pruning low-magnitude dimensions--removing up to two-thirds of the embedding space--we show that generation quality and fidelity remain largely unaffected, and in some cases improve. These results reveal a semantic bottleneck in Transformer-based diffusion models, providing new insights into how semantics are encoded and suggesting opportunities for more efficient conditioning mechanisms.
• 摘要：扩散变压器在类条件和多模态生成方面取得了最先进的性能，但其学习的条件嵌入的结构仍然知之甚少。在这项工作中，我们首次对这些嵌入进行系统研究，并发现了一个显着的冗余：类条件嵌入表现出极大的角度相似性，在 ImageNet-1K 上超过 99%，而连续条件任务（例如姿势引导图像生成和视频到音频生成）达到超过 99.9%。我们进一步发现语义信息集中在一小部分维度中，头部维度携带主导信号，尾部维度贡献最小。通过修剪低量级维度（删除多达三分之二的嵌入空间），我们表明生成质量和保真度基本上不受影响，并且在某些情况下有所改善。这些结果揭示了基于 Transformer 的扩散模型中的语义瓶颈，为语义编码方式提供了新的见解，并为更有效的调节机制提供了机会。

Title: Deep Clustering based Boundary-Decoder Net for Inter and Intra Layer Stress Prediction of Heterogeneous Integrated IC Chip

• Authors: Kart Leong Lim, Ji Lin
• Subjects: cs.LG, cs.CE
• Abstract URL: https://arxiv.org/abs/2602.21601
• Pdf URL: https://arxiv.org/pdf/2602.21601
• Copy Paste: [[2602.21601]] Deep Clustering based Boundary-Decoder Net for Inter and Intra Layer Stress Prediction of Heterogeneous Integrated IC Chip(https://arxiv.org/abs/2602.21601)
• Keywords: generative
• Abstract: High stress occurs when 3D heterogeneous IC packages are subjected to thermal cycling at extreme temperatures. Stress mainly occurs at the interface between different materials. We investigate stress image using latent space representation which is based on using deep generative model (DGM). However, most DGM approaches are unsupervised, meaning they resort to image pairing (input and output) to train DGM. Instead, we rely on a recent boundary-decoder (BD) net, which uses boundary condition and image pairing for stress modeling. The boundary net maps material parameters to the latent space co-shared by its image counterpart. Because such a setup is dimensionally wise ill-posed, we further couple BD net with deep clustering. To access the performance of our proposed method, we simulate an IC chip dataset comprising of 1825 stress images. We compare our new approach using variants of BD net as well as a baseline approach. We show that our approach is able to outperform all the comparison in terms of train and test error reduction.
• 摘要：当 3D 异构 IC 封装在极端温度下经受热循环时，会产生高应力。应力主要发生在不同材料之间的界面处。我们使用基于深度生成模型（DGM）的潜在空间表示来研究压力图像。然而，大多数 DGM 方法都是无监督的，这意味着它们依靠图像配对（输入和输出）来训练 DGM。相反，我们依赖于最近的边界解码器（BD）网络，它使用边界条件和图像配对进行应力建模。边界网将材质参数映射到与其图像对应物共同共享的潜在空间。因为这样的设置在维度上是不适定的，所以我们进一步将 BD 网络与深度聚类结合起来。为了评估我们提出的方法的性能，我们模拟了包含 1825 个应力图像的 IC 芯片数据集。我们使用 BD 网络的变体以及基线方法来比较我们的新方法。我们表明，我们的方法在减少训练和测试错误方面能够胜过所有比较。

Title: UniHand: A Unified Model for Diverse Controlled 4D Hand Motion Modeling

• Authors: Zhihao Sun, Tong Wu, Ruirui Tu, Daoguo Dong, Zuxuan Wu
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.21631
• Pdf URL: https://arxiv.org/pdf/2602.21631
• Copy Paste: [[2602.21631]] UniHand: A Unified Model for Diverse Controlled 4D Hand Motion Modeling(https://arxiv.org/abs/2602.21631)
• Keywords: generation, generative
• Abstract: Hand motion plays a central role in human interaction, yet modeling realistic 4D hand motion (i.e., 3D hand pose sequences over time) remains challenging. Research in this area is typically divided into two tasks: (1) Estimation approaches reconstruct precise motion from visual observations, but often fail under hand occlusion or absence; (2) Generation approaches focus on synthesizing hand poses by exploiting generative priors under multi-modal structured inputs and infilling motion from incomplete sequences. However, this separation not only limits the effective use of heterogeneous condition signals that frequently arise in practice, but also prevents knowledge transfer between the two tasks. We present UniHand, a unified diffusion-based framework that formulates both estimation and generation as conditional motion synthesis. UniHand integrates heterogeneous inputs by embedding structured signals into a shared latent space through a joint variational autoencoder, which aligns conditions such as MANO parameters and 2D skeletons. Visual observations are encoded with a frozen vision backbone, while a dedicated hand perceptron extracts hand-specific cues directly from image features, removing the need for complex detection and cropping pipelines. A latent diffusion model then synthesizes consistent motion sequences from these diverse conditions. Extensive experiments across multiple benchmarks demonstrate that UniHand delivers robust and accurate hand motion modeling, maintaining performance under severe occlusions and temporally incomplete inputs.
• 摘要：手部动作在人类交互中发挥着核心作用，但对真实的 4D 手部动作（即随时间变化的 3D 手部姿势序列）进行建模仍然具有挑战性。该领域的研究通常分为两个任务：（1）估计方法从视觉观察中重建精确的运动，但在手遮挡或缺失的情况下常常失败； （2）生成方法侧重于通过利用多模态结构化输入下的生成先验并从不完整序列填充运动来合成手部姿势。然而，这种分离不仅限制了实践中经常出现的异构条件信号的有效使用，而且阻碍了两个任务之间的知识传递。我们提出了 UniHand，一个基于扩散的统一框架，它将估计和生成制定为条件运动合成。 UniHand 通过联合变分自动编码器将结构化信号嵌入到共享潜在空间中，从而集成异构输入，该编码器对齐 MANO 参数和 2D 骨架等条件。视觉观察用冻结的视觉主干进行编码，而专用的手部感知器直接从图像特征中提取手部特定的线索，从而无需复杂的检测和裁剪管道。然后，潜在扩散模型根据这些不同的条件合成一致的运动序列。跨多个基准的大量实验表明，UniHand 可提供强大而准确的手部运动建模，在严重遮挡和暂时不完整的输入下保持性能。

Title: E-comIQ-ZH: A Human-Aligned Dataset and Benchmark for Fine-Grained Evaluation of E-commerce Posters with Chain-of-Thought

• Authors: Meiqi Sun, Mingyu Li, Junxiong Zhu
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.21698
• Pdf URL: https://arxiv.org/pdf/2602.21698
• Copy Paste: [[2602.21698]] E-comIQ-ZH: A Human-Aligned Dataset and Benchmark for Fine-Grained Evaluation of E-commerce Posters with Chain-of-Thought(https://arxiv.org/abs/2602.21698)
• Keywords: generation, generative, quality assessment
• Abstract: Generative AI is widely used to create commercial posters. However, rapid advances in generation have outpaced automated quality assessment. Existing models emphasize generic esthetics or low level distortions and lack the functional criteria required for e-commerce design. It is especially challenging for Chinese content, where complex characters often produce subtle but critical textual artifacts that are overlooked by existing methods. To address this, we introduce E-comIQ-ZH, a framework for evaluating Chinese e-commerce posters. We build the first dataset E-comIQ-18k to feature multi dimensional scores and expert calibrated Chain of Thought (CoT) rationales. Using this dataset, we train E-comIQ-M, a specialized evaluation model that aligns with human expert judgment. Our framework enables E-comIQ-Bench, the first automated and scalable benchmark for the generation of Chinese e-commerce posters. Extensive experiments show our E-comIQ-M aligns more closely with expert standards and enables scalable automated assessment of e-commerce posters. All datasets, models, and evaluation tools will be released to support future research in this this http URL will be available at this https URL.
• 摘要：生成式人工智能被广泛用于制作商业海报。然而，发电技术的快速进步已经超过了自动化质量评估的速度。现有模型强调通用美学或低水平扭曲，缺乏电子商务设计所需的功能标准。这对于中文内容来说尤其具有挑战性，因为复杂的字符通常会产生微妙但关键的文本工件，而现有方法会忽略这些文本工件。为了解决这个问题，我们引入了 E-comIQ-ZH，一个评估中国电子商务海报的框架。我们构建了第一个数据集 E-comIQ-18k，以具有多维度分数和专家校准的思想链 (CoT) 基本原理。使用该数据集，我们训练 E-comIQ-M，这是一种与人类专家判断一致的专业评估模型。我们的框架支持 E-comIQ-Bench，这是第一个用于生成中国电子商务海报的自动化且可扩展的基准。大量实验表明，我们的 E-comIQ-M 更符合专家标准，并且能够对电子商务海报进行可扩展的自动评估。所有数据集、模型和评估工具都将发布，以支持未来的研究。此 http URL 将在此 https URL 上提供。

Title: Structure-to-Image: Zero-Shot Depth Estimation in Colonoscopy via High-Fidelity Sim-to-Real Adaptation

• Authors: Juan Yang, Yuyan Zhang, Han Jia, Bing Hu, Wanzhong Song
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.21740
• Pdf URL: https://arxiv.org/pdf/2602.21740
• Copy Paste: [[2602.21740]] Structure-to-Image: Zero-Shot Depth Estimation in Colonoscopy via High-Fidelity Sim-to-Real Adaptation(https://arxiv.org/abs/2602.21740)
• Keywords: generative
• Abstract: Monocular depth estimation (MDE) for colonoscopy is hampered by the domain gap between simulated and real-world images. Existing image-to-image translation methods, which use depth as a posterior constraint, often produce structural distortions and specular highlights by failing to balance realism with structure consistency. To address this, we propose a Structure-to-Image paradigm that transforms the depth map from a passive constraint into an active generative foundation. We are the first to introduce phase congruency to colonoscopic domain adaptation and design a cross-level structure constraint to co-optimize geometric structures and fine-grained details like vascular textures. In zero-shot evaluations conducted on a publicly available phantom dataset, the MDE model that was fine-tuned on our generated data achieved a maximum reduction of 44.18% in RMSE compared to competing methods. Our code is available at this https URL.
• 摘要：结肠镜检查的单目深度估计 (MDE) 受到模拟图像和真实图像之间的域差距的阻碍。现有的图像到图像转换方法使用深度作为后验约束，通常由于无法平衡真实性和结构一致性而产生结构扭曲和镜面高光。为了解决这个问题，我们提出了一种结构到图像范例，将深度图从被动约束转变为主动生成基础。我们是第一个将相位一致性引入结肠镜域适应并设计跨级结构约束来共同优化几何结构和血管纹理等细粒度细节的人。在对公开可用的虚拟数据集进行的零样本评估中，根据我们生成的数据进行微调的 MDE 模型与竞争方法相比，RMSE 最大降低了 44.18%。我们的代码可以在这个 https URL 上找到。

Title: Accelerating Diffusion via Hybrid Data-Pipeline Parallelism Based on Conditional Guidance Scheduling

• Authors: Euisoo Jung, Byunghyun Kim, Hyunjin Kim, Seonghye Cho, Jae-Gil Lee
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.21760
• Pdf URL: https://arxiv.org/pdf/2602.21760
• Copy Paste: [[2602.21760]] Accelerating Diffusion via Hybrid Data-Pipeline Parallelism Based on Conditional Guidance Scheduling(https://arxiv.org/abs/2602.21760)
• Keywords: generation
• Abstract: Diffusion models have achieved remarkable progress in high-fidelity image, video, and audio generation, yet inference remains computationally expensive. Nevertheless, current diffusion acceleration methods based on distributed parallelism suffer from noticeable generation artifacts and fail to achieve substantial acceleration proportional to the number of GPUs. Therefore, we propose a hybrid parallelism framework that combines a novel data parallel strategy, condition-based partitioning, with an optimal pipeline scheduling method, adaptive parallelism switching, to reduce generation latency and achieve high generation quality in conditional diffusion models. The key ideas are to (i) leverage the conditional and unconditional denoising paths as a new data-partitioning perspective and (ii) adaptively enable optimal pipeline parallelism according to the denoising discrepancy between these two paths. Our framework achieves $2.31\times$ and $2.07\times$ latency reductions on SDXL and SD3, respectively, using two NVIDIA RTX~3090 GPUs, while preserving image quality. This result confirms the generality of our approach across U-Net-based diffusion models and DiT-based flow-matching architectures. Our approach also outperforms existing methods in acceleration under high-resolution synthesis settings. Code is available at this https URL.
• 摘要：扩散模型在高保真图像、视频和音频生成方面取得了显着进展，但推理的计算成本仍然很高。然而，当前基于分布式并行的扩散加速方法存在明显的生成伪影，并且无法实现与 GPU 数量成比例的实质性加速。因此，我们提出了一种混合并行框架，将新颖的数据并行策略（基于条件的分区）与最佳流水线调度方法（自适应并行切换）相结合，以减少生成延迟并在条件扩散模型中实现高生成质量。关键思想是（i）利用条件和无条件去噪路径作为新的数据分区视角，以及（ii）根据这两条路径之间的去噪差异自适应地启用最佳管道并行性。我们的框架使用两个 NVIDIA RTX~3090 GPU，在 SDXL 和 SD3 上分别实现了 2.31\times$ 和 2.07\times$ 延迟减少，同时保持图像质量。这一结果证实了我们的方法在基于 U-Net 的扩散模型和基于 DiT 的流匹配架构中的通用性。我们的方法在高分辨率合成设置下的加速方面也优于现有方法。代码可从此 https URL 获取。

Title: SAPNet++: Evolving Point-Prompted Instance Segmentation with Semantic and Spatial Awareness

• Authors: Zhaoyang Wei, Xumeng Han, Xuehui Yu, Xue Yang, Guorong Li, Zhenjun Han, Jianbin Jiao
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.21762
• Pdf URL: https://arxiv.org/pdf/2602.21762
• Copy Paste: [[2602.21762]] SAPNet++: Evolving Point-Prompted Instance Segmentation with Semantic and Spatial Awareness(https://arxiv.org/abs/2602.21762)
• Keywords: generation
• Abstract: Single-point annotation is increasingly prominent in visual tasks for labeling cost reduction. However, it challenges tasks requiring high precision, such as the point-prompted instance segmentation (PPIS) task, which aims to estimate precise masks using single-point prompts to train a segmentation network. Due to the constraints of point annotations, granularity ambiguity and boundary uncertainty arise the difficulty distinguishing between different levels of detail (eg. whole object vs. parts) and the challenge of precisely delineating object boundaries. Previous works have usually inherited the paradigm of mask generation along with proposal selection to achieve PPIS. However, proposal selection relies solely on category information, failing to resolve the ambiguity of different granularity. Furthermore, mask generators offer only finite discrete solutions that often deviate from actual masks, particularly at boundaries. To address these issues, we propose the Semantic-Aware Point-Prompted Instance Segmentation Network (SAPNet). It integrates Point Distance Guidance and Box Mining Strategy to tackle group and local issues caused by the point's granularity ambiguity. Additionally, we incorporate completeness scores within proposals to add spatial granularity awareness, enhancing multiple instance learning (MIL) in proposal selection termed S-MIL. The Multi-level Affinity Refinement conveys pixel and semantic clues, narrowing boundary uncertainty during mask refinement. These modules culminate in SAPNet++, mitigating point prompt's granularity ambiguity and boundary uncertainty and significantly improving segmentation performance. Extensive experiments on four challenging datasets validate the effectiveness of our methods, highlighting the potential to advance PPIS.
• 摘要：单点注释在降低标记成本的视觉任务中越来越重要。然而，它对需要高精度的任务提出了挑战，例如点提示实例分割（PPIS）任务，该任务旨在使用单点提示来估计精确的掩模来训练分割网络。由于点注释的限制，粒度模糊性和边界不确定性导致区分不同细节级别（例如整个对象与部分）的困难以及精确描绘对象边界的挑战。以前的工作通常继承了掩模生成和提案选择的范例来实现 PPIS。然而，提案选择仅依赖类别信息，无法解决不同粒度的模糊性。此外，掩模生成器仅提供有限的离散解决方案，这些解决方案通常偏离实际掩模，特别是在边界处。为了解决这些问题，我们提出了语义感知点提示实例分割网络（SAPNet）。它集成了点距离引导和盒子挖掘策略，以解决由点的粒度模糊引起的群体和局部问题。此外，我们将完整性分数纳入提案中，以添加空间粒度意识，增强提案选择中的多实例学习（MIL），称为 S-MIL。多级亲和细化传达像素和语义线索，缩小掩模细化过程中的边界不确定性。这些模块在 SAPNet++ 中达到顶峰，减轻了点提示的粒度模糊性和边界不确定性，并显着提高了分段性能。对四个具有挑战性的数据集进行的广泛实验验证了我们方法的有效性，凸显了推进 PPIS 的潜力。

Title: SkyReels-V4: Multi-modal Video-Audio Generation, Inpainting and Editing model

• Authors: Guibin Chen, Dixuan Lin, Jiangping Yang, Youqiang Zhang, Zhengcong Fei, Debang Li, Sheng Chen, Chaofeng Ao, Nuo Pang, Yiming Wang, Yikun Dou, Zheng Chen, Mingyuan Fan, Tuanhui Li, Mingshan Chang, Hao Zhang, Xiaopeng Sun, Jingtao Xu, Yuqiang Xie, Jiahua Wang, Zhiheng Xu, Weiming Xiong, Yuzhe Jin, Baoxuan Gu, Binjie Mao, Yunjie Yu, Jujie He, Yuhao Feng, Shiwen Tu, Chaojie Wang, Rui Yan, Wei Shen, Jingchen Wu, Peng Zhao, Xuanyue Zhong, Zhuangzhuang Liu, Kaifei Wang, Fuxiang Zhang, Weikai Xu, Wenyan Liu, Binglu Zhang, Yu Shen, Tianhui Xiong, Bin Peng, Liang Zeng, Xuchen Song, Haoxiang Guo, Peiyu Wang, Yahui Zhou
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.21818
• Pdf URL: https://arxiv.org/pdf/2602.21818
• Copy Paste: [[2602.21818]] SkyReels-V4: Multi-modal Video-Audio Generation, Inpainting and Editing model(https://arxiv.org/abs/2602.21818)
• Keywords: super-resolution, generation
• Abstract: SkyReels V4 is a unified multi modal video foundation model for joint video audio generation, inpainting, and editing. The model adopts a dual stream Multimodal Diffusion Transformer (MMDiT) architecture, where one branch synthesizes video and the other generates temporally aligned audio, while sharing a powerful text encoder based on the Multimodal Large Language Models (MMLM). SkyReels V4 accepts rich multi modal instructions, including text, images, video clips, masks, and audio references. By combining the MMLMs multi modal instruction following capability with in context learning in the video branch MMDiT, the model can inject fine grained visual guidance under complex conditioning, while the audio branch MMDiT simultaneously leverages audio references to guide sound generation. On the video side, we adopt a channel concatenation formulation that unifies a wide range of inpainting style tasks, such as image to video, video extension, and video editing under a single interface, and naturally extends to vision referenced inpainting and editing via multi modal prompts. SkyReels V4 supports up to 1080p resolution, 32 FPS, and 15 second duration, enabling high fidelity, multi shot, cinema level video generation with synchronized audio. To make such high resolution, long-duration generation computationally feasible, we introduce an efficiency strategy: Joint generation of low resolution full sequences and high-resolution keyframes, followed by dedicated super-resolution and frame interpolation models. To our knowledge, SkyReels V4 is the first video foundation model that simultaneously supports multi-modal input, joint video audio generation, and a unified treatment of generation, inpainting, and editing, while maintaining strong efficiency and quality at cinematic resolutions and durations.
• 摘要：SkyReels V4 是一个统一的多模态视频基础模型，用于联合视频音频生成、修复和编辑。该模型采用双流多模态扩散变压器（MMDiT）架构，其中一个分支合成视频，另一个分支生成时间对齐的音频，同时共享基于多模态大语言模型（MMLM）的强大文本编码器。 SkyReels V4 接受丰富的多模式指令，包括文本、图像、视频剪辑、蒙版和音频参考。通过将 MMLM 多模态指令跟随功能与视频分支 MMDiT 中的上下文学习相结合，该模型可以在复杂条件下注入细粒度的视觉指导，而音频分支 MMDiT 同时利用音频参考来指导声音生成。在视频方面，我们采用通道串联公式，将图像到视频、视频扩展和视频编辑等多种修复风格任务统一在一个界面下，并通过多模式提示自然扩展到视觉参考修复和编辑。 SkyReels V4 支持高达 1080p 的分辨率、32 FPS 和 15 秒的持续时间，可生成具有同步音频的高保真、多镜头、影院级视频。为了使这种高分辨率、长时间的生成在计算上可行，我们引入了一种效率策略：联合生成低分辨率全序列和高分辨率关键帧，然后是专用的超分辨率和帧插值模型。据我们所知，SkyReels V4是第一个同时支持多模态输入、联合视频音频生成以及生成、修复和编辑统一处理的视频基础模型，同时在电影分辨率和时长上保持强大的效率和质量。

Title: Joint Shadow Generation and Relighting via Light-Geometry Interaction Maps

• Authors: Shan Wang, Peixia Li, Chenchen Xu, Ziang Cheng, Jiayu Yang, Hongdong Li, Pulak Purkait
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.21820
• Pdf URL: https://arxiv.org/pdf/2602.21820
• Copy Paste: [[2602.21820]] Joint Shadow Generation and Relighting via Light-Geometry Interaction Maps(https://arxiv.org/abs/2602.21820)
• Keywords: generation, generative
• Abstract: We propose Light-Geometry Interaction (LGI) maps, a novel representation that encodes light-aware occlusion from monocular depth. Unlike ray tracing, which requires full 3D reconstruction, LGI captures essential light-shadow interactions reliably and accurately, computed from off-the-shelf 2.5D depth map predictions. LGI explicitly ties illumination direction to geometry, providing a physics-inspired prior that constrains generative models. Without such prior, these models often produce floating shadows, inconsistent illumination, and implausible shadow geometry. Building on this representation, we propose a unified pipeline for joint shadow generation and relighting - unlike prior methods that treat them as disjoint tasks - capturing the intrinsic coupling of illumination and shadowing essential for modeling indirect effects. By embedding LGI into a bridge-matching generative backbone, we reduce ambiguity and enforce physically consistent light-shadow reasoning. To enable effective training, we curated the first large-scale benchmark dataset for joint shadow and relighting, covering reflections, transparency, and complex interreflections. Experiments show significant gains in realism and consistency across synthetic and real images. LGI thus bridges geometry-inspired rendering with generative modeling, enabling efficient, physically consistent shadow generation and relighting.
• 摘要：我们提出了光几何交互（LGI）图，这是一种从单眼深度编码光感知遮挡的新颖表示。与需要完整 3D 重建的光线追踪不同，LGI 能够可靠、准确地捕获基本的光影交互，并根据现成的 2.5D 深度图预测进行计算。 LGI 明确地将照明方向与几何形状联系起来，提供了一个受物理启发的先验来约束生成模型。如果没有这样的先验，这些模型通常会产生浮动阴影、不一致的照明和不可信的阴影几何形状。在此表示的基础上，我们提出了一个用于联合阴影生成和重新照明的统一管道（与将它们视为不相交任务的先前方法不同），捕获对于建模间接效果至关重要的照明和阴影的内在耦合。通过将 LGI 嵌入到桥匹配生成主干中，我们减少了歧义并强制执行物理上一致的光影推理。为了实现有效的训练，我们策划了第一个用于联合阴影和重新照明的大型基准数据集，涵盖反射、透明度和复杂的相互反射。实验表明，合成图像和真实图像的真实性和一致性有了显着提高。因此，LGI 将几何启发的渲染与生成建模联系起来，实现高效、物理一致的阴影生成和重新照明。

Title: DocDjinn: Controllable Synthetic Document Generation with VLMs and Handwriting Diffusion

• Authors: Marcel Lamott, Saifullah Saifullah, Nauman Riaz, Yves-Noel Weweler, Tobias Alt-Veit, Ahmad Sarmad Ali, Muhammad Armaghan Shakir, Adrian Kalwa, Momina Moetesum, Andreas Dengel, Sheraz Ahmed, Faisal Shafait, Ulrich Schwanecke, Adrian Ulges
• Subjects: cs.LG
• Abstract URL: https://arxiv.org/abs/2602.21824
• Pdf URL: https://arxiv.org/pdf/2602.21824
• Copy Paste: [[2602.21824]] DocDjinn: Controllable Synthetic Document Generation with VLMs and Handwriting Diffusion(https://arxiv.org/abs/2602.21824)
• Keywords: generation
• Abstract: Effective document intelligence models rely on large amounts of annotated training data. However, procuring sufficient and high-quality data poses significant challenges due to the labor-intensive and costly nature of data acquisition. Additionally, leveraging language models to annotate real documents raises concerns about data privacy. Synthetic document generation has emerged as a promising, privacy-preserving alternative. We propose DocDjinn, a novel framework for controllable synthetic document generation using Vision-Language Models (VLMs) that produces annotated documents from unlabeled seed samples. Our approach generates visually plausible and semantically consistent synthetic documents that follow the distribution of an existing source dataset through clustering-based seed selection with parametrized sampling. By enriching documents with realistic diffusion-based handwriting and contextual visual elements via semantic-visual decoupling, we generate diverse, high-quality annotated synthetic documents. We evaluate across eleven benchmarks spanning key information extraction, question answering, document classification, and document layout analysis. To our knowledge, this is the first work demonstrating that VLMs can generate faithful annotated document datasets at scale from unlabeled seeds that can effectively enrich or approximate real, manually annotated data for diverse document understanding tasks. We show that with only 100 real training samples, our framework achieves on average $87\%$ of the performance of the full real-world dataset. We publicly release our code and 140k+ synthetic document samples.
• 摘要：有效的文档智能模型依赖于大量带注释的训练数据。然而，由于数据采集的劳动密集型和成本高昂的性质，获取足够和高质量的数据带来了重大挑战。此外，利用语言模型来注释真实文档会引起对数据隐私的担忧。合成文档生成已成为一种有前景的隐私保护替代方案。我们提出了 DocDjinn，这是一种使用视觉语言模型（VLM）进行可控合成文档生成的新颖框架，可从未标记的种子样本中生成带注释的文档。我们的方法生成视觉上合理且语义一致的合成文档，这些文档通过基于聚类的种子选择和参数化采样来遵循现有源数据集的分布。通过语义视觉解耦，使用基于扩散的真实手写和上下文视觉元素来丰富文档，我们生成了多样化的、高质量的带注释的合成文档。我们评估了十一个基准，涵盖关键信息提取、问题回答、文档分类和文档布局分析。据我们所知，这是第一个证明 VLM 可以从未标记的种子中大规模生成忠实注释文档数据集的工作，这些数据集可以有效地丰富或近似真实的手动注释数据，以用于不同的文档理解任务。我们表明，仅使用 100 个真实训练样本，我们的框架就能平均达到完整真实数据集性能的 87\%$。我们公开发布我们的代码和 140k+ 合成文档样本。

Title: UniVBench: Towards Unified Evaluation for Video Foundation Models

• Authors: Jianhui Wei, Xiaotian Zhang, Yichen Li, Yuan Wang, Yan Zhang, Ziyi Chen, Zhihang Tang, Wei Xu, Zuozhu Liu
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.21835
• Pdf URL: https://arxiv.org/pdf/2602.21835
• Copy Paste: [[2602.21835]] UniVBench: Towards Unified Evaluation for Video Foundation Models(https://arxiv.org/abs/2602.21835)
• Keywords: generation
• Abstract: Video foundation models aim to integrate video understanding, generation, editing, and instruction following within a single framework, making them a central direction for next-generation multimodal systems. However, existing evaluation benchmarks remain fragmented and limited in scope, as they each target a single task, rely on task-specific metrics, and typically use short or simple video clips. As a result, they do not capture the unified capabilities that these models are designed to deliver. To address this gap, we introduce UniVBench, a benchmark purpose-built for evaluating video foundation models across four core abilities: video understanding, video generation, video editing, and a newly proposed task, video reconstruction, which assesses how faithfully a model can reproduce video content it has encountered. Our benchmark substantially expands the complexity of evaluation by incorporating 200 high-quality, diverse and multi-shot videos, each paired with detailed captions, multi-format editing instructions, and reference images. All videos are human-created and carefully validated, offering richer cinematic information than prior benchmarks. In addition, we develop a unified agentic evaluation system (UniV-Eval) that standardizes prompting, instruction parsing, and scoring across all tasks, enabling fair, scalable, and reproducible comparisons of unified video models. By grounding evaluation in instruction-based multi-shot video tasks, UniVBench provides the first framework for measuring the integrated capabilities that video foundation models aim to achieve. Extensive human annotations ensure our evaluation aligns with human judgment, enabling rigorous assessment and accelerating progress toward robust video intelligence.
• 摘要：视频基础模型旨在将视频理解、生成、编辑和指令跟踪集成在一个框架内，使其成为下一代多模态系统的中心方向。然而，现有的评估基准仍然分散且范围有限，因为它们每个都针对单个任务，依赖于特定于任务的指标，并且通常使用短或简单的视频剪辑。因此，它们无法捕获这些模型旨在提供的统一功能。为了解决这一差距，我们引入了 UniVBench，这是一个专门为评估视频基础模型的四个核心能力而构建的基准：视频理解、视频生成、视频编辑，以及新提出的任务视频重建，该任务评估模型如何忠实地再现其遇到的视频内容。我们的基准测试通过纳入 200 个高质量、多样化的多镜头视频，每个视频都配有详细的标题、多格式编辑说明和参考图像，极大地扩展了评估的复杂性。所有视频均由人工创作并经过仔细验证，提供比之前的基准更丰富的电影信息。此外，我们开发了一个统一的代理评估系统（UniV-Eval），该系统标准化了所有任务的提示、指令解析和评分，从而实现了统一视频模型的公平、可扩展和可重复的比较。通过在基于指令的多镜头视频任务中进行基础评估，UniVBench 提供了第一个用于测量视频基础模型旨在实现的集成功能的框架。广泛的人工注释确保我们的评估与人类判断一致，从而实现严格的评估并加速实现强大的视频智能。

Title: GFPL: Generative Federated Prototype Learning for Resource-Constrained and Data-Imbalanced Vision Task

• Authors: Shiwei Lu, Yuhang He, Jiashuo Li, Qiang Wang, Yihong Gong
• Subjects: cs.CV, cs.LG
• Abstract URL: https://arxiv.org/abs/2602.21873
• Pdf URL: https://arxiv.org/pdf/2602.21873
• Copy Paste: [[2602.21873]] GFPL: Generative Federated Prototype Learning for Resource-Constrained and Data-Imbalanced Vision Task(https://arxiv.org/abs/2602.21873)
• Keywords: generation, generative
• Abstract: Federated learning (FL) facilitates the secure utilization of decentralized images, advancing applications in medical image recognition and autonomous driving. However, conventional FL faces two critical challenges in real-world deployment: ineffective knowledge fusion caused by model updates biased toward majority-class features, and prohibitive communication overhead due to frequent transmissions of high-dimensional model parameters. Inspired by the human brain's efficiency in knowledge integration, we propose a novel Generative Federated Prototype Learning (GFPL) framework to address these issues. Within this framework, a prototype generation method based on Gaussian Mixture Model (GMM) captures the statistical information of class-wise features, while a prototype aggregation strategy using Bhattacharyya distance effectively fuses semantically similar knowledge across clients. In addition, these fused prototypes are leveraged to generate pseudo-features, thereby mitigating feature distribution imbalance across clients. To further enhance feature alignment during local training, we devise a dual-classifier architecture, optimized via a hybrid loss combining Dot Regression and Cross-Entropy. Extensive experiments on benchmarks show that GFPL improves model accuracy by 3.6% under imbalanced data settings while maintaining low communication cost.
• 摘要：联邦学习（FL）促进了去中心化图像的安全利用，推进了医学图像识别和自动驾驶方面的应用。然而，传统的 FL 在实际部署中面临两个关键挑战：模型更新偏向多数类特征导致的知识融合无效，以及高维模型参数的频繁传输导致的高昂的通信开销。受人脑知识整合效率的启发，我们提出了一种新颖的生成联合原型学习（GFPL）框架来解决这些问题。在此框架内，基于高斯混合模型（GMM）的原型生成方法捕获类特征的统计信息，而使用巴塔查亚距离的原型聚合策略有效地融合了客户端之间语义相似的知识。此外，这些融合原型被用来生成伪特征，从而减轻客户端之间的特征分布不平衡。为了进一步增强本地训练期间的特征对齐，我们设计了一种双分类器架构，通过结合点回归和交叉熵的混合损失进行优化。大量的基准实验表明，在不平衡数据设置下，GFPL 将模型精度提高了 3.6%，同时保持了较低的通信成本。

Title: How to Take a Memorable Picture? Empowering Users with Actionable Feedback

• Authors: Francesco Laiti, Davide Talon, Jacopo Staiano, Elisa Ricci
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.21877
• Pdf URL: https://arxiv.org/pdf/2602.21877
• Copy Paste: [[2602.21877]] How to Take a Memorable Picture? Empowering Users with Actionable Feedback(https://arxiv.org/abs/2602.21877)
• Keywords: generative
• Abstract: Image memorability, i.e., how likely an image is to be remembered, has traditionally been studied in computer vision either as a passive prediction task, with models regressing a scalar score, or with generative methods altering the visual input to boost the image likelihood of being remembered. Yet, none of these paradigms supports users at capture time, when the crucial question is how to improve a photo memorability. We introduce the task of Memorability Feedback (MemFeed), where an automated model should provide actionable, human-interpretable guidance to users with the goal to enhance an image future recall. We also present MemCoach, the first approach designed to provide concrete suggestions in natural language for memorability improvement (e.g., "emphasize facial expression," "bring the subject forward"). Our method, based on Multimodal Large Language Models (MLLMs), is training-free and employs a teacher-student steering strategy, aligning the model internal activations toward more memorable patterns learned from a teacher model progressing along least-to-most memorable samples. To enable systematic evaluation on this novel task, we further introduce MemBench, a new benchmark featuring sequence-aligned photoshoots with annotated memorability scores. Our experiments, considering multiple MLLMs, demonstrate the effectiveness of MemCoach, showing consistently improved performance over several zero-shot models. The results indicate that memorability can not only be predicted but also taught and instructed, shifting the focus from mere prediction to actionable feedback for human creators.
• 摘要：图像可记忆性，即图像被记住的可能性，传统上在计算机视觉中作为被动预测任务进行研究，模型回归标量分数，或者通过生成方法改变视觉输入以提高图像被记住的可能性。然而，当关键问题是如何提高照片的可记忆性时，这些范例都不支持用户在拍摄时。我们引入了记忆性反馈（MemFeed）任务，其中自动化模型应该为用户提供可操作的、人类可解释的指导，以增强未来的图像回忆。我们还推出了 MemCoach，这是第一个旨在以自然语言提供具体建议以提高记忆力的方法（例如，“强调面部表情”、“将主题向前推进”）。我们的方法基于多模态大语言模型（MLLM），无需训练，并采用师生指导策略，将模型内部激活调整为从教师模型中沿着最不难忘的样本学习到的更难忘的模式。为了能够对这项新颖的任务进行系统评估，我们进一步引入了 MemBench，这是一种新的基准，具有序列对齐的照片和带注释的记忆分数。我们的实验考虑了多个 MLLM，证明了 MemCoach 的有效性，与几个零样本模型相比，性能得到了持续改进。结果表明，记忆力不仅可以预测，还可以教授和指导，从而将焦点从单纯的预测转移到人类创造者可操作的反馈上。

Title: Scan Clusters, Not Pixels: A Cluster-Centric Paradigm for Efficient Ultra-high-definition Image Restoration

• Authors: Chen Wu, Ling Wang, Zhuoran Zheng, Yuning Cui, Zhixiong Yang, Xiangyu Chen, Yue Zhang, Weidong Jiang, Jingyuan Xia
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.21917
• Pdf URL: https://arxiv.org/pdf/2602.21917
• Copy Paste: [[2602.21917]] Scan Clusters, Not Pixels: A Cluster-Centric Paradigm for Efficient Ultra-high-definition Image Restoration(https://arxiv.org/abs/2602.21917)
• Keywords: restoration
• Abstract: Ultra-High-Definition (UHD) image restoration is trapped in a scalability crisis: existing models, bound to pixel-wise operations, demand unsustainable computation. While state space models (SSMs) like Mamba promise linear complexity, their pixel-serial scanning remains a fundamental bottleneck for the millions of pixels in UHD content. We ask: must we process every pixel to understand the image? This paper introduces C$^2$SSM, a visual state space model that breaks this taboo by shifting from pixel-serial to cluster-serial scanning. Our core discovery is that the rich feature distribution of a UHD image can be distilled into a sparse set of semantic centroids via a neural-parameterized mixture model. C$^2$SSM leverages this to reformulate global modeling into a novel dual-path process: it scans and reasons over a handful of cluster centers, then diffuses the global context back to all pixels through a principled similarity distribution, all while a lightweight modulator preserves fine details. This cluster-centric paradigm achieves a decisive leap in efficiency, slashing computational costs while establishing new state-of-the-art results across five UHD restoration tasks. More than a solution, C$^2$SSM charts a new course for efficient large-scale vision: scan clusters, not pixels.
• 摘要：超高清 (UHD) 图像恢复陷入可扩展性危机：现有模型必须进行逐像素操作，需要不可持续的计算。虽然像 Mamba 这样的状态空间模型 (SSM) 保证了线性复杂性，但它们的像素串行扫描仍然是超高清内容中数百万像素的基本瓶颈。我们问：我们必须处理每个像素才能理解图像吗？本文介绍了 C$^2$SSM，这是一种视觉状态空间模型，它通过从像素串行扫描转变为簇串行扫描来打破这一禁忌。我们的核心发现是，超高清图像的丰富特征分布可以通过神经参数化混合模型提炼成一组稀疏的语义质心。 C$^2$SSM 利用这一点将全局建模重新表述为一种新颖的双路径过程：它扫描并推理少数聚类中心，然后通过有原则的相似性分布将全局上下文扩散回所有像素，同时轻量级调制器保留精细细节。这种以集群为中心的范例实现了效率的决定性飞跃，大幅削减了计算成本，同时在五个超高清恢复任务中建立了新的最先进的结果。 C$^2$SSM 不仅仅是一个解决方案，它还为高效的大规模视觉绘制了一条新路线：扫描簇，而不是像素。

Title: Geometry-as-context: Modulating Explicit 3D in Scene-consistent Video Generation to Geometry Context

• Authors: JiaKui Hu, Jialun Liu, Liying Yang, Xinliang Zhang, Kaiwen Li, Shuang Zeng, Yuanwei Li, Haibin Huang, Chi Zhang, Yanye Lu
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.21929
• Pdf URL: https://arxiv.org/pdf/2602.21929
• Copy Paste: [[2602.21929]] Geometry-as-context: Modulating Explicit 3D in Scene-consistent Video Generation to Geometry Context(https://arxiv.org/abs/2602.21929)
• Keywords: generation
• Abstract: Scene-consistent video generation aims to create videos that explore 3D scenes based on a camera trajectory. Previous methods rely on video generation models with external memory for consistency, or iterative 3D reconstruction and inpainting, which accumulate errors during inference due to incorrect intermediary outputs, non-differentiable processes, and separate models. To overcome these limitations, we introduce ``geometry-as-context". It iteratively completes the following steps using an autoregressive camera-controlled video generation model: (1) estimates the geometry of the current view necessary for 3D reconstruction, and (2) simulates and restores novel view images rendered by the 3D scene. Under this multi-task framework, we develop the camera gated attention module to enhance the model's capability to effectively leverage camera poses. During the training phase, text contexts are utilized to ascertain whether geometric or RGB images should be generated. To ensure that the model can generate RGB-only outputs during inference, the geometry context is randomly dropped from the interleaved text-image-geometry training sequence. The method has been tested on scene video generation with one-direction and forth-and-back trajectories. The results show its superiority over previous approaches in maintaining scene consistency and camera control.
• 摘要：场景一致的视频生成旨在创建基于摄像机轨迹探索 3D 场景的视频。以前的方法依赖具有外部存储器的视频生成模型来实现一致性，或者迭代 3D 重建和修复，这会在推理过程中由于不正确的中间输出、不可微分的过程和单独的模型而累积错误。为了克服这些限制，我们引入了“几何即上下文”。它使用自回归相机控制的视频生成模型迭代地完成以下步骤：（1）估计 3D 重建所需的当前视图的几何形状，以及（2）模拟和恢复 3D 场景渲染的新视图图像。在这个多任务框架下，我们开发了相机门控注意力模块，以增强模型有效利用相机姿势的能力。在训练阶段，利用文本上下文为了确定应该生成几何图像还是 RGB 图像，为了确保模型在推理过程中可以生成仅 RGB 的输出，从交错的文本-图像-几何训练序列中随机删除该方法，并在单向和前后轨迹的场景视频生成上进行了测试，结果表明其在保持场景一致性和摄像机控制方面优于以前的方法。

Title: Bayesian Generative Adversarial Networks via Gaussian Approximation for Tabular Data Synthesis

• Authors: Bahrul Ilmi Nasution, Mark Elliot, Richard Allmendinger
• Subjects: cs.LG, stat.ML
• Abstract URL: https://arxiv.org/abs/2602.21948
• Pdf URL: https://arxiv.org/pdf/2602.21948
• Copy Paste: [[2602.21948]] Bayesian Generative Adversarial Networks via Gaussian Approximation for Tabular Data Synthesis(https://arxiv.org/abs/2602.21948)
• Keywords: generative
• Abstract: Generative Adversarial Networks (GAN) have been used in many studies to synthesise mixed tabular data. Conditional tabular GAN (CTGAN) have been the most popular variant but struggle to effectively navigate the risk-utility trade-off. Bayesian GAN have received less attention for tabular data, but have been explored with unstructured data such as images and text. The most used technique employed in Bayesian GAN is Markov Chain Monte Carlo (MCMC), but it is computationally intensive, particularly in terms of weight storage. In this paper, we introduce Gaussian Approximation of CTGAN (GACTGAN), an integration of the Bayesian posterior approximation technique using Stochastic Weight Averaging-Gaussian (SWAG) within the CTGAN generator to synthesise tabular data, reducing computational overhead after the training phase. We demonstrate that GACTGAN yields better synthetic data compared to CTGAN, achieving better preservation of tabular structure and inferential statistics with less privacy risk. These results highlight GACTGAN as a simpler, effective implementation of Bayesian tabular synthesis.
• 摘要：生成对抗网络（GAN）已在许多研究中用于合成混合表格数据。条件表格 GAN (CTGAN) 是最流行的变体，但难以有效地平衡风险与效用。贝叶斯 GAN 在表格数据方面受到的关注较少，但已在图像和文本等非结构化数据上进行了探索。贝叶斯 GAN 中最常用的技术是马尔可夫链蒙特卡罗 (MCMC)，但它的计算量很大，特别是在权重存储方面。在本文中，我们介绍了 CTGAN 的高斯近似（GACTGAN），它是 CTGAN 生成器中使用随机权重平均高斯（SWAG）的贝叶斯后验近似技术的集成，用于合成表格数据，从而减少训练阶段后的计算开销。我们证明，与 CTGAN 相比，GACTGAN 能产生更好的合成数据，更好地保存表格结构和推理统计，同时隐私风险更低。这些结果凸显了 GACTGAN 是贝叶斯表格综合的一种更简单、有效的实现。

Title: RobustVisRAG: Causality-Aware Vision-Based Retrieval-Augmented Generation under Visual Degradations

• Authors: I-Hsiang Chen, Yu-Wei Liu, Tse-Yu Wu, Yu-Chien Chiang, Jen-Chien Yang, Wei-Ting Chen
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.22013
• Pdf URL: https://arxiv.org/pdf/2602.22013
• Copy Paste: [[2602.22013]] RobustVisRAG: Causality-Aware Vision-Based Retrieval-Augmented Generation under Visual Degradations(https://arxiv.org/abs/2602.22013)
• Keywords: generation
• Abstract: Vision-based Retrieval-Augmented Generation (VisRAG) leverages vision-language models (VLMs) to jointly retrieve relevant visual documents and generate grounded answers based on multimodal evidence. However, existing VisRAG models degrade in performance when visual inputs suffer from distortions such as blur, noise, low light, or shadow, where semantic and degradation factors become entangled within pretrained visual encoders, leading to errors in both retrieval and generation stages. To address this limitation, we introduce RobustVisRAG, a causality-guided dual-path framework that improves VisRAG robustness while preserving efficiency and zero-shot generalization. RobustVisRAG uses a non-causal path to capture degradation signals through unidirectional attention and a causal path to learn purified semantics guided by these signals. Together with the proposed Non-Causal Distortion Modeling and Causal Semantic Alignment objectives, the framework enforces a clear separation between semantics and degradations, enabling stable retrieval and generation under challenging visual conditions. To evaluate robustness under realistic conditions, we introduce the Distortion-VisRAG dataset, a large-scale benchmark containing both synthetic and real-world degraded documents across seven domains, with 12 synthetic and 5 real distortion types that comprehensively reflect practical visual degradations. Experimental results show that RobustVisRAG improves retrieval, generation, and end-to-end performance by 7.35%, 6.35%, and 12.40%, respectively, on real-world degradations, while maintaining comparable accuracy on clean inputs.
• 摘要：基于视觉的检索增强生成 (VisRAG) 利用视觉语言模型 (VLM) 联合检索相关视觉文档并根据多模态证据生成有依据的答案。然而，当视觉输入遭受模糊、噪声、低光或阴影等失真时，现有的 VisRAG 模型的性能会下降，其中语义和退化因素会与预训练的视觉编码器纠缠在一起，从而导致检索和生成阶段出现错误。为了解决这个限制，我们引入了 RobustVisRAG，这是一种因果引导的双路径框架，可以提高 VisRAG 的鲁棒性，同时保持效率和零样本泛化。 RobustVisRAG 使用非因果路径通过单向注意力捕获退化信号，并使用因果路径来学习由这些信号引导的纯化语义。与提出的非因果失真建模和因果语义对齐目标一起，该框架强制语义和降级之间的明确分离，从而在具有挑战性的视觉条件下实现稳定的检索和生成。为了评估现实条件下的鲁棒性，我们引入了 Distortion-VisRAG 数据集，这是一个大规模基准，包含七个领域的合成和真实降级文档，其中有 12 种合成失真类型和 5 种真实失真类型，全面反映了实际视觉降级。实验结果表明，RobustVisRAG 将现实世界退化的检索、生成和端到端性能分别提高了 7.35%、6.35% 和 12.40%，同时在干净输入上保持了相当的准确性。

Title: SPGen: Stochastic scanpath generation for paintings using unsupervised domain adaptation

• Authors: Mohamed Amine Kerkouri, Marouane Tliba, Aladine Chetouani, Alessandro Bruno
• Subjects: cs.CV, cs.HC
• Abstract URL: https://arxiv.org/abs/2602.22049
• Pdf URL: https://arxiv.org/pdf/2602.22049
• Copy Paste: [[2602.22049]] SPGen: Stochastic scanpath generation for paintings using unsupervised domain adaptation(https://arxiv.org/abs/2602.22049)
• Keywords: generation
• Abstract: Understanding human visual attention is key to preserving cultural heritage We introduce SPGen a novel deep learning model to predict scanpaths the sequence of eye movementswhen viewers observe paintings. Our architecture uses a Fully Convolutional Neural Network FCNN with differentiable fixation selection and learnable Gaussian priors to simulate natural viewing biases To address the domain gap between photographs and artworks we employ unsupervised domain adaptation via a gradient reversal layer allowing the model to transfer knowledge from natural scenes to paintings Furthermore a random noise sampler models the inherent stochasticity of eyetracking data. Extensive testing shows SPGen outperforms existing methods offering a powerful tool to analyze gaze behavior and advance the preservation and appreciation of artistic treasures.
• 摘要：了解人类视觉注意力是保护文化遗产的关键我们引入了 SPGen 一种新颖的深度学习模型，用于预测观众观察绘画时的扫描路径和眼球运动序列。我们的架构使用具有可微注视选择和可学习高斯先验的全卷积神经网络 FCNN 来模拟自然观看偏差为了解决照片和艺术品之间的域差距，我们通过梯度反转层采用无监督域适应，允许模型将知识从自然场景转移到绘画此外，随机噪声采样器对眼球跟踪数据的固有随机性进行建模。广泛的测试表明 SPGen 优于现有方法，提供了分析凝视行为并促进艺术珍品的保存和欣赏的强大工具。

Title: Brain3D: Brain Report Automation via Inflated Vision Transformers in 3D

• Authors: Mariano Barone, Francesco Di Serio, Giuseppe Riccio, Antonio Romano, Marco Postiglione, Antonino Ferraro, Vincenzo Moscato
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.22098
• Pdf URL: https://arxiv.org/pdf/2602.22098
• Copy Paste: [[2602.22098]] Brain3D: Brain Report Automation via Inflated Vision Transformers in 3D(https://arxiv.org/abs/2602.22098)
• Keywords: generation
• Abstract: Current medical vision-language models (VLMs) process volumetric brain MRI using 2D slice-based approximations, fragmenting the spatial context required for accurate neuroradiological interpretation. We developed \textbf{Brain3D}, a staged vision-language framework for automated radiology report generation from 3D brain tumor MRI. Our approach inflates a pretrained 2D medical encoder into a native 3D architecture and progressively aligns it with a causal language model through three stages: contrastive grounding, supervised projector warmup, and LoRA-based linguistic specialization. Unlike generalist 3D medical VLMs, \textbf{Brain3D} is tailored to neuroradiology, where hemispheric laterality, tumor infiltration patterns, and anatomical localization are critical. Evaluated on 468 subjects (BraTS pathological cases plus healthy controls), our model achieves a Clinical Pathology F1 of 0.951 versus 0.413 for a strong 2D baseline while maintaining perfect specificity on healthy scans. The staged alignment proves essential: contrastive grounding establishes visual-textual correspondence, projector warmup stabilizes conditioning, and LoRA adaptation shifts output from verbose captions to structured clinical reports\footnote{Our code is publicly available for transparency and reproducibility
• 摘要：当前的医学视觉语言模型 (VLM) 使用基于 2D 切片的近似处理体积脑 MRI，分割准确的神经放射学解释所需的空间上下文。我们开发了 \textbf{Brain3D}，这是一个分阶段视觉语言框架，用于根据 3D 脑肿瘤 MRI 自动生成放射学报告。我们的方法将预训练的 2D 医学编码器扩展为原生 3D 架构，并通过三个阶段逐步将其与因果语言模型对齐：对比基础、监督投影仪预热和基于 LoRA 的语言专业化。与通用 3D 医学 VLM 不同，\textbf{Brain3D} 专为神经放射学量身定制，其中半球偏侧性、肿瘤浸润模式和解剖定位至关重要。我们的模型对 468 名受试者（BraTS 病理病例加上健康对照）进行了评估，其临床病理学 F1 为 0.951，而强大的 2D 基线为 0.413，同时保持健康扫描的完美特异性。分阶段的对齐被证明是至关重要的：对比基础建立了视觉文本对应，投影仪预热稳定了调节，LoRA 适应将输出从冗长的标题转移到结构化的临床报告\脚注{我们的代码是公开的，以提高透明度和可重复性

Title: GeoDiv: Framework For Measuring Geographical Diversity In Text-To-Image Models

• Authors: Abhipsa Basu, Mohana Singh, Shashank Agnihotri, Margret Keuper, R. Venkatesh Babu
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.22120
• Pdf URL: https://arxiv.org/pdf/2602.22120
• Copy Paste: [[2602.22120]] GeoDiv: Framework For Measuring Geographical Diversity In Text-To-Image Models(https://arxiv.org/abs/2602.22120)
• Keywords: generative
• Abstract: Text-to-image (T2I) models are rapidly gaining popularity, yet their outputs often lack geographical diversity, reinforce stereotypes, and misrepresent regions. Given their broad reach, it is critical to rigorously evaluate how these models portray the world. Existing diversity metrics either rely on curated datasets or focus on surface-level visual similarity, limiting interpretability. We introduce GeoDiv, a framework leveraging large language and vision-language models to assess geographical diversity along two complementary axes: the Socio-Economic Visual Index (SEVI), capturing economic and condition-related cues, and the Visual Diversity Index (VDI), measuring variation in primary entities and backgrounds. Applied to images generated by models such as Stable Diffusion and FLUX.1-dev across $10$ entities and $16$ countries, GeoDiv reveals a consistent lack of diversity and identifies fine-grained attributes where models default to biased portrayals. Strikingly, depictions of countries like India, Nigeria, and Colombia are disproportionately impoverished and worn, reflecting underlying socio-economic biases. These results highlight the need for greater geographical nuance in generative models. GeoDiv provides the first systematic, interpretable framework for measuring such biases, marking a step toward fairer and more inclusive generative systems. Project page: this https URL
• 摘要：文本到图像（T2I）模型正在迅速流行，但其输出往往缺乏地理多样性，强化刻板印象并歪曲地区。鉴于其广泛的影响范围，严格评估这些模型如何描绘世界至关重要。现有的多样性指标要么依赖于精选的数据集，要么专注于表面视觉相似性，从而限制了可解释性。我们引入了 GeoDiv，这是一个利用大型语言和视觉语言模型来沿着两个互补轴评估地理多样性的框架：社会经济视觉指数（SEVI），捕捉经济和条件相关线索，以及视觉多样性指数（VDI），衡量主要实体和背景的变化。 GeoDiv 应用于由稳定扩散和 FLUX.1-dev 等模型在 10 美元实体和 16 美元国家/地区生成的图像，揭示了一贯缺乏多样性的情况，并识别了模型默认为有偏见的描绘的细粒度属性。引人注目的是，对印度、尼日利亚和哥伦比亚等国家的描述极其贫困和破旧，反映出潜在的社会经济偏见。这些结果凸显了生成模型中需要更大的地理细微差别。 GeoDiv 提供了第一个系统的、可解释的框架来衡量此类偏差，标志着朝着更公平、更具包容性的生成系统迈出了一步。项目页面：此 https URL

Title: NoLan: Mitigating Object Hallucinations in Large Vision-Language Models via Dynamic Suppression of Language Priors

• Authors: Lingfeng Ren, Weihao Yu, Runpeng Yu, Xinchao Wang
• Subjects: cs.CV, cs.AI, cs.CL
• Abstract URL: https://arxiv.org/abs/2602.22144
• Pdf URL: https://arxiv.org/pdf/2602.22144
• Copy Paste: [[2602.22144]] NoLan: Mitigating Object Hallucinations in Large Vision-Language Models via Dynamic Suppression of Language Priors(https://arxiv.org/abs/2602.22144)
• Keywords: generation
• Abstract: Object hallucination is a critical issue in Large Vision-Language Models (LVLMs), where outputs include objects that do not appear in the input image. A natural question arises from this phenomenon: Which component of the LVLM pipeline primarily contributes to object hallucinations? The vision encoder to perceive visual information, or the language decoder to generate text responses? In this work, we strive to answer this question through designing a systematic experiment to analyze the roles of the vision encoder and the language decoder in hallucination generation. Our observations reveal that object hallucinations are predominantly associated with the strong priors from the language decoder. Based on this finding, we propose a simple and training-free framework, No-Language-Hallucination Decoding, NoLan, which refines the output distribution by dynamically suppressing language priors, modulated based on the output distribution difference between multimodal and text-only inputs. Experimental results demonstrate that NoLan effectively reduces object hallucinations across various LVLMs on different tasks. For instance, NoLan achieves substantial improvements on POPE, enhancing the accuracy of LLaVA-1.5 7B and Qwen-VL 7B by up to 6.45 and 7.21, respectively. The code is publicly available at: this https URL.
• 摘要：物体幻觉是大视觉语言模型 (LVLM) 中的一个关键问题，其中输出包括输入图像中未出现的物体。这种现象自然会产生一个问题：LVLM 管道的哪个组件主要导致物体幻觉？视觉编码器感知视觉信息，还是语言解码器生成文本响应？在这项工作中，我们试图通过设计系统实验来分析视觉编码器和语言解码器在幻觉生成中的作用来回答这个问题。我们的观察表明，物体幻觉主要与语言解码器的强先验相关。基于这一发现，我们提出了一个简单且免训练的框架，No-Language-Hallucination Decoding，NoLan，它通过动态抑制语言先验来细化输出分布，并根据多模态和纯文本输入之间的输出分布差异进行调制。实验结果表明，NoLan 在不同任务上的各种 LVLM 中有效减少了物体幻觉。例如，NoLan 在 POPE 上取得了实质性改进，将 LLaVA-1.5 7B 和 Qwen-VL 7B 的精度分别提高了 6.45 和 7.21。该代码可在以下位置公开获取：此 https URL。

Title: CoLoGen: Progressive Learning of Concept`-`Localization Duality for Unified Image Generation

• Authors: YuXin Song, Yu Lu, Haoyuan Sun, Huanjin Yao, Fanglong Liu, Yifan Sun, Haocheng Feng, Hang Zhou, Jingdong Wang
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.22150
• Pdf URL: https://arxiv.org/pdf/2602.22150
• Copy Paste: [[2602.22150]] CoLoGen: Progressive Learning of Concept`-`Localization Duality for Unified Image Generation(https://arxiv.org/abs/2602.22150)
• Keywords: generation
• Abstract: Unified conditional image generation remains difficult because different tasks depend on fundamentally different internal representations. Some require conceptual understanding for semantic synthesis, while others rely on localization cues for spatial precision. Forcing these heterogeneous tasks to share a single representation leads to concept`-`localization representational conflict. To address this issue, we propose CoLoGen, a unified diffusion framework that progressively learns and reconciles this concept`-`localization duality. CoLoGen uses a staged curriculum that first builds core conceptual and localization abilities, then adapts them to diverse visual conditions, and finally refines their synergy for complex instruction`-`driven tasks. Central to this process is the Progressive Representation Weaving (PRW) module, which dynamically routes features to specialized experts and stably integrates their outputs across stages. Experiments on editing, controllable generation, and customized generation show that CoLoGen achieves competitive or superior performance, offering a principled representational perspective for unified image generation.
• 摘要：统一的条件图像生成仍然很困难，因为不同的任务依赖于根本不同的内部表示。有些需要概念理解来进行语义合成，而另一些则依赖于定位线索来实现空间精度。强制这些异构任务共享单一表示会导致概念“-”本地化表示冲突。为了解决这个问题，我们提出了 CoLoGen，一个统一的扩散框架，可以逐步学习并协调这个概念“本地化二元性”。 CoLoGen 使用分阶段课程，首先构建核心概念和本地化能力，然后使它们适应不同的视觉条件，最后完善它们对复杂指令驱动任务的协同作用。该过程的核心是渐进表示编织（PRW）模块，该模块动态地将功能路由给专业专家并稳定地跨阶段集成他们的输出。编辑、可控生成和定制生成的实验表明，CoLoGen 实现了具有竞争力或优越的性能，为统一图像生成提供了原则性的表示视角。

Title: CASR: A Robust Cyclic Framework for Arbitrary Large-Scale Super-Resolution with Distribution Alignment and Self-Similarity Awareness

• Authors: Wenhao Guo, Zhaoran Zhao, Peng Lu, Sheng Li, Qian Qiao, RuiDe Li
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.22159
• Pdf URL: https://arxiv.org/pdf/2602.22159
• Copy Paste: [[2602.22159]] CASR: A Robust Cyclic Framework for Arbitrary Large-Scale Super-Resolution with Distribution Alignment and Self-Similarity Awareness(https://arxiv.org/abs/2602.22159)
• Keywords: super-resolution
• Abstract: Arbitrary-Scale SR (ASISR) remains fundamentally limited by cross-scale distribution shift: once the inference scale leaves the training range, noise, blur, and artifacts accumulate sharply. We revisit this challenge from a cross-scale distribution transition perspective and propose CASR, a simple yet highly efficient cyclic SR framework that reformulates ultra-magnification as a sequence of in-distribution scale transitions. This design ensures stable inference at arbitrary scales while requiring only a single model. CASR tackles two major bottlenecks: distribution drift across iterations and patch-wise diffusion inconsistencies. The proposed SDAM module aligns structural distributions via superpixel aggregation, preventing error accumulation, while SARM module restores high-frequency textures by enforcing autocorrelation and embedding LR self-similarity priors. Despite using only a single model, our approach significantly reduces distribution drift, preserves long-range texture consistency, and achieves superior generalization even at extreme magnification.
• 摘要：任意尺度 SR (ASISR) 从根本上仍然受到跨尺度分布偏移的限制：一旦推理尺度离开训练范围，噪声、模糊和伪影就会急剧累积。我们从跨尺度分布转变的角度重新审视这一挑战，并提出了 CASR，这是一种简单而高效的循环 SR 框架，它将超放大重新表述为一系列分布内尺度转变。这种设计确保了任意尺度的稳定推理，同时只需要单个模型。 CASR 解决了两个主要瓶颈：迭代间的分布漂移和补丁式扩散不一致。所提出的 SDAM 模块通过超像素聚合来对齐结构分布，防止错误累积，而 SARM 模块则通过强制自相关和嵌入 LR 自相似性先验来恢复高频纹理。尽管仅使用单个模型，但我们的方法显着减少了分布漂移，保持了远程纹理一致性，并且即使在极端放大倍率下也能实现出色的泛化。

Title: Off-The-Shelf Image-to-Image Models Are All You Need To Defeat Image Protection Schemes

• Authors: Xavier Pleimling, Sifat Muhammad Abdullah, Gunjan Balde, Peng Gao, Mainack Mondal, Murtuza Jadliwala, Bimal Viswanath
• Subjects: cs.CV, cs.AI
• Abstract URL: https://arxiv.org/abs/2602.22197
• Pdf URL: https://arxiv.org/pdf/2602.22197
• Copy Paste: [[2602.22197]] Off-The-Shelf Image-to-Image Models Are All You Need To Defeat Image Protection Schemes(https://arxiv.org/abs/2602.22197)
• Keywords: generative
• Abstract: Advances in Generative AI (GenAI) have led to the development of various protection strategies to prevent the unauthorized use of images. These methods rely on adding imperceptible protective perturbations to images to thwart misuse such as style mimicry or deepfake manipulations. Although previous attacks on these protections required specialized, purpose-built methods, we demonstrate that this is no longer necessary. We show that off-the-shelf image-to-image GenAI models can be repurposed as generic ``denoisers" using a simple text prompt, effectively removing a wide range of protective perturbations. Across 8 case studies spanning 6 diverse protection schemes, our general-purpose attack not only circumvents these defenses but also outperforms existing specialized attacks while preserving the image's utility for the adversary. Our findings reveal a critical and widespread vulnerability in the current landscape of image protection, indicating that many schemes provide a false sense of security. We stress the urgent need to develop robust defenses and establish that any future protection mechanism must be benchmarked against attacks from off-the-shelf GenAI models. Code is available in this repository: this https URL
• 摘要：生成式人工智能 (GenAI) 的进步促进了各种保护策略的发展，以防止未经授权使用图像。这些方法依赖于向图像添加难以察觉的保护性扰动，以阻止滥用，例如风格模仿或深度伪造操作。尽管以前对这些保护的攻击需要专门的、专用的方法，但我们证明这不再是必要的。我们证明，现成的图像到图像 GenAI 模型可以使用简单的文本提示重新用作通用“降噪器”，从而有效地消除各种保护性扰动。在涵盖 6 种不同保护方案的 8 个案例研究中，我们的通用攻击不仅绕过了这些防御，而且在保留图像对对手的实用性的同时优于现有的专门攻击。我们的研究结果揭示了当前图像保护领域中一个关键且广泛的漏洞，表明许多我们强调迫切需要开发强大的防御措施，并确定任何未来的保护机制都必须针对现成的 GenAI 模型的攻击进行基准测试：此 https URL 中提供了代码。

Title: Solaris: Building a Multiplayer Video World Model in Minecraft

• Authors: Georgy Savva, Oscar Michel, Daohan Lu, Suppakit Waiwitlikhit, Timothy Meehan, Dhairya Mishra, Srivats Poddar, Jack Lu, Saining Xie
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.22208
• Pdf URL: https://arxiv.org/pdf/2602.22208
• Copy Paste: [[2602.22208]] Solaris: Building a Multiplayer Video World Model in Minecraft(https://arxiv.org/abs/2602.22208)
• Keywords: generation
• Abstract: Existing action-conditioned video generation models (video world models) are limited to single-agent perspectives, failing to capture the multi-agent interactions of real-world environments. We introduce Solaris, a multiplayer video world model that simulates consistent multi-view observations. To enable this, we develop a multiplayer data system designed for robust, continuous, and automated data collection on video games such as Minecraft. Unlike prior platforms built for single-player settings, our system supports coordinated multi-agent interaction and synchronized videos + actions capture. Using this system, we collect 12.64 million multiplayer frames and propose an evaluation framework for multiplayer movement, memory, grounding, building, and view consistency. We train Solaris using a staged pipeline that progressively transitions from single-player to multiplayer modeling, combining bidirectional, causal, and Self Forcing training. In the final stage, we introduce Checkpointed Self Forcing, a memory-efficient Self Forcing variant that enables a longer-horizon teacher. Results show our architecture and training design outperform existing baselines. Through open-sourcing our system and models, we hope to lay the groundwork for a new generation of multi-agent world models.
• 摘要：现有的动作条件视频生成模型（视频世界模型）仅限于单智能体视角，无法捕捉现实世界环境的多智能体交互。我们介绍 Solaris，这是一种模拟一致的多视图观察的多人视频世界模型。为了实现这一目标，我们开发了一个多人数据系统，专为《我的世界》等视频游戏的稳健、连续和自动化数据收集而设计。与之前为单人游戏设置构建的平台不同，我们的系统支持协调的多代理交互和同步视频+动作捕捉。使用该系统，我们收集了 1264 万个多人游戏帧，并提出了多人运动、记忆、接地、构建和视图一致性的评估框架。我们使用分阶段的管道来训练 Solaris，该管道逐渐从单人模式过渡到多人模式，结合了双向、因果和自我强迫训练。在最后阶段，我们引入了检查点自我强迫，这是一种内存高效的自我强迫变体，可以实现更长视野的教师。结果显示我们的架构和培训设计优于现有基线。通过开源我们的系统和模型，我们希望为新一代多智能体世界模型奠定基础。

Title: WHOLE: World-Grounded Hand-Object Lifted from Egocentric Videos

• Authors: Yufei Ye, Jiaman Li, Ryan Rong, C. Karen Liu
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.22209
• Pdf URL: https://arxiv.org/pdf/2602.22209
• Copy Paste: [[2602.22209]] WHOLE: World-Grounded Hand-Object Lifted from Egocentric Videos(https://arxiv.org/abs/2602.22209)
• Keywords: generative
• Abstract: Egocentric manipulation videos are highly challenging due to severe occlusions during interactions and frequent object entries and exits from the camera view as the person moves. Current methods typically focus on recovering either hand or object pose in isolation, but both struggle during interactions and fail to handle out-of-sight cases. Moreover, their independent predictions often lead to inconsistent hand-object relations. We introduce WHOLE, a method that holistically reconstructs hand and object motion in world space from egocentric videos given object templates. Our key insight is to learn a generative prior over hand-object motion to jointly reason about their interactions. At test time, the pretrained prior is guided to generate trajectories that conform to the video observations. This joint generative reconstruction substantially outperforms approaches that process hands and objects separately followed by post-processing. WHOLE achieves state-of-the-art performance on hand motion estimation, 6D object pose estimation, and their relative interaction reconstruction. Project website: this https URL
• 摘要：由于交互过程中的严重遮挡以及随着人的移动而频繁地进入和退出摄像机视图，以自我为中心的操纵视频非常具有挑战性。当前的方法通常侧重于单独恢复手部或物体的姿势，但两者在交互过程中都很困难，并且无法处理视线之外的情况。此外，他们的独立预测常常导致不一致的手-物体关系。我们引入了 WHOLE，一种根据给定对象模板的以自我为中心的视频整体重建世界空间中的手和对象运动的方法。我们的主要见解是学习手部物体运动的生成先验，以共同推理它们的相互作用。在测试时，引导预训练的先验生成符合视频观察的轨迹。这种联合生成重建大大优于分别处理手和物体然后进行后处理的方法。 WHOLE 在手部运动估计、6D 物体姿态估计及其相对交互重建方面实现了最先进的性能。项目网站：这个https URL