2026-02-25

Title: Tensor Network Generator-Enhanced Optimization for Traveling Salesman Problem

• Authors: Ryo Sakai, Chen-Yu Liu
• Subjects: cs.LG, math.OC, quant-ph
• Abstract URL: https://arxiv.org/abs/2602.20175
• Pdf URL: https://arxiv.org/pdf/2602.20175
• Copy Paste: [[2602.20175]] Tensor Network Generator-Enhanced Optimization for Traveling Salesman Problem(https://arxiv.org/abs/2602.20175)
• Keywords: generative
• Abstract: We present an application of the tensor network generator-enhanced optimization (TN-GEO) framework to address the traveling salesman problem (TSP), a fundamental combinatorial optimization challenge. Our approach employs a tensor network Born machine based on automatically differentiable matrix product states (MPS) as the generative model, using the Born rule to define probability distributions over candidate solutions. Unlike approaches based on binary encoding, which require $N^2$ variables and penalty terms to enforce valid tour constraints, we adopt a permutation-based formulation with integer variables and use autoregressive sampling with masking to guarantee that every generated sample is a valid tour by construction. We also introduce a $k$-site MPS variant that learns distributions over $k$-grams (consecutive city subsequences) using a sliding window approach, enabling parameter-efficient modeling for larger instances. Experimental validation on TSPLIB benchmark instances with up to 52 cities demonstrates that TN-GEO can outperform classical heuristics including swap and 2-opt hill-climbing. The $k$-site variants, which put more focus on local correlations, show better results compared to the full-MPS case.
• 摘要：我们提出了张量网络生成器增强优化（TN-GEO）框架的应用来解决旅行商问题（TSP），这是一个基本的组合优化挑战。我们的方法采用基于自动可微矩阵乘积状态（MPS）的张量网络 Born 机作为生成模型，使用 Born 规则定义候选解决方案的概率分布。与基于二进制编码的方法不同，基于二进制编码的方法需要 $N^2$ 变量和惩罚项来强制有效的巡回约束，我们采用基于排列的整数变量公式，并使用带有掩码的自回归采样来保证每个生成的样本都是有效的巡回构建。我们还引入了 $k$-site MPS 变体，它使用滑动窗口方法学习 $k$-gram（连续城市子序列）上的分布，从而为较大实例实现参数高效建模。对多达 52 个城市的 TSPLIB 基准实例进行的实验验证表明，TN-GEO 的性能优于包括交换和 2-opt 爬山在内的经典启发式算法。与完整 MPS 情况相比，$k$ 位点变体更加关注局部相关性，显示出更好的结果。

Title: Multimodal Crystal Flow: Any-to-Any Modality Generation for Unified Crystal Modeling

• Authors: Kiyoung Seong, Sungsoo Ahn, Sehui Han, Changyoung Park
• Subjects: cs.LG, cs.AI
• Abstract URL: https://arxiv.org/abs/2602.20210
• Pdf URL: https://arxiv.org/pdf/2602.20210
• Copy Paste: [[2602.20210]] Multimodal Crystal Flow: Any-to-Any Modality Generation for Unified Crystal Modeling(https://arxiv.org/abs/2602.20210)
• Keywords: generation, generative
• Abstract: Crystal modeling spans a family of conditional and unconditional generation tasks across different modalities, including crystal structure prediction (CSP) and \emph{de novo} generation (DNG). While recent deep generative models have shown promising performance, they remain largely task-specific, lacking a unified framework that shares crystal representations across different generation tasks. To address this limitation, we propose \emph{Multimodal Crystal Flow (MCFlow)}, a unified multimodal flow model that realizes multiple crystal generation tasks as distinct inference trajectories via independent time variables for atom types and crystal structures. To enable multimodal flow in a standard transformer model, we introduce a composition- and symmetry-aware atom ordering with hierarchical permutation augmentation, injecting strong compositional and crystallographic priors without explicit structural templates. Experiments on the MP-20 and MPTS-52 benchmarks show that MCFlow achieves competitive performance against task-specific baselines across multiple crystal generation tasks.
• 摘要：晶体建模跨越一系列不同模式的条件和无条件生成任务，包括晶体结构预测（CSP）和\emph{de novo}生成（DNG）。虽然最近的深度生成模型表现出了良好的性能，但它们在很大程度上仍然是特定于任务的，缺乏在不同生成任务之间共享晶体表示的统一框架。为了解决这个限制，我们提出了\emph{多模态晶体流（MCFlow）}，这是一种统一的多模态流模型，它通过原子类型和晶体结构的独立时间变量将多个晶体生成任务实现为不同的推理轨迹。为了在标准变压器模型中实现多模态流，我们引入了具有分层排列增强的成分和对称感知原子排序，无需显式结构模板即可注入强大的成分和晶体学先验。 MP-20 和 MPTS-52 基准测试表明，MCFlow 在多个晶体生成任务中实现了与特定任务基线相比具有竞争力的性能。

Title: Discrete Diffusion with Sample-Efficient Estimators for Conditionals

• Authors: Karthik Elamvazhuthi, Abhijith Jayakumar, Andrey Y. Lokhov
• Subjects: cs.LG, stat.ML
• Abstract URL: https://arxiv.org/abs/2602.20293
• Pdf URL: https://arxiv.org/pdf/2602.20293
• Copy Paste: [[2602.20293]] Discrete Diffusion with Sample-Efficient Estimators for Conditionals(https://arxiv.org/abs/2602.20293)
• Keywords: generative
• Abstract: We study a discrete denoising diffusion framework that integrates a sample-efficient estimator of single-site conditionals with round-robin noising and denoising dynamics for generative modeling over discrete state spaces. Rather than approximating a discrete analog of a score function, our formulation treats single-site conditional probabilities as the fundamental objects that parameterize the reverse diffusion process. We employ a sample-efficient method known as Neural Interaction Screening Estimator (NeurISE) to estimate these conditionals in the diffusion dynamics. Controlled experiments on synthetic Ising models, MNIST, and scientific data sets produced by a D-Wave quantum annealer, synthetic Potts model and one-dimensional quantum systems demonstrate the proposed approach. On the binary data sets, these experiments demonstrate that the proposed approach outperforms popular existing methods including ratio-based approaches, achieving improved performance in total variation, cross-correlations, and kernel density estimation metrics.
• 摘要：我们研究了一种离散去噪扩散框架，它将单点条件的样本有效估计器与循环噪声和去噪动力学相结合，用于离散状态空间的生成建模。我们的公式不是近似分数函数的离散模拟，而是将单点条件概率视为参数化反向扩散过程的基本对象。我们采用一种称为神经相互作用筛选估计器 (NeurISE) 的样本有效方法来估计扩散动力学中的这些条件。对合成 Ising 模型、MNIST 以及 D-Wave 量子退火器、合成 Potts 模型和一维量子系统产生的科学数据集进行的受控实验证明了所提出的方法。在二进制数据集上，这些实验表明，所提出的方法优于流行的现有方法，包括基于比率的方法，在总变异、互相关和核密度估计指标方面实现了改进的性能。

Title: Learning to Solve Complex Problems via Dataset Decomposition

• Authors: Wanru Zhao, Lucas Caccia, Zhengyan Shi, Minseon Kim, Weijia Xu, Alessandro Sordoni
• Subjects: cs.LG
• Abstract URL: https://arxiv.org/abs/2602.20296
• Pdf URL: https://arxiv.org/pdf/2602.20296
• Copy Paste: [[2602.20296]] Learning to Solve Complex Problems via Dataset Decomposition(https://arxiv.org/abs/2602.20296)
• Keywords: generation
• Abstract: Curriculum learning is a class of training strategies that organizes the data being exposed to a model by difficulty, gradually from simpler to more complex examples. This research explores a reverse curriculum generation approach that recursively decomposes complex datasets into simpler, more learnable components. We propose a teacher-student framework where the teacher is equipped with the ability to reason step-by-step, which is used to recursively generate easier versions of examples, enabling the student model to progressively master difficult tasks. We propose a novel scoring system to measure data difficulty based on its structural complexity and conceptual depth, allowing curriculum construction over decomposed data. Experiments on math datasets (MATH and AIME) and code generation datasets demonstrate that models trained with curricula generated by our approach exhibit superior performance compared to standard training on original datasets.
• 摘要：课程学习是一类训练策略，它按照难度逐渐从简单到复杂的示例来组织模型所接触的数据。这项研究探索了一种反向课程生成方法，该方法将复杂的数据集递归地分解为更简单、更容易学习的组件。我们提出了一个师生框架，其中教师具备逐步推理的能力，用于递归生成更简单版本的示例，使学生模型能够逐步掌握困难的任务。我们提出了一种新颖的评分系统，根据数据的结构复杂性和概念深度来衡量数据难度，从而允许在分解的数据上构建课程。对数学数据集（MATH 和 AIME）和代码生成数据集的实验表明，使用我们的方法生成的课程训练的模型与原始数据集的标准训练相比表现出卓越的性能。

Title: Shape-informed cardiac mechanics surrogates in data-scarce regimes via geometric encoding and generative augmentation

• Authors: Davide Carrara, Marc Hirschvogel, Francesca Bonizzoni, Stefano Pagani, Simone Pezzuto, Francesco Regazzoni
• Subjects: cs.LG, cs.AI, math.NA
• Abstract URL: https://arxiv.org/abs/2602.20306
• Pdf URL: https://arxiv.org/pdf/2602.20306
• Copy Paste: [[2602.20306]] Shape-informed cardiac mechanics surrogates in data-scarce regimes via geometric encoding and generative augmentation(https://arxiv.org/abs/2602.20306)
• Keywords: generation, generative
• Abstract: High-fidelity computational models of cardiac mechanics provide mechanistic insight into the heart function but are computationally prohibitive for routine clinical use. Surrogate models can accelerate simulations, but generalization across diverse anatomies is challenging, particularly in data-scarce settings. We propose a two-step framework that decouples geometric representation from learning the physics response, to enable shape-informed surrogate modeling under data-scarce conditions. First, a shape model learns a compact latent representation of left ventricular geometries. The learned latent space effectively encodes anatomies and enables synthetic geometries generation for data augmentation. Second, a neural field-based surrogate model, conditioned on this geometric encoding, is trained to predict ventricular displacement under external loading. The proposed architecture performs positional encoding by using universal ventricular coordinates, which improves generalization across diverse anatomies. Geometric variability is encoded using two alternative strategies, which are systematically compared: a PCA-based approach suitable for working with point cloud representations of geometries, and a DeepSDF-based implicit neural representation learned directly from point clouds. Overall, our results, obtained on idealized and patient-specific datasets, show that the proposed approaches allow for accurate predictions and generalization to unseen geometries, and robustness to noisy or sparsely sampled inputs.
• 摘要：心脏力学的高保真计算模型提供了对心脏功能的机械洞察，但在计算上对于常规临床使用来说是令人望而却步的。替代模型可以加速模拟，但跨不同解剖结构的泛化具有挑战性，特别是在数据稀缺的环境中。我们提出了一个两步框架，将几何表示与学习物理响应分离，以在数据稀缺条件下实现形状知情的替代建模。首先，形状模型学习左心室几何结构的紧凑潜在表示。学习到的潜在空间有效地对解剖结构进行编码，并能够生成用于数据增强的合成几何图形。其次，训练基于神经场的替代模型，以这种几何编码为条件，预测外部负载下的心室位移。所提出的架构通过使用通用心室坐标来执行位置编码，这提高了不同解剖结构的泛化能力。几何变异性使用两种替代策略进行编码，并对这两种策略进行了系统比较：适合处理几何点云表示的基于 PCA 的方法，以及直接从点云学习的基于 DeepSDF 的隐式神经表示。总的来说，我们在理想化和特定于患者的数据集上获得的结果表明，所提出的方法可以对未见过的几何形状进行准确预测和泛化，并对噪声或稀疏采样输入具有鲁棒性。

Title: GSNR: Graph Smooth Null-Space Representation for Inverse Problems

• Authors: Romario Gualdrón-Hurtado, Roman Jacome, Rafael S. Suarez, Henry Arguello
• Subjects: cs.CV, eess.IV, math.OC
• Abstract URL: https://arxiv.org/abs/2602.20328
• Pdf URL: https://arxiv.org/pdf/2602.20328
• Copy Paste: [[2602.20328]] GSNR: Graph Smooth Null-Space Representation for Inverse Problems(https://arxiv.org/abs/2602.20328)
• Keywords: super-resolution
• Abstract: Inverse problems in imaging are ill-posed, leading to infinitely many solutions consistent with the measurements due to the non-trivial null-space of the sensing matrix. Common image priors promote solutions on the general image manifold, such as sparsity, smoothness, or score function. However, as these priors do not constrain the null-space component, they can bias the reconstruction. Thus, we aim to incorporate meaningful null-space information in the reconstruction framework. Inspired by smooth image representation on graphs, we propose Graph-Smooth Null-Space Representation (GSNR), a mechanism that imposes structure only into the invisible component. Particularly, given a graph Laplacian, we construct a null-restricted Laplacian that encodes similarity between neighboring pixels in the null-space signal, and we design a low-dimensional projection matrix from the $p$-smoothest spectral graph modes (lowest graph frequencies). This approach has strong theoretical and practical implications: i) improved convergence via a null-only graph regularizer, ii) better coverage, how much null-space variance is captured by $p$ modes, and iii) high predictability, how well these modes can be inferred from the measurements. GSNR is incorporated into well-known inverse problem solvers, e.g., PnP, DIP, and diffusion solvers, in four scenarios: image deblurring, compressed sensing, demosaicing, and image super-resolution, providing consistent improvement of up to 4.3 dB over baseline formulations and up to 1 dB compared with end-to-end learned models in terms of PSNR.
• 摘要：成像中的逆问题是不适定的，由于传感矩阵的非平凡零空间，导致无限多个与测量结果一致的解。常见的图像先验促进了一般图像流形上的解决方案，例如稀疏性、平滑度或得分函数。然而，由于这些先验不限制零空间分量，因此它们可能会使重建产生偏差。因此，我们的目标是将有意义的零空间信息纳入重建框架中。受图上平滑图像表示的启发，我们提出了图平滑零空间表示（GSNR），这是一种仅将结构强加到不可见组件中的机制。特别是，给定图拉普拉斯，我们构造一个零限制拉普拉斯，它编码零空间信号中相邻像素之间的相似性，并且我们从 $p$-最平滑谱图模式（最低图频率）设计一个低维投影矩阵。这种方法具有很强的理论和实践意义：i）通过仅空图正则化器改进收敛性，ii）更好的覆盖范围，$p$模式捕获了多少零空间方差，以及iii）高可预测性，从测量中推断这些模式的效果如何。 GSNR 被纳入著名的逆问题求解器（例如 PnP、DIP 和扩散求解器）中，在图像去模糊、压缩感知、去马赛克和图像超分辨率四种场景中，在 PSNR 方面比基线公式提高高达 4.3 dB，与端到端学习模型相比提高高达 1 dB。

Title: BiRQA: Bidirectional Robust Quality Assessment for Images

• Authors: Aleksandr Gushchin, Dmitriy S. Vatolin, Anastasia Antsiferova
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.20351
• Pdf URL: https://arxiv.org/pdf/2602.20351
• Copy Paste: [[2602.20351]] BiRQA: Bidirectional Robust Quality Assessment for Images(https://arxiv.org/abs/2602.20351)
• Keywords: restoration, generative, quality assessment
• Abstract: Full-Reference image quality assessment (FR IQA) is important for image compression, restoration and generative modeling, yet current neural metrics remain slow and vulnerable to adversarial perturbations. We present BiRQA, a compact FR IQA metric model that processes four fast complementary features within a bidirectional multiscale pyramid. A bottom-up attention module injects fine-scale cues into coarse levels through an uncertainty-aware gate, while a top-down cross-gating block routes semantic context back to high resolution. To enhance robustness, we introduce Anchored Adversarial Training, a theoretically grounded strategy that uses clean "anchor" samples and a ranking loss to bound pointwise prediction error under attacks. On five public FR IQA benchmarks BiRQA outperforms or matches the previous state of the art (SOTA) while running ~3x faster than previous SOTA models. Under unseen white-box attacks it lifts SROCC from 0.30-0.57 to 0.60-0.84 on KADID-10k, demonstrating substantial robustness gains. To our knowledge, BiRQA is the only FR IQA model combining competitive accuracy with real-time throughput and strong adversarial resilience.
• 摘要：全参考图像质量评估 (FR IQA) 对于图像压缩、恢复和生成建模非常重要，但当前的神经指标仍然缓慢且容易受到对抗性扰动。我们提出 BiRQA，一种紧凑的 FR IQA 度量模型，可处理双向多尺度金字塔内的四个快速互补特征。自下而上的注意力模块通过不确定性感知门将精细尺度线索注入粗略级别，而自上而下的交叉门控模块将语义上下文路由回高分辨率。为了增强鲁棒性，我们引入了锚定对抗训练，这是一种基于理论的策略，它使用干净的“锚”样本和排名损失来限制攻击下的逐点预测误差。在五个公共 FR IQA 基准测试中，BiRQA 的性能优于或匹配之前的最新技术 (SOTA)，同时运行速度比之前的 SOTA 模型快约 3 倍。在看不见的白盒攻击下，它将 KADID-10k 上的 SROCC 从 0.30-0.57 提升到 0.60-0.84，展示了显着的鲁棒性增益。据我们所知，BiRQA 是唯一将有竞争力的准确性与实时吞吐量和强大的对抗弹性相结合的 FR IQA 模型。

Title: 3DSPA: A 3D Semantic Point Autoencoder for Evaluating Video Realism

• Authors: Bhavik Chandna, Kelsey R. Allen
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.20354
• Pdf URL: https://arxiv.org/pdf/2602.20354
• Copy Paste: [[2602.20354]] 3DSPA: A 3D Semantic Point Autoencoder for Evaluating Video Realism(https://arxiv.org/abs/2602.20354)
• Keywords: generation, generative
• Abstract: AI video generation is evolving rapidly. For video generators to be useful for applications ranging from robotics to film-making, they must consistently produce realistic videos. However, evaluating the realism of generated videos remains a largely manual process -- requiring human annotation or bespoke evaluation datasets which have restricted scope. Here we develop an automated evaluation framework for video realism which captures both semantics and coherent 3D structure and which does not require access to a reference video. Our method, 3DSPA, is a 3D spatiotemporal point autoencoder which integrates 3D point trajectories, depth cues, and DINO semantic features into a unified representation for video evaluation. 3DSPA models how objects move and what is happening in the scene, enabling robust assessments of realism, temporal consistency, and physical plausibility. Experiments show that 3DSPA reliably identifies videos which violate physical laws, is more sensitive to motion artifacts, and aligns more closely with human judgments of video quality and realism across multiple datasets. Our results demonstrate that enriching trajectory-based representations with 3D semantics offers a stronger foundation for benchmarking generative video models, and implicitly captures physical rule violations. The code and pretrained model weights will be available at this https URL.
• 摘要：人工智能视频生成正在迅速发展。为了使视频生成器能够用于从机器人到电影制作等各种应用，它们必须始终如一地生成逼真的视频。然而，评估生成视频的真实感仍然是一个很大程度上手动的过程——需要人工注释或范围有限的定制评估数据集。在这里，我们开发了一个视频真实感自动评估框架，它可以捕获语义和连贯的 3D 结构，并且不需要访问参考视频。我们的方法 3DSPA 是一种 3D 时空点自动编码器，它将 3D 点轨迹、深度线索和 DINO 语义特征集成到视频评估的统一表示中。 3DSPA 对物体如何移动以及场景中发生的情况进行建模，从而能够对真实性、时间一致性和物理合理性进行可靠的评估。实验表明，3DSPA 能够可靠地识别违反物理定律的视频，对运动伪影更敏感，并且更符合人类对多个数据集的视频质量和真实感的判断。我们的结果表明，利用 3D 语义丰富基于轨迹的表示为基准生成视频模型提供了更坚实的基础，并隐式捕获物理规则违规行为。代码和预训练模型权重将在此 https URL 中提供。

Title: Momentum Guidance: Plug-and-Play Guidance for Flow Models

• Authors: Runlong Liao, Jian Yu, Baiyu Su, Chi Zhang, Lizhang Chen, Qiang Liu
• Subjects: cs.LG, cs.CV
• Abstract URL: https://arxiv.org/abs/2602.20360
• Pdf URL: https://arxiv.org/pdf/2602.20360
• Copy Paste: [[2602.20360]] Momentum Guidance: Plug-and-Play Guidance for Flow Models(https://arxiv.org/abs/2602.20360)
• Keywords: generative
• Abstract: Flow-based generative models have become a strong framework for high-quality generative modeling, yet pretrained models are rarely used in their vanilla conditional form: conditional samples without guidance often appear diffuse and lack fine-grained detail due to the smoothing effects of neural networks. Existing guidance techniques such as classifier-free guidance (CFG) improve fidelity but double the inference cost and typically reduce sample diversity. We introduce Momentum Guidance (MG), a new dimension of guidance that leverages the ODE trajectory itself. MG extrapolates the current velocity using an exponential moving average of past velocities and preserves the standard one-evaluation-per-step cost. It matches the effect of standard guidance without extra computation and can further improve quality when combined with CFG. Experiments demonstrate MG's effectiveness across benchmarks. Specifically, on ImageNet-256, MG achieves average improvements in FID of 36.68% without CFG and 25.52% with CFG across various sampling settings, attaining an FID of 1.597 at 64 sampling steps. Evaluations on large flow-based models like Stable Diffusion 3 and FLUX.1-dev further confirm consistent quality enhancements across standard metrics.
• 摘要：基于流的生成模型已成为高质量生成建模的强大框架，但预训练模型很少以其普通条件形式使用：由于神经网络的平滑效应，没有指导的条件样本通常显得分散且缺乏细粒度细节。现有的引导技术，例如无分类器引导 (CFG)，可以提高保真度，但会使推理成本加倍，并且通常会降低样本多样性。我们引入动量指导 (MG)，这是一种利用 ODE 轨迹本身的新指导维度。 MG 使用过去速度的指数移动平均值来推断当前速度，并保留标准的每步一次评估成本。它无需额外计算即可达到标准引导的效果，并且与CFG结合可以进一步提高质量。实验证明了 MG 在各个基准测试中的有效性。具体来说，在 ImageNet-256 上，MG 在各种采样设置中在没有 CFG 的情况下实现了 36.68% 的 FID 平均改进，在使用 CFG 的情况下实现了 25.52% 的平均改进，在 64 个采样步骤中获得了 1.597 的 FID。对 Stable Diffusion 3 和 FLUX.1-dev 等大型基于流的模型的评估进一步证实了跨标准指标的一致质量增强。

Title: SimLBR: Learning to Detect Fake Images by Learning to Detect Real Images

• Authors: Aayush Dhakal, Subash Khanal, Srikumar Sastry, Jacob Arndt, Philipe Ambrozio Dias, Dalton Lunga, Nathan Jacobs
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.20412
• Pdf URL: https://arxiv.org/pdf/2602.20412
• Copy Paste: [[2602.20412]] SimLBR: Learning to Detect Fake Images by Learning to Detect Real Images(https://arxiv.org/abs/2602.20412)
• Keywords: generative
• Abstract: The rapid advancement of generative models has made the detection of AI-generated images a critical challenge for both research and society. Recent works have shown that most state-of-the-art fake image detection methods overfit to their training data and catastrophically fail when evaluated on curated hard test sets with strong distribution shifts. In this work, we argue that it is more principled to learn a tight decision boundary around the real image distribution and treat the fake category as a sink class. To this end, we propose SimLBR, a simple and efficient framework for fake image detection using Latent Blending Regularization (LBR). Our method significantly improves cross-generator generalization, achieving up to +24.85\% accuracy and +69.62\% recall on the challenging Chameleon benchmark. SimLBR is also highly efficient, training orders of magnitude faster than existing approaches. Furthermore, we emphasize the need for reliability-oriented evaluation in fake image detection, introducing risk-adjusted metrics and worst-case estimates to better assess model robustness. All code and models will be released on HuggingFace and GitHub.
• 摘要：生成模型的快速发展使得人工智能生成图像的检测成为研究和社会面临的严峻挑战。最近的研究表明，大多数最先进的假图像检测方法都过度拟合其训练数据，并且在具有强烈分布变化的精心策划的硬测试集上进行评估时会发生灾难性的失败。在这项工作中，我们认为更有原则的是围绕真实图像分布学习严格的决策边界并将假类别视为接收器类。为此，我们提出了 SimLBR，这是一种使用潜在混合正则化 (LBR) 进行虚假图像检测的简单而高效的框架。我们的方法显着提高了跨生成器泛化能力，在具有挑战性的 Chameleon 基准测试中实现了高达 +24.85\% 的准确率和 +69.62\% 的召回率。 SimLBR 还非常高效，训练速度比现有方法快几个数量级。此外，我们强调在虚假图像检测中需要进行以可靠性为导向的评估，引入风险调整指标和最坏情况估计，以更好地评估模型的稳健性。所有代码和模型将在 HuggingFace 和 GitHub 上发布。

Title: gQIR: Generative Quanta Image Reconstruction

• Authors: Aryan Garg, Sizhuo Ma, Mohit Gupta
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.20417
• Pdf URL: https://arxiv.org/pdf/2602.20417
• Copy Paste: [[2602.20417]] gQIR: Generative Quanta Image Reconstruction(https://arxiv.org/abs/2602.20417)
• Keywords: restoration, generative
• Abstract: Capturing high-quality images from only a few detected photons is a fundamental challenge in computational imaging. Single-photon avalanche diode (SPAD) sensors promise high-quality imaging in regimes where conventional cameras fail, but raw \emph{quanta frames} contain only sparse, noisy, binary photon detections. Recovering a coherent image from a burst of such frames requires handling alignment, denoising, and demosaicing (for color) under noise statistics far outside those assumed by standard restoration pipelines or modern generative models. We present an approach that adapts large text-to-image latent diffusion models to the photon-limited domain of quanta burst imaging. Our method leverages the structural and semantic priors of internet-scale diffusion models while introducing mechanisms to handle Bernoulli photon statistics. By integrating latent-space restoration with burst-level spatio-temporal reasoning, our approach produces reconstructions that are both photometrically faithful and perceptually pleasing, even under high-speed motion. We evaluate the method on synthetic benchmarks and new real-world datasets, including the first color SPAD burst dataset and a challenging \textit{Deforming (XD)} video benchmark. Across all settings, the approach substantially improves perceptual quality over classical and modern learning-based baselines, demonstrating the promise of adapting large generative priors to extreme photon-limited sensing. Code at \href{this https URL}{this https URL}.
• 摘要：仅从少量检测到的光子捕获高质量图像是计算成像的基本挑战。单光子雪崩二极管 (SPAD) 传感器可以在传统相机无法实现的情况下实现高质量成像，但原始\emph{量子帧}仅包含稀疏、嘈杂的二元光子检测。从一系列此类帧中恢复连贯图像需要在噪声统计数据下处理对齐、去噪和去马赛克（颜色），远远超出标准恢复管道或现代生成模型假设的范围。我们提出了一种将大型文本到图像潜在扩散模型适应量子爆发成像的光子有限域的方法。我们的方法利用互联网规模扩散模型的结构和语义先验，同时引入处理伯努利光子统计的机制。通过将潜在空间恢复与突发级时空推理相结合，我们的方法即使在高速运动下也能产生光度忠实且感知愉悦的重建。我们在综合基准和新的现实数据集上评估该方法，包括第一个彩色 SPAD 突发数据集和具有挑战性的 \textit{Deforming (XD)} 视频基准。在所有设置中，该方法比经典和现代基于学习的基线显着提高了感知质量，证明了将大生成先验适应极端光子限制传感的前景。代码位于 \href{此 https URL}{此 https URL}。

Title: A Long-Short Flow-Map Perspective for Drifting Models

• Authors: Zhiqi Li, Bo Zhu
• Subjects: cs.LG
• Abstract URL: https://arxiv.org/abs/2602.20463
• Pdf URL: https://arxiv.org/pdf/2602.20463
• Copy Paste: [[2602.20463]] A Long-Short Flow-Map Perspective for Drifting Models(https://arxiv.org/abs/2602.20463)
• Keywords: generative
• Abstract: This paper provides a reinterpretation of the Drifting Model~\cite{deng2026generative} through a semigroup-consistent long-short flow-map factorization. We show that a global transport process can be decomposed into a long-horizon flow map followed by a short-time terminal flow map admitting a closed-form optimal velocity representation, and that taking the terminal interval length to zero recovers exactly the drifting field together with a conservative impulse term required for flow-map consistency. Based on this perspective, we propose a new likelihood learning formulation that aligns the long-short flow-map decomposition with density evolution under transport. We validate the framework through both theoretical analysis and empirical evaluations on benchmark tests, and further provide a theoretical interpretation of the feature-space optimization while highlighting several open problems for future study.
• 摘要：本文通过半群一致的长短流图分解对漂移模型进行了重新解释。我们证明，全局传输过程可以分解为长时域流图，然后是短时终端流图，允许封闭形式的最佳速度表示，并且将终端间隔长度设为零可以精确地恢复漂移场以及流图一致性所需的保守脉冲项。基于这个观点，我们提出了一种新的似然学习公式，将长短流图分解与传输下的密度演化相结合。我们通过理论分析和基准测试的实证评估验证了该框架，并进一步提供了特征空间优化的理论解释，同时强调了未来研究的几个开放问题。

Title: SceMoS: Scene-Aware 3D Human Motion Synthesis by Planning with Geometry-Grounded Tokens

• Authors: Anindita Ghosh, Vladislav Golyanik, Taku Komura, Philipp Slusallek, Christian Theobalt, Rishabh Dabral
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.20476
• Pdf URL: https://arxiv.org/pdf/2602.20476
• Copy Paste: [[2602.20476]] SceMoS: Scene-Aware 3D Human Motion Synthesis by Planning with Geometry-Grounded Tokens(https://arxiv.org/abs/2602.20476)
• Keywords: generative
• Abstract: Synthesizing text-driven 3D human motion within realistic scenes requires learning both semantic intent ("walk to the couch") and physical feasibility (e.g., avoiding collisions). Current methods use generative frameworks that simultaneously learn high-level planning and low-level contact reasoning, and rely on computationally expensive 3D scene data such as point clouds or voxel occupancy grids. We propose SceMoS, a scene-aware motion synthesis framework that shows that structured 2D scene representations can serve as a powerful alternative to full 3D supervision in physically grounded motion synthesis. SceMoS disentangles global planning from local execution using lightweight 2D cues and relying on (1) a text-conditioned autoregressive global motion planner that operates on a bird's-eye-view (BEV) image rendered from an elevated corner of the scene, encoded with DINOv2 features, as the scene representation, and (2) a geometry-grounded motion tokenizer trained via a conditional VQ-VAE, that uses 2D local scene heightmap, thus embedding surface physics directly into a discrete vocabulary. This 2D factorization reaches an efficiency-fidelity trade-off: BEV semantics capture spatial layout and affordance for global reasoning, while local heightmaps enforce fine-grained physical adherence without full 3D volumetric reasoning. SceMoS achieves state-of-the-art motion realism and contact accuracy on the TRUMANS benchmark, reducing the number of trainable parameters for scene encoding by over 50%, showing that 2D scene cues can effectively ground 3D human-scene interaction.
• 摘要：在现实场景中合成文本驱动的 3D 人体运动需要学习语义意图（“走到沙发上”）和物理可行性（例如，避免碰撞）。当前的方法使用生成框架，同时学习高级规划和低级接触推理，并依赖于计算成本高昂的 3D 场景数据，例如点云或体素占用网格。我们提出了 SceMoS，这是一种场景感知运动合成框架，它表明结构化 2D 场景表示可以作为物理基础运动合成中完整 3D 监督的强大替代方案。 SceMoS 使用轻量级 2D 线索将全局规划与局部执行分开，并依赖于 (1) 文本条件自回归全局运动规划器，该规划器对从场景的高架角渲染的鸟瞰图 (BEV) 图像进行操作，使用 DINOv2 特征编码作为场景表示，以及 (2) 通过条件 VQ-VAE 训练的基于几何的运动分词器，它使用 2D 局部场景高度图，从而嵌入表面物理直接转化为离散词汇。这种 2D 分解达到了效率与保真度的权衡：BEV 语义捕获全局推理的空间布局和可供性，而局部高度图则强制执行细粒度的物理依从性，而无需完整的 3D 体积推理。 SceMoS 在 TRUMANS 基准上实现了最先进的运动真实感和接触精度，将场景编码的可训练参数数量减少了 50% 以上，表明 2D 场景线索可以有效地支持 3D 人景交互。

Title: VINA: Variational Invertible Neural Architectures

• Authors: Shubhanshu Shekhar, Mohammad Javad Khojasteh, Ananya Acharya, Tony Tohme, Kamal Youcef-Toumi
• Subjects: cs.LG, cs.AI
• Abstract URL: https://arxiv.org/abs/2602.20480
• Pdf URL: https://arxiv.org/pdf/2602.20480
• Copy Paste: [[2602.20480]] VINA: Variational Invertible Neural Architectures(https://arxiv.org/abs/2602.20480)
• Keywords: generative
• Abstract: The distinctive architectural features of normalizing flows (NFs), notably bijectivity and tractable Jacobians, make them well-suited for generative modeling. Invertible neural networks (INNs) build on these principles to address supervised inverse problems, enabling direct modeling of both forward and inverse mappings. In this paper, we revisit these architectures from both theoretical and practical perspectives and address a key gap in the literature: the lack of theoretical guarantees on approximation quality under realistic assumptions, whether for posterior inference in INNs or for generative modeling with NFs. We introduce a unified framework for INNs and NFs based on variational unsupervised loss functions, inspired by analogous formulations in related areas such as generative adversarial networks (GANs) and the Precision-Recall divergence for training normalizing flows. Within this framework, we derive theoretical performance guarantees, quantifying posterior accuracy for INNs and distributional accuracy for NFs, under assumptions that are weaker and more practically realistic than those used in prior work. Building on these theoretical results, we conduct extensive case studies to distill general design principles and practical guidelines. We conclude by demonstrating the effectiveness of our approach on a realistic ocean-acoustic inversion problem.
• 摘要：标准化流 (NF) 独特的架构特征，特别是双射性和易于处理的雅可比行列式，使它们非常适合生成建模。可逆神经网络 (INN) 基于这些原理来解决有监督的逆问题，从而能够对正向和逆向映射进行直接建模。在本文中，我们从理论和实践的角度重新审视这些架构，并解决文献中的一个关键差距：无论是 INN 中的后验推理还是 NF 的生成建模，在现实假设下缺乏对近似质量的理论保证。我们引入了基于变分无监督损失函数的 INN 和 NF 统一框架，其灵感来自于相关领域的类似公式，例如生成对抗网络 (GAN) 和训练归一化流的精确召回散度。在此框架内，我们得出了理论性能保证，量化了 INN 的后验准确性和 NF 的分布准确性，其假设比之前的工作中使用的假设更弱且更实际。在这些理论结果的基础上，我们进行了广泛的案例研究，以提炼出一般的设计原则和实践指南。最后，我们证明了我们的方法对现实海洋声学反演问题的有效性。

Title: LESA: Learnable Stage-Aware Predictors for Diffusion Model Acceleration

• Authors: Peiliang Cai, Jiacheng Liu, Haowen Xu, Xinyu Wang, Chang Zou, Linfeng Zhang
• Subjects: cs.CV, cs.AI
• Abstract URL: https://arxiv.org/abs/2602.20497
• Pdf URL: https://arxiv.org/pdf/2602.20497
• Copy Paste: [[2602.20497]] LESA: Learnable Stage-Aware Predictors for Diffusion Model Acceleration(https://arxiv.org/abs/2602.20497)
• Keywords: generation
• Abstract: Diffusion models have achieved remarkable success in image and video generation tasks. However, the high computational demands of Diffusion Transformers (DiTs) pose a significant challenge to their practical deployment. While feature caching is a promising acceleration strategy, existing methods based on simple reusing or training-free forecasting struggle to adapt to the complex, stage-dependent dynamics of the diffusion process, often resulting in quality degradation and failing to maintain consistency with the standard denoising process. To address this, we propose a LEarnable Stage-Aware (LESA) predictor framework based on two-stage training. Our approach leverages a Kolmogorov-Arnold Network (KAN) to accurately learn temporal feature mappings from data. We further introduce a multi-stage, multi-expert architecture that assigns specialized predictors to different noise-level stages, enabling more precise and robust feature forecasting. Extensive experiments show our method achieves significant acceleration while maintaining high-fidelity generation. Experiments demonstrate 5.00x acceleration on FLUX.1-dev with minimal quality degradation (1.0% drop), 6.25x speedup on Qwen-Image with a 20.2% quality improvement over the previous SOTA (TaylorSeer), and 5.00x acceleration on HunyuanVideo with a 24.7% PSNR improvement over TaylorSeer. State-of-the-art performance on both text-to-image and text-to-video synthesis validates the effectiveness and generalization capability of our training-based framework across different models. Our code is included in the supplementary materials and will be released on GitHub.
• 摘要：扩散模型在图像和视频生成任务中取得了显着的成功。然而，扩散变压器（DiT）的高计算要求对其实际部署提出了重大挑战。虽然特征缓存是一种很有前途的加速策略，但基于简单重用或免训练预测的现有方法很难适应扩散过程的复杂、阶段相关的动态，通常会导致质量下降，并且无法保持与标准去噪过程的一致性。为了解决这个问题，我们提出了一个基于两阶段训练的 LEarnable Stage-Aware (LESA) 预测器框架。我们的方法利用柯尔莫哥洛夫-阿诺德网络（KAN）来准确地从数据中学习时间特征映射。我们进一步引入了多阶段、多专家架构，将专门的预测器分配给不同的噪声级别阶段，从而实现更精确和稳健的特征预测。大量的实验表明，我们的方法在保持高保真生成的同时实现了显着的加速。实验表明，FLUX.1-dev 上的加速为 5.00 倍，质量下降最小（下降 1.0%）；Qwen-Image 上的加速为 6.25 倍，与之前的 SOTA（TaylorSeer）相比，质量提高了 20.2%；HunyuanVideo 上的加速为 5.00 倍，PSNR 比 TaylorSeer 提高了 24.7%。文本到图像和文本到视频合成的最先进性能验证了我们基于训练的框架在不同模型上的有效性和泛化能力。我们的代码包含在补充材料中，并将在 GitHub 上发布。

Title: Probing and Bridging Geometry-Interaction Cues for Affordance Reasoning in Vision Foundation Models

• Authors: Qing Zhang, Xuesong Li, Jing Zhang
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.20501
• Pdf URL: https://arxiv.org/pdf/2602.20501
• Copy Paste: [[2602.20501]] Probing and Bridging Geometry-Interaction Cues for Affordance Reasoning in Vision Foundation Models(https://arxiv.org/abs/2602.20501)
• Keywords: generative
• Abstract: What does it mean for a visual system to truly understand affordance? We argue that this understanding hinges on two complementary capacities: geometric perception, which identifies the structural parts of objects that enable interaction, and interaction perception, which models how an agent's actions engage with those parts. To test this hypothesis, we conduct a systematic probing of Visual Foundation Models (VFMs). We find that models like DINO inherently encode part-level geometric structures, while generative models like Flux contain rich, verb-conditioned spatial attention maps that serve as implicit interaction priors. Crucially, we demonstrate that these two dimensions are not merely correlated but are composable elements of affordance. By simply fusing DINO's geometric prototypes with Flux's interaction maps in a training-free and zero-shot manner, we achieve affordance estimation competitive with weakly-supervised methods. This final fusion experiment confirms that geometric and interaction perception are the fundamental building blocks of affordance understanding in VFMs, providing a mechanistic account of how perception grounds action.
• 摘要：对于视觉系统来说，真正理解可供性意味着什么？我们认为，这种理解取决于两种互补的能力：几何感知，它识别能够实现交互的对象的结构部分；以及交互感知，它模拟代理的行为如何与这些部分交互。为了检验这个假设，我们对视觉基础模型（VFM）进行了系统的探索。我们发现像 DINO 这样的模型本质上编码部分级几何结构，而像 Flux 这样的生成模型包含丰富的、动词条件的空间注意力图，充当隐式交互先验。至关重要的是，我们证明这两个维度不仅是相关的，而且是可供组合的元素。通过以免训练和零样本的方式简单地将 DINO 的几何原型与 Flux 的交互图融合，我们实现了与弱监督方法竞争的可供性估计。最终的融合实验证实了几何和交互感知是 VFM 中可供性理解的基本构建块，提供了感知如何基于行动的机械解释。

Title: How Do Inpainting Artifacts Propagate to Language?

• Authors: Pratham Yashwante, Davit Abrahamyan, Shresth Grover, Sukruth Rao
• Subjects: cs.CV, cs.AI
• Abstract URL: https://arxiv.org/abs/2602.20520
• Pdf URL: https://arxiv.org/pdf/2602.20520
• Copy Paste: [[2602.20520]] How Do Inpainting Artifacts Propagate to Language?(https://arxiv.org/abs/2602.20520)
• Keywords: generation
• Abstract: We study how visual artifacts introduced by diffusion-based inpainting affect language generation in vision-language models. We use a two-stage diagnostic setup in which masked image regions are reconstructed and then provided to captioning models, enabling controlled comparisons between captions generated from original and reconstructed inputs. Across multiple datasets, we analyze the relationship between reconstruction fidelity and downstream caption quality. We observe consistent associations between pixel-level and perceptual reconstruction metrics and both lexical and semantic captioning performance. Additional analysis of intermediate visual representations and attention patterns shows that inpainting artifacts lead to systematic, layer-dependent changes in model behavior. Together, these results provide a practical diagnostic framework for examining how visual reconstruction quality influences language generation in multimodal systems.
• 摘要：我们研究基于扩散的修复引入的视觉伪影如何影响视觉语言模型中的语言生成。我们使用两阶段诊断设置，其中重建掩模图像区域，然后提供给字幕模型，从而实现从原始输入和重建输入生成的字幕之间的受控比较。在多个数据集中，我们分析了重建保真度和下游字幕质量之间的关系。我们观察到像素级和感知重建指标与词汇和语义字幕性能之间存在一致的关联。对中间视觉表示和注意力模式的额外分析表明，修复伪影会导致模型行为发生系统性的、依赖于层的变化。总之，这些结果提供了一个实用的诊断框架，用于检查视觉重建质量如何影响多模态系统中的语言生成。

Title: GENSR: Symbolic Regression Based in Equation Generative Space

• Authors: Qian Li, Yuxiao Hu, Juncheng Liu, Yuntian Chen
• Subjects: cs.LG, cs.SC
• Abstract URL: https://arxiv.org/abs/2602.20557
• Pdf URL: https://arxiv.org/pdf/2602.20557
• Copy Paste: [[2602.20557]] GENSR: Symbolic Regression Based in Equation Generative Space(https://arxiv.org/abs/2602.20557)
• Keywords: generative
• Abstract: Symbolic Regression (SR) tries to reveal the hidden equations behind observed data. However, most methods search within a discrete equation space, where the structural modifications of equations rarely align with their numerical behavior, leaving fitting error feedback too noisy to guide exploration. To address this challenge, we propose GenSR, a generative latent space-based SR framework following the `map construction -> coarse localization -> fine search'' paradigm. Specifically, GenSR first pretrains a dual-branch Conditional Variational Autoencoder (CVAE) to reparameterize symbolic equations into a generative latent space with symbolic continuity and local numerical smoothness. This space can be regarded as a well-structured `map'' of the equation space, providing directional signals for search. At inference, the CVAE coarsely localizes the input data to promising regions in the latent space. Then, a modified CMA-ES refines the candidate region, leveraging smooth latent gradients. From a Bayesian perspective, GenSR reframes the SR task as maximizing the conditional distribution $p(\mathrm{Equ.} \mid \mathrm{Num.})$, with CVAE training achieving this objective through the Evidence Lower Bound (ELBO). This new perspective provides a theoretical guarantee for the effectiveness of GenSR. Extensive experiments show that GenSR jointly optimizes predictive accuracy, expression simplicity, and computational efficiency, while remaining robust under noise.
• 摘要：符号回归 (SR) 试图揭示观测数据背后的隐藏方程。然而，大多数方法在离散方程空间内进行搜索，其中方程的结构修改很少与其数值行为一致，导致拟合误差反馈噪声太大而无法指导探索。为了应对这一挑战，我们提出了 GenSR，一种基于潜在空间的生成 SR 框架，遵循“地图构建 -> 粗定位 -> 精细搜索”范式。具体来说，GenSR 首先预训练双分支条件变分自动编码器 (CVAE)，将符号方程重新参数化为具有符号连续性和局部数值平滑度的生成潜在空间。该空间可以被视为方程空间的结构良好的“地图”，为搜索提供方向信号。在推理时，CVAE 将输入数据粗略地定位到潜在空间中的有希望的区域。然后，修改后的 CMA-ES 利用平滑的潜在梯度细化候选区域。从贝叶斯角度来看，GenSR 将 SR 任务重构为最大化条件分布 $p(\mathrm{Equ.} \mid \mathrm{Num.})$，CVAE 训练通过证据下界 (ELBO) 实现这一目标。这一新视角为GenSR的有效性提供了理论保证。大量实验表明，GenSR 共同优化了预测准确性、表达简单性和计算效率，同时在噪声下保持鲁棒性。

Title: Efficient and Explainable End-to-End Autonomous Driving via Masked Vision-Language-Action Diffusion

• Authors: Jiaru Zhang, Manav Gagvani, Can Cui, Juntong Peng, Ruqi Zhang, Ziran Wang
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.20577
• Pdf URL: https://arxiv.org/pdf/2602.20577
• Copy Paste: [[2602.20577]] Efficient and Explainable End-to-End Autonomous Driving via Masked Vision-Language-Action Diffusion(https://arxiv.org/abs/2602.20577)
• Keywords: generation
• Abstract: Large Language Models (LLMs) and Vision-Language Models (VLMs) have emerged as promising candidates for end-to-end autonomous driving. However, these models typically face challenges in inference latency, action precision, and explainability. Existing autoregressive approaches struggle with slow token-by-token generation, while prior diffusion-based planners often rely on verbose, general-purpose language tokens that lack explicit geometric structure. In this work, we propose Masked Vision-Language-Action Diffusion for Autonomous Driving (MVLAD-AD), a novel framework designed to bridge the gap between efficient planning and semantic explainability via a masked vision-language-action diffusion model. Unlike methods that force actions into the language space, we introduce a discrete action tokenization strategy that constructs a compact codebook of kinematically feasible waypoints from real-world driving distributions. Moreover, we propose geometry-aware embedding learning to ensure that embeddings in the latent space approximate physical geometric metrics. Finally, an action-priority decoding strategy is introduced to prioritize trajectory generation. Extensive experiments on nuScenes and derived benchmarks demonstrate that MVLAD-AD achieves superior efficiency and outperforms state-of-the-art autoregressive and diffusion baselines in planning precision, while providing high-fidelity and explainable reasoning.
• 摘要：大型语言模型（LLM）和视觉语言模型（VLM）已成为端到端自动驾驶的有希望的候选者。然而，这些模型通常面临推理延迟、动作精度和可解释性方面的挑战。现有的自回归方法难以解决逐个令牌生成缓慢的问题，而先前基于扩散的规划器通常依赖于缺乏明确几何结构的冗长的通用语言令牌。在这项工作中，我们提出了用于自动驾驶的蒙蔽视觉-语言-动作扩散（MVLAD-AD），这是一种新颖的框架，旨在通过蒙蔽视觉-语言-动作扩散模型来弥合有效规划和语义可解释性之间的差距。与将动作强制进入语言空间的方法不同，我们引入了一种离散动作标记化策略，该策略根据现实世界的驾驶分布构建运动学上可行的路径点的紧凑密码本。此外，我们提出了几何感知嵌入学习，以确保潜在空间中的嵌入近似物理几何度量。最后，引入了动作优先解码策略来优先考虑轨迹生成。对 nuScenes 和派生基准进行的大量实验表明，MVLAD-AD 实现了卓越的效率，并且在规划精度方面优于最先进的自回归和扩散基线，同时提供高保真度和可解释的推理。

Title: Is the Trigger Essential? A Feature-Based Triggerless Backdoor Attack in Vertical Federated Learning

• Authors: Yige Liu, Yiwei Lou, Che Wang, Yongzhi Cao, Hanpin Wang
• Subjects: cs.LG, cs.CR
• Abstract URL: https://arxiv.org/abs/2602.20593
• Pdf URL: https://arxiv.org/pdf/2602.20593
• Copy Paste: [[2602.20593]] Is the Trigger Essential? A Feature-Based Triggerless Backdoor Attack in Vertical Federated Learning(https://arxiv.org/abs/2602.20593)
• Keywords: generation
• Abstract: As a distributed collaborative machine learning paradigm, vertical federated learning (VFL) allows multiple passive parties with distinct features and one active party with labels to collaboratively train a model. Although it is known for the privacy-preserving capabilities, VFL still faces significant privacy and security threats from backdoor attacks. Existing backdoor attacks typically involve an attacker implanting a trigger into the model during the training phase and executing the attack by adding the trigger to the samples during the inference phase. However, in this paper, we find that triggers are not essential for backdoor attacks in VFL. In light of this, we disclose a new backdoor attack pathway in VFL by introducing a feature-based triggerless backdoor attack. This attack operates under a more stringent security assumption, where the attacker is honest-but-curious rather than malicious during the training phase. It comprises three modules: label inference for the targeted backdoor attack, poison generation with amplification and perturbation mechanisms, and backdoor execution to implement the attack. Extensive experiments on five benchmark datasets demonstrate that our attack outperforms three baseline backdoor attacks by 2 to 50 times while minimally impacting the main task. Even in VFL scenarios with 32 passive parties and only one set of auxiliary data, our attack maintains high performance. Moreover, when confronted with distinct defense strategies, our attack remains largely unaffected and exhibits strong robustness. We hope that the disclosure of this triggerless backdoor attack pathway will encourage the community to revisit security threats in VFL scenarios and inspire researchers to develop more robust and practical defense strategies.
• 摘要：作为一种分布式协作机器学习范例，垂直联合学习（VFL）允许多个具有不同特征的被动方和一个具有标签的主动方协作训练模型。尽管 VFL 以其隐私保护功能而闻名，但它仍然面临着来自后门攻击的重大隐私和安全威胁。现有的后门攻击通常涉及攻击者在训练阶段将触发器植入模型中，并在推理阶段通过将触发器添加到样本中来执行攻击。然而，在本文中，我们发现触发器对于 VFL 中的后门攻击并不是必需的。鉴于此，我们通过引入基于特征的无触发后门攻击，在 VFL 中公开了一种新的后门攻击途径。这种攻击在更严格的安全假设下进行，攻击者在训练阶段是诚实但好奇的，而不是恶意的。它包括三个模块：针对目标后门攻击的标签推断、具有放大和扰动机制的毒物生成以及用于实施攻击的后门执行。对五个基准数据集的大量实验表明，我们的攻击比三个基准后门攻击的性能高出 2 到 50 倍，同时对主要任务的影响最小。即使在有 32 个被动方且只有一组辅助数据的 VFL 场景中，我们的攻击也保持高性能。此外，当面对不同的防御策略时，我们的攻击基本上不受影响，并且表现出很强的鲁棒性。我们希望这种无触发后门攻击路径的披露能够鼓励社区重新审视 VFL 场景中的安全威胁，并激励研究人员开发更强大、更实用的防御策略。

Title: Interaction-aware Representation Modeling with Co-occurrence Consistency for Egocentric Hand-Object Parsing

• Authors: Yuejiao Su, Yi Wang, Lei Yao, Yawen Cui, Lap-Pui Chau
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.20597
• Pdf URL: https://arxiv.org/pdf/2602.20597
• Copy Paste: [[2602.20597]] Interaction-aware Representation Modeling with Co-occurrence Consistency for Egocentric Hand-Object Parsing(https://arxiv.org/abs/2602.20597)
• Keywords: generation
• Abstract: A fine-grained understanding of egocentric human-environment interactions is crucial for developing next-generation embodied agents. One fundamental challenge in this area involves accurately parsing hands and active objects. While transformer-based architectures have demonstrated considerable potential for such tasks, several key limitations remain unaddressed: 1) existing query initialization mechanisms rely primarily on semantic cues or learnable parameters, demonstrating limited adaptability to changing active objects across varying input scenes; 2) previous transformer-based methods utilize pixel-level semantic features to iteratively refine queries during mask generation, which may introduce interaction-irrelevant content into the final embeddings; and 3) prevailing models are susceptible to "interaction illusion", producing physically inconsistent predictions. To address these issues, we propose an end-to-end Interaction-aware Transformer (InterFormer), which integrates three key components, i.e., a Dynamic Query Generator (DQG), a Dual-context Feature Selector (DFS), and the Conditional Co-occurrence (CoCo) loss. The DQG explicitly grounds query initialization in the spatial dynamics of hand-object contact, enabling targeted generation of interaction-aware queries for hands and various active objects. The DFS fuses coarse interactive cues with semantic features, thereby suppressing interaction-irrelevant noise and emphasizing the learning of interactive relationships. The CoCo loss incorporates hand-object relationship constraints to enhance physical consistency in prediction. Our model achieves state-of-the-art performance on both the EgoHOS and the challenging out-of-distribution mini-HOI4D datasets, demonstrating its effectiveness and strong generalization ability. Code and models are publicly available at this https URL.
• 摘要：对以自我为中心的人类与环境相互作用的精细理解对于开发下一代实体代理至关重要。该领域的一个基本挑战涉及准确解析手和活动物体。虽然基于 Transformer 的架构在此类任务中表现出了巨大的潜力，但仍有几个关键限制尚未解决：1）现有的查询初始化机制主要依赖于语义线索或可学习参数，这表明对跨不同输入场景更改活动对象的适应性有限； 2）以前基于变压器的方法利用像素级语义特征在掩码生成期间迭代地细化查询，这可能会将与交互无关的内容引入到最终的嵌入中； 3）流行的模型容易受到“交互错觉”的影响，产生物理上不一致的预测。为了解决这些问题，我们提出了一种端到端交互感知变压器（InterFormer），它集成了三个关键组件，即动态查询生成器（DQG）、双上下文特征选择器（DFS）和条件共现（CoCo）损失。 DQG 明确地将查询初始化基于手部对象接触的空间动态，从而能够有针对性地生成手部和各种活动对象的交互感知查询。 DFS 将粗略的交互线索与语义特征融合在一起，从而抑制与交互无关的噪声并强调交互关系的学习。 CoCo 损失结合了手-物体关系约束，以增强预测的物理一致性。我们的模型在 EgoHOS 和具有挑战性的分布外迷你 HOI4D 数据集上都实现了最先进的性能，展示了其有效性和强大的泛化能力。代码和模型可通过此 https URL 公开获取。

Title: QEDBENCH: Quantifying the Alignment Gap in Automated Evaluation of University-Level Mathematical Proofs

• Authors: Santiago Gonzalez, Alireza Amiri Bavandpour, Peter Ye, Edward Zhang, Ruslans Aleksejevs, Todor Antić, Polina Baron, Sujeet Bhalerao, Shubhrajit Bhattacharya, Zachary Burton, John Byrne, Hyungjun Choi, Nujhat Ahmed Disha, Koppany István Encz, Yuchen Fang, Robert Joseph George, Ebrahim Ghorbani, Alan Goldfarb, Jing Guo, Meghal Gupta, Stefano Huber, Annika Kanckos, Minjung Kang, Hyun Jong Kim, Dino Lorenzini, Levi Lorenzo, Tianyi Mao, Giovanni Marzenta, Ariane M. Masuda, Lukas Mauth, Ana Mickovic, Andres Miniguano-Trujillo, Antoine Moulin, Wenqi Ni, Tomos Parry, Kevin Ren, Hossein Roodbarani, Mathieu Rundström, Manjil Saikia, Detchat Samart, Rebecca Steiner, Connor Stewart, Dhara Thakkar, Jeffrey Tse, Vasiliki Velona, Yunhai Xiang, Sibel Yalçın, Jun Yan, Ji Zeng, Arman Cohan, Quanquan C. Liu
• Subjects: cs.LG
• Abstract URL: https://arxiv.org/abs/2602.20629
• Pdf URL: https://arxiv.org/pdf/2602.20629
• Copy Paste: [[2602.20629]] QEDBENCH: Quantifying the Alignment Gap in Automated Evaluation of University-Level Mathematical Proofs(https://arxiv.org/abs/2602.20629)
• Keywords: generation
• Abstract: As Large Language Models (LLMs) saturate elementary benchmarks, the research frontier has shifted from generation to the reliability of automated evaluation. We demonstrate that standard "LLM-as-a-Judge" protocols suffer from a systematic Alignment Gap when applied to upper-undergraduate to early graduate level mathematics. To quantify this, we introduce QEDBench, the first large-scale dual-rubric alignment benchmark to systematically measure alignment with human experts on university-level math proofs by contrasting course-specific rubrics against expert common knowledge criteria. By deploying a dual-evaluation matrix (7 judges x 5 solvers) against 1,000+ hours of human evaluation, we reveal that certain frontier evaluators like Claude Opus 4.5, DeepSeek-V3, Qwen 2.5 Max, and Llama 4 Maverick exhibit significant positive bias (up to +0.18, +0.20, +0.30, +0.36 mean score inflation, respectively). Furthermore, we uncover a critical reasoning gap in the discrete domain: while Gemini 3.0 Pro achieves state-of-the-art performance (0.91 average human evaluation score), other reasoning models like GPT-5 Pro and Claude Sonnet 4.5 see their performance significantly degrade in discrete domains. Specifically, their average human evaluation scores drop to 0.72 and 0.63 in Discrete Math, and to 0.74 and 0.50 in Graph Theory. In addition to these research results, we also release QEDBench as a public benchmark for evaluating and improving AI judges. Our benchmark is publicly published at this https URL.
• 摘要：随着大型语言模型 (LLM) 的基本基准饱和，研究前沿已从生成转向自动评估的可靠性。我们证明，标准的“法学硕士作为法官”协议在应用于本科高年级到研究生早期水平的数学时会遇到系统性的对齐差距。为了量化这一点，我们引入了 QEDBench，这是第一个大规模双标准对齐基准，通过将特定于课程的标准与专家常识标准进行对比，系统地衡量与人类专家在大学水平数学证明上的一致性。通过针对 1,000 多个小时的人工评估部署双重评估矩阵（7 个法官 x 5 个求解器），我们发现某些前沿评估器（例如 Claude Opus 4.5、DeepSeek-V3、Qwen 2.5 Max 和 Llama 4 Maverick）表现出显着的正偏差（分别高达 +0.18、+0.20、+0.30、+0.36 平均分数膨胀）。此外，我们发现了离散领域中的一个关键推理差距：虽然 Gemini 3.0 Pro 实现了最先进的性能（人类平均评估分数为 0.91），但 GPT-5 Pro 和 Claude Sonnet 4.5 等其他推理模型在离散领域中的性能显着下降。具体来说，他们在离散数学中的平均人类评估分数下降至 0.72 和 0.63，在图论中下降至 0.74 和 0.50。除了这些研究成果之外，我们还发布了QEDBench作为评估和改进人工智能法官的公共基准。我们的基准测试在此 https URL 上公开发布。

Title: TrajGPT-R: Generating Urban Mobility Trajectory with Reinforcement Learning-Enhanced Generative Pre-trained Transformer

• Authors: Jiawei Wang, Chuang Yang, Jiawei Yong, Xiaohang Xu, Hongjun Wang, Noboru Koshizuka, Shintaro Fukushima, Ryosuke Shibasaki, Renhe Jiang
• Subjects: cs.LG, cs.AI
• Abstract URL: https://arxiv.org/abs/2602.20643
• Pdf URL: https://arxiv.org/pdf/2602.20643
• Copy Paste: [[2602.20643]] TrajGPT-R: Generating Urban Mobility Trajectory with Reinforcement Learning-Enhanced Generative Pre-trained Transformer(https://arxiv.org/abs/2602.20643)
• Keywords: generation, generative
• Abstract: Mobility trajectories are essential for understanding urban dynamics and enhancing urban planning, yet access to such data is frequently hindered by privacy concerns. This research introduces a transformative framework for generating large-scale urban mobility trajectories, employing a novel application of a transformer-based model pre-trained and fine-tuned through a two-phase process. Initially, trajectory generation is conceptualized as an offline reinforcement learning (RL) problem, with a significant reduction in vocabulary space achieved during tokenization. The integration of Inverse Reinforcement Learning (IRL) allows for the capture of trajectory-wise reward signals, leveraging historical data to infer individual mobility preferences. Subsequently, the pre-trained model is fine-tuned using the constructed reward model, effectively addressing the challenges inherent in traditional RL-based autoregressive methods, such as long-term credit assignment and handling of sparse reward environments. Comprehensive evaluations on multiple datasets illustrate that our framework markedly surpasses existing models in terms of reliability and diversity. Our findings not only advance the field of urban mobility modeling but also provide a robust methodology for simulating urban data, with significant implications for traffic management and urban development planning. The implementation is publicly available at this https URL.
• 摘要：移动轨迹对于了解城市动态和加强城市规划至关重要，但访问此类数据经常受到隐私问题的阻碍。这项研究引入了一种用于生成大规模城市出行轨迹的变革框架，采用了通过两阶段过程进行预训练和微调的基于变压器的模型的新颖应用。最初，轨迹生成被概念化为离线强化学习（RL）问题，在标记化过程中显着减少了词汇空间。反向强化学习 (IRL) 的集成可以捕获轨迹奖励信号，利用历史数据推断个人移动偏好。随后，使用构建的奖励模型对预训练模型进行微调，有效解决传统基于强化学习的自回归方法固有的挑战，例如长期信用分配和稀疏奖励环境的处理。对多个数据集的综合评估表明，我们的框架在可靠性和多样性方面明显优于现有模型。我们的研究结果不仅推动了城市交通建模领域的发展，而且还提供了模拟城市数据的可靠方法，对交通管理和城市发展规划具有重大影响。该实现可通过此 https URL 公开获得。

Title: AnimeAgent: Is the Multi-Agent via Image-to-Video models a Good Disney Storytelling Artist?

• Authors: Hailong Yan, Shice Liu, Tao Wang, Xiangtao Zhang, Yijie Zhong, Jinwei Chen, Le Zhang, Bo Li
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.20664
• Pdf URL: https://arxiv.org/pdf/2602.20664
• Copy Paste: [[2602.20664]] AnimeAgent: Is the Multi-Agent via Image-to-Video models a Good Disney Storytelling Artist?(https://arxiv.org/abs/2602.20664)
• Keywords: generation
• Abstract: Custom Storyboard Generation (CSG) aims to produce high-quality, multi-character consistent storytelling. Current approaches based on static diffusion models, whether used in a one-shot manner or within multi-agent frameworks, face three key limitations: (1) Static models lack dynamic expressiveness and often resort to "copy-paste" pattern. (2) One-shot inference cannot iteratively correct missing attributes or poor prompt adherence. (3) Multi-agents rely on non-robust evaluators, ill-suited for assessing stylized, non-realistic animation. To address these, we propose AnimeAgent, the first Image-to-Video (I2V)-based multi-agent framework for CSG. Inspired by Disney's "Combination of Straight Ahead and Pose to Pose" workflow, AnimeAgent leverages I2V's implicit motion prior to enhance consistency and expressiveness, while a mixed subjective-objective reviewer enables reliable iterative refinement. We also collect a human-annotated CSG benchmark with ground-truth. Experiments show AnimeAgent achieves SOTA performance in consistency, prompt fidelity, and stylization.
• 摘要：自定义故事板生成 (CSG) 旨在制作高质量、多角色一致的故事讲述。当前基于静态扩散模型的方法，无论是一次性使用还是在多智能体框架内使用，都面临三个关键限制：（1）静态模型缺乏动态表达能力，并且经常采用“复制粘贴”模式。 (2) 一次性推理无法迭代地纠正缺失的属性或提示依从性差。 (3) 多智能体依赖于非鲁棒评估器，不适合评估风格化、非现实的动画。为了解决这些问题，我们提出了 AnimeAgent，这是第一个基于图像到视频 (I2V) 的 CSG 多代理框架。受迪士尼“直线前进和姿势到姿势的组合”工作流程的启发，AnimeAgent 在增强一致性和表现力之前利用 I2V 的隐式运动，而混合主客观审阅器可实现可靠的迭代细化。我们还收集了具有真实性的人工注释 CSG 基准。实验表明 AnimeAgent 在一致性、提示保真度和风格化方面实现了 SOTA 性能。

Title: BoxSplitGen: A Generative Model for 3D Part Bounding Boxes in Varying Granularity

• Authors: Juil Koo, Wei-Tung Lin, Chanho Park, Chanhyeok Park, Minhyuk Sung
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.20666
• Pdf URL: https://arxiv.org/pdf/2602.20666
• Copy Paste: [[2602.20666]] BoxSplitGen: A Generative Model for 3D Part Bounding Boxes in Varying Granularity(https://arxiv.org/abs/2602.20666)
• Keywords: generation, generative
• Abstract: Human creativity follows a perceptual process, moving from abstract ideas to finer details during creation. While 3D generative models have advanced dramatically, models specifically designed to assist human imagination in 3D creation -- particularly for detailing abstractions from coarse to fine -- have not been explored. We propose a framework that enables intuitive and interactive 3D shape generation by iteratively splitting bounding boxes to refine the set of bounding boxes. The main technical components of our framework are two generative models: the box-splitting generative model and the box-to-shape generative model. The first model, named BoxSplitGen, generates a collection of 3D part bounding boxes with varying granularity by iteratively splitting coarse bounding boxes. It utilizes part bounding boxes created through agglomerative merging and learns the reverse of the merging process -- the splitting sequences. The model consists of two main components: the first learns the categorical distribution of the box to be split, and the second learns the distribution of the two new boxes, given the set of boxes and the indication of which box to split. The second model, the box-to-shape generative model, is trained by leveraging the 3D shape priors learned by an existing 3D diffusion model while adapting the model to incorporate bounding box conditioning. In our experiments, we demonstrate that the box-splitting generative model outperforms token prediction models and the inpainting approach with an unconditional diffusion model. Also, we show that our box-to-shape model, based on a state-of-the-art 3D diffusion model, provides superior results compared to a previous model.
• 摘要：人类的创造力遵循一个感知过程，在创造过程中从抽象的想法转向更精细的细节。虽然 3D 生成模型取得了巨大进步，但专门为帮助人类在 3D 创作中发挥想象力而设计的模型（尤其是从粗到细的细节抽象）尚未得到探索。我们提出了一个框架，通过迭代分割边界框来细化边界框集，从而实现直观且交互式的 3D 形状生成。我们框架的主要技术组件是两个生成模型：盒子分割生成模型和盒子到形状生成模型。第一个模型名为 BoxSplitGen，通过迭代分割粗边界框来生成具有不同粒度的 3D 零件边界框集合。它利用通过凝聚合并创建的部分边界框，并学习合并过程的逆过程——分裂序列。该模型由两个主要组件组成：第一个组件学习要拆分的框的分类分布，第二个组件在给定框集和要拆分的框的指示的情况下学习两个新框的分布。第二个模型是框到形状生成模型，它通过利用现有 3D 扩散模型学习到的 3D 形状先验进行训练，同时调整模型以合并边界框调节。在我们的实验中，我们证明了盒子分割生成模型优于令牌预测模型和使用无条件扩散模型的修复方法。此外，我们还表明，我们的盒子到形状模型基于最先进的 3D 扩散模型，与之前的模型相比，提供了更出色的结果。

Title: BBQ-to-Image: Numeric Bounding Box and Qolor Control in Large-Scale Text-to-Image Models

• Authors: Eliran Kachlon, Alexander Visheratin, Nimrod Sarid, Tal Hacham, Eyal Gutflaish, Saar Huberman, Hezi Zisman, David Ruppin, Ron Mokady
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.20672
• Pdf URL: https://arxiv.org/pdf/2602.20672
• Copy Paste: [[2602.20672]] BBQ-to-Image: Numeric Bounding Box and Qolor Control in Large-Scale Text-to-Image Models(https://arxiv.org/abs/2602.20672)
• Keywords: generation
• Abstract: Text-to-image models have rapidly advanced in realism and controllability, with recent approaches leveraging long, detailed captions to support fine-grained generation. However, a fundamental parametric gap remains: existing models rely on descriptive language, whereas professional workflows require precise numeric control over object location, size, and color. In this work, we introduce BBQ, a large-scale text-to-image model that directly conditions on numeric bounding boxes and RGB triplets within a unified structured-text framework. We obtain precise spatial and chromatic control by training on captions enriched with parametric annotations, without architectural modifications or inference-time optimization. This also enables intuitive user interfaces such as object dragging and color pickers, replacing ambiguous iterative prompting with precise, familiar controls. Across comprehensive evaluations, BBQ achieves strong box alignment and improves RGB color fidelity over state-of-the-art baselines. More broadly, our results support a new paradigm in which user intent is translated into an intermediate structured language, consumed by a flow-based transformer acting as a renderer and naturally accommodating numeric parameters.
• 摘要：文本到图像模型在真实性和可控性方面迅速进步，最近的方法利用长而详细的标题来支持细粒度的生成。然而，一个基本的参数差距仍然存在：现有模型依赖于描述性语言，而专业工作流程需要对对象位置、大小和颜色进行精确的数字控制。在这项工作中，我们介绍了 BBQ，一种大规模文本到图像模型，它直接以统一结构化文本框架内的数字边界框和 RGB 三元组为条件。我们通过对富含参数注释的标题进行训练来获得精确的空间和色彩控制，无需架构修改或推理时间优化。这还支持直观的用户界面，例如对象拖动和颜色选择器，用精确、熟悉的控件取代模糊的迭代提示。通过综合评估，BBQ 实现了强大的盒子对齐，并在最先进的基线上提高了 RGB 颜色保真度。更广泛地说，我们的结果支持一种新的范例，其中用户意图被转换为中间结构化语言，由充当渲染器并自然容纳数字参数的基于流的转换器使用。

Title: GA-Drive: Geometry-Appearance Decoupled Modeling for Free-viewpoint Driving Scene Generatio

• Authors: Hao Zhang, Lue Fan, Qitai Wang, Wenbo Li, Zehuan Wu, Lewei Lu, Zhaoxiang Zhang, Hongsheng Li
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.20673
• Pdf URL: https://arxiv.org/pdf/2602.20673
• Copy Paste: [[2602.20673]] GA-Drive: Geometry-Appearance Decoupled Modeling for Free-viewpoint Driving Scene Generatio(https://arxiv.org/abs/2602.20673)
• Keywords: generation
• Abstract: A free-viewpoint, editable, and high-fidelity driving simulator is crucial for training and evaluating end-to-end autonomous driving systems. In this paper, we present GA-Drive, a novel simulation framework capable of generating camera views along user-specified novel trajectories through Geometry-Appearance Decoupling and Diffusion-Based Generation. Given a set of images captured along a recorded trajectory and the corresponding scene geometry, GA-Drive synthesizes novel pseudo-views using geometry information. These pseudo-views are then transformed into photorealistic views using a trained video diffusion model. In this way, we decouple the geometry and appearance of scenes. An advantage of such decoupling is its support for appearance editing via state-of-the-art video-to-video editing techniques, while preserving the underlying geometry, enabling consistent edits across both original and novel trajectories. Extensive experiments demonstrate that GA-Drive substantially outperforms existing methods in terms of NTA-IoU, NTL-IoU, and FID scores.
• 摘要：自由视角、可编辑且高保真的驾驶模拟器对于训练和评估端到端自动驾驶系统至关重要。在本文中，我们提出了 GA-Drive，这是一种新颖的模拟框架，能够通过几何外观解耦和基于扩散的生成沿着用户指定的新颖轨迹生成相机视图。给定沿着记录轨迹捕获的一组图像和相应的场景几何形状，GA-Drive 使用几何信息合成新颖的伪视图。然后使用经过训练的视频扩散模型将这些伪视图转换为逼真的视图。通过这种方式，我们将场景的几何形状和外观解耦。这种解耦的一个优点是它支持通过最先进的视频到视频编辑技术进行外观编辑，同时保留底层几何形状，从而能够在原始和新颖的轨迹上进行一致的编辑。大量实验表明，GA-Drive 在 NTA-IoU、NTL-IoU 和 FID 分数方面明显优于现有方法。

Title: RAYNOVA: 3D-Geometry-Free Auto-Regressive Driving World Modeling with Unified Spatio-Temporal Representation

• Authors: Yichen Xie, Chensheng Peng, Mazen Abdelfattah, Yihan Hu, Jiezhi Yang, Eric Higgins, Ryan Brigden, Masayoshi Tomizuka, Wei Zhan
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.20685
• Pdf URL: https://arxiv.org/pdf/2602.20685
• Copy Paste: [[2602.20685]] RAYNOVA: 3D-Geometry-Free Auto-Regressive Driving World Modeling with Unified Spatio-Temporal Representation(https://arxiv.org/abs/2602.20685)
• Keywords: generation
• Abstract: World foundation models aim to simulate the evolution of the real world with physically plausible behavior. Unlike prior methods that handle spatial and temporal correlations separately, we propose RAYNOVA, a geometry-free world model that employs a dual-causal autoregressive framework. It follows both scale-wise and temporal topological orders in the autoregressive process, and leverages global attention for unified 4D spatio-temporal reasoning. Different from existing works that impose strong 3D geometric priors, RAYNOVA constructs an isotropic spatio-temporal representation across views, frames, and scales based on relative Plücker-ray positional encoding, enabling robust generalization to diverse camera setups and ego motions. We further introduce a recurrent training paradigm to alleviate distribution drift in long-horizon video generation. RAYNOVA achieves state-of-the-art multi-view video generation results on nuScenes, while offering higher throughput and strong controllability under diverse input conditions, generalizing to novel views and camera configurations without explicit 3D scene representation. Our code will be released at this http URL.
• 摘要：世界基础模型旨在通过物理上合理的行为来模拟现实世界的演化。与之前分别处理空间和时间相关性的方法不同，我们提出了 RAYNOVA，一种采用双因果自回归框架的无几何世界模型。它在自回归过程中遵循尺度和时间拓扑顺序，并利用全局注意力进行统一的 4D 时空推理。与强加强 3D 几何先验的现有作品不同，RAYNOVA 基于相对 Plücker 射线位置编码构建了跨视图、帧和尺度的各向同性时空表示，从而能够对不同的相机设置和自我运动进行稳健的泛化。我们进一步引入了一种循环训练范例，以减轻长视野视频生成中的分布漂移。 RAYNOVA 在 nuScenes 上实现了最先进的多视图视频生成结果，同时在不同的输入条件下提供更高的吞吐量和强大的可控性，推广到新颖的视图和相机配置，而无需明确的 3D 场景表示。我们的代码将在此 http URL 发布。

Title: Monocular Endoscopic Tissue 3D Reconstruction with Multi-Level Geometry Regularization

• Authors: Yangsen Chen, Hao Wang
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.20718
• Pdf URL: https://arxiv.org/pdf/2602.20718
• Copy Paste: [[2602.20718]] Monocular Endoscopic Tissue 3D Reconstruction with Multi-Level Geometry Regularization(https://arxiv.org/abs/2602.20718)
• Keywords: generation
• Abstract: Reconstructing deformable endoscopic tissues is crucial for achieving robot-assisted surgery. However, 3D Gaussian Splatting-based approaches encounter challenges in achieving consistent tissue surface reconstruction, while existing NeRF-based methods lack real-time rendering capabilities. In pursuit of both smooth deformable surfaces and real-time rendering, we introduce a novel approach based on 3D Gaussian Splatting. Specifically, we introduce surface-aware reconstruction, initially employing a Sign Distance Field-based method to construct a mesh, subsequently utilizing this mesh to constrain the Gaussian Splatting reconstruction process. Furthermore, to ensure the generation of physically plausible deformations, we incorporate local rigidity and global non-rigidity restrictions to guide Gaussian deformation, tailored for the highly deformable nature of soft endoscopic tissue. Based on 3D Gaussian Splatting, our proposed method delivers a fast rendering process and smooth surface appearances. Quantitative and qualitative analysis against alternative methodologies shows that our approach achieves solid reconstruction quality in both textures and geometries.
• 摘要：重建可变形的内窥镜组织对于实现机器人辅助手术至关重要。然而，基于 3D 高斯溅射的方法在实现一致的组织表面重建方面遇到了挑战，而现有的基于 NeRF 的方法缺乏实时渲染功能。为了追求平滑的可变形表面和实时渲染，我们引入了一种基于 3D 高斯泼溅的新颖方法。具体来说，我们引入了表面感知重建，最初采用基于符号距离场的方法来构造网格，随后利用该网格来约束高斯泼溅重建过程。此外，为了确保生成物理上合理的变形，我们结合了局部刚性和全局非刚性限制来指导高斯变形，专为软内窥镜组织的高度变形性质而定制。基于 3D Gaussian Splatting，我们提出的方法可提供快速渲染过程和平滑的表面外观。针对替代方法的定量和定性分析表明，我们的方法在纹理和几何形状方面都实现了可靠的重建质量。

Title: CleanStyle: Plug-and-Play Style Conditioning Purification for Text-to-Image Stylization

• Authors: Xiaoman Feng, Mingkun Lei, Yang Wang, Dingwen Fu, Chi Zhang
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.20721
• Pdf URL: https://arxiv.org/pdf/2602.20721
• Copy Paste: [[2602.20721]] CleanStyle: Plug-and-Play Style Conditioning Purification for Text-to-Image Stylization(https://arxiv.org/abs/2602.20721)
• Keywords: generation
• Abstract: Style transfer in diffusion models enables controllable visual generation by injecting the style of a reference image. However, recent encoder-based methods, while efficient and tuning-free, often suffer from content leakage, where semantic elements from the style image undesirably appear in the output, impairing prompt fidelity and stylistic consistency. In this work, we introduce CleanStyle, a plug-and-play framework that filters out content-related noise from the style embedding without retraining. Motivated by empirical analysis, we observe that such leakage predominantly stems from the tail components of the style embedding, which are isolated via Singular Value Decomposition (SVD). To address this, we propose CleanStyleSVD (CS-SVD), which dynamically suppresses tail components using a time-aware exponential schedule, providing clean, style-preserving conditional embeddings throughout the denoising process. Furthermore, we present Style-Specific Classifier-Free Guidance (SS-CFG), which reuses the suppressed tail components to construct style-aware unconditional inputs. Unlike conventional methods that use generic negative embeddings (e.g., zero vectors), SS-CFG introduces targeted negative signals that reflect style-specific but prompt-irrelevant visual elements. This enables the model to effectively suppress these distracting patterns during generation, thereby improving prompt fidelity and enhancing the overall visual quality of stylized outputs. Our approach is lightweight, interpretable, and can be seamlessly integrated into existing encoder-based diffusion models without retraining. Extensive experiments demonstrate that CleanStyle substantially reduces content leakage, improves stylization quality and improves prompt alignment across a wide range of style references and prompts.
• 摘要：扩散模型中的风格迁移通过注入参考图像的风格来实现可控的视觉生成。然而，最近基于编码器的方法虽然高效且无需调整，但经常遭受内容泄漏，其中来自风格图像的语义元素不合需要地出现在输出中，损害提示保真度和风格一致性。在这项工作中，我们引入了 CleanStyle，这是一个即插即用的框架，可以从样式嵌入中过滤掉与内容相关的噪音，而无需重新训练。在实证分析的推动下，我们观察到这种泄漏主要源于样式嵌入的尾部组件，这些组件通过奇异值分解（SVD）进行隔离。为了解决这个问题，我们提出 CleanStyleSVD (CS-SVD)，它使用时间感知的指数计划动态抑制尾部组件，在整个去噪过程中提供干净、保留风格的条件嵌入。此外，我们提出了特定于风格的无分类器指导（SS-CFG），它重用抑制的尾部组件来构造风格感知的无条件输入。与使用通用负嵌入（例如零向量）的传统方法不同，SS-CFG 引入了有针对性的负信号，这些信号反映特定于风格但提示不相关的视觉元素。这使得模型能够在生成过程中有效抑制这些分散注意力的模式，从而提高提示保真度并增强风格化输出的整体视觉质量。我们的方法是轻量级的、可解释的，并且可以无缝集成到现有的基于编码器的扩散模型中，而无需重新训练。大量实验表明，CleanStyle 大大减少了内容泄漏，提高了样式化质量，并改进了各种样式引用和提示之间的提示对齐。

Title: Bridging Physically Based Rendering and Diffusion Models with Stochastic Differential Equation

• Authors: Junwei Shu, Wenjie Liu, Changgu Chen, Hantang Liu, Yang Li, Changbo Wang
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.20725
• Pdf URL: https://arxiv.org/pdf/2602.20725
• Copy Paste: [[2602.20725]] Bridging Physically Based Rendering and Diffusion Models with Stochastic Differential Equation(https://arxiv.org/abs/2602.20725)
• Keywords: generative
• Abstract: Diffusion-based image generators excel at producing realistic content from text or image conditions, but they offer only limited explicit control over low-level, physically grounded shading and material properties. In contrast, physically based rendering (PBR) offers fine-grained physical control but lacks prompt-driven flexibility. Although these two paradigms originate from distinct communities, both share a common evolution -- from noisy observations to clean images. In this paper, we propose a unified stochastic formulation that bridges Monte Carlo rendering and diffusion-based generative modeling. First, a general stochastic differential equation (SDE) formulation for Monte Carlo integration under the Central Limit Theorem is modeled. Through instantiation via physically based path tracing, we convert it into a physically grounded SDE representation. Moreover, we provide a systematic analysis of how the physical characteristics of path tracing can be extended to existing diffusion models from the perspective of noise variance. Extensive experiments across multiple tasks show that our method can exert physically grounded control over diffusion-generated results, covering tasks such as rendering and material editing.
• 摘要：基于扩散的图像生成器擅长根据文本或图像条件生成逼真的内容，但它们仅对低级、物理基础的着色和材质属性提供有限的显式控制。相比之下，基于物理的渲染 (PBR) 提供细粒度的物理控制，但缺乏提示驱动的灵活性。尽管这两种范式起源于不同的社区，但两者都有一个共同的演变——从嘈杂的观察到干净的图像。在本文中，我们提出了一种统一的随机公式，将蒙特卡罗渲染和基于扩散的生成建模联系起来。首先，对中心极限定理下蒙特卡罗积分的一般随机微分方程 (SDE) 公式进行建模。通过基于物理的路径跟踪的实例化，我们将其转换为基于物理的 SDE 表示。此外，我们从噪声方差的角度系统地分析了如何将路径追踪的物理特性扩展到现有的扩散模型。跨多个任务的广泛实验表明，我们的方法可以对扩散生成的结果施加物理基础的控制，涵盖渲染和材质编辑等任务。

Title: Deep unfolding of MCMC kernels: scalable, modular & explainable GANs for high-dimensional posterior sampling

• Authors: Jonathan Spence, Tobías I. Liaudat, Konstantinos Zygalakis, Marcelo Pereyra
• Subjects: cs.LG
• Abstract URL: https://arxiv.org/abs/2602.20758
• Pdf URL: https://arxiv.org/pdf/2602.20758
• Copy Paste: [[2602.20758]] Deep unfolding of MCMC kernels: scalable, modular & explainable GANs for high-dimensional posterior sampling(https://arxiv.org/abs/2602.20758)
• Keywords: generative
• Abstract: Markov chain Monte Carlo (MCMC) methods are fundamental to Bayesian computation, but can be computationally intensive, especially in high-dimensional settings. Push-forward generative models, such as generative adversarial networks (GANs), variational auto-encoders and normalising flows offer a computationally efficient alternative for posterior sampling. However, push-forward models are opaque as they lack the modularity of Bayes Theorem, leading to poor generalisation with respect to changes in the likelihood function. In this work, we introduce a novel approach to GAN architecture design by applying deep unfolding to Langevin MCMC algorithms. This paradigm maps fixed-step iterative algorithms onto modular neural networks, yielding architectures that are both flexible and amenable to interpretation. Crucially, our design allows key model parameters to be specified at inference time, offering robustness to changes in the likelihood parameters. We train these unfolded samplers end-to-end using a supervised regularized Wasserstein GAN framework for posterior sampling. Through extensive Bayesian imaging experiments, we demonstrate that our proposed approach achieves high sampling accuracy and excellent computational efficiency, while retaining the physics consistency, adaptability and interpretability of classical MCMC strategies.
• 摘要：马尔可夫链蒙特卡罗 (MCMC) 方法是贝叶斯计算的基础，但计算量可能很大，尤其是在高维设置中。前推生成模型，例如生成对抗网络 (GAN)、变分自动编码器和归一化流，为后验采样提供了计算高效的替代方案。然而，前推模型是不透明的，因为它们缺乏贝叶斯定理的模块化，导致对似然函数变化的泛化能力较差。在这项工作中，我们通过将深度展开应用于 Langevin MCMC 算法，介绍了一种新颖的 GAN 架构设计方法。这种范例将固定步长迭代算法映射到模块化神经网络上，产生既灵活又易于解释的架构。至关重要的是，我们的设计允许在推理时指定关键模型参数，从而为似然参数的变化提供鲁棒性。我们使用监督正则化 Wasserstein GAN 框架对这些展开的采样器进行端到端训练，以进行后验采样。通过广泛的贝叶斯成像实验，我们证明了我们提出的方法实现了高采样精度和出色的计算效率，同时保留了经典 MCMC 策略的物理一致性、适应性和可解释性。

Title: MUSE: Harnessing Precise and Diverse Semantics for Few-Shot Whole Slide Image Classification

• Authors: Jiahao Xu, Sheng Huang, Xin Zhang, Zhixiong Nan, Jiajun Dong, Nankun Mu
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.20873
• Pdf URL: https://arxiv.org/pdf/2602.20873
• Copy Paste: [[2602.20873]] MUSE: Harnessing Precise and Diverse Semantics for Few-Shot Whole Slide Image Classification(https://arxiv.org/abs/2602.20873)
• Keywords: generation
• Abstract: In computational pathology, few-shot whole slide image classification is primarily driven by the extreme scarcity of expert-labeled slides. Recent vision-language methods incorporate textual semantics generated by large language models, but treat these descriptions as static class-level priors that are shared across all samples and lack sample-wise refinement. This limits both the diversity and precision of visual-semantic alignment, hindering generalization under limited supervision. To overcome this, we propose the stochastic MUlti-view Semantic Enhancement (MUSE), a framework that first refines semantic precision via sample-wise adaptation and then enhances semantic richness through retrieval-augmented multi-view generation. Specifically, MUSE introduces Sample-wise Fine-grained Semantic Enhancement (SFSE), which yields a fine-grained semantic prior for each sample through MoE-based adaptive visual-semantic interaction. Guided by this prior, Stochastic Multi-view Model Optimization (SMMO) constructs an LLM-generated knowledge base of diverse pathological descriptions per class, then retrieves and stochastically integrates multiple matched textual views during training. These dynamically selected texts serve as enriched semantic supervisions to stochastically optimize the vision-language model, promoting robustness and mitigating overfitting. Experiments on three benchmark WSI datasets show that MUSE consistently outperforms existing vision-language baselines in few-shot settings, demonstrating that effective few-shot pathology learning requires not only richer semantic sources but also their active and sample-aware semantic optimization. Our code is available at: this https URL.
• 摘要：在计算病理学中，少镜头全幻灯片图像分类主要是由专家标记的幻灯片的极度稀缺驱动的。最近的视觉语言方法结合了大型语言模型生成的文本语义，但将这些描述视为静态类级先验，这些先验在所有样本之间共享，并且缺乏样本方面的细化。这限制了视觉语义对齐的多样性和精确度，阻碍了有限监督下的泛化。为了克服这个问题，我们提出了随机多视图语义增强（MUSE），该框架首先通过样本自适应来提高语义精度，然后通过检索增强的多视图生成来增强语义丰富度。具体来说，MUSE 引入了样本级细粒度语义增强 (SFSE)，它通过基于 MoE 的自适应视觉语义交互为每个样本生成细粒度语义先验。在此先验的指导下，随机多视图模型优化（SMMO）构建了一个由法学硕士生成的每个类别的不同病理描述的知识库，然后在训练期间检索并随机集成多个匹配的文本视图。这些动态选择的文本作为丰富的语义监督来随机优化视觉语言模型，提高鲁棒性并减轻过度拟合。在三个基准 WSI 数据集上进行的实验表明，MUSE 在少样本设置中始终优于现有的视觉语言基线，这表明有效的少样本病理学学习不仅需要更丰富的语义源，还需要它们的主动和样本感知语义优化。我们的代码位于：此 https URL。

Title: When Safety Collides: Resolving Multi-Category Harmful Conflicts in Text-to-Image Diffusion via Adaptive Safety Guidance

• Authors: Yongli Xiang, Ziming Hong, Zhaoqing Wang, Xiangyu Zhao, Bo Han, Tongliang Liu
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.20880
• Pdf URL: https://arxiv.org/pdf/2602.20880
• Copy Paste: [[2602.20880]] When Safety Collides: Resolving Multi-Category Harmful Conflicts in Text-to-Image Diffusion via Adaptive Safety Guidance(https://arxiv.org/abs/2602.20880)
• Keywords: generation, generative
• Abstract: Text-to-Image (T2I) diffusion models have demonstrated significant advancements in generating high-quality images, while raising potential safety concerns regarding harmful content generation. Safety-guidance-based methods have been proposed to mitigate harmful outputs by steering generation away from harmful zones, where the zones are averaged across multiple harmful categories based on predefined keywords. However, these approaches fail to capture the complex interplay among different harm categories, leading to "harmful conflicts" where mitigating one type of harm may inadvertently amplify another, thus increasing overall harmful rate. To address this issue, we propose Conflict-aware Adaptive Safety Guidance (CASG), a training-free framework that dynamically identifies and applies the category-aligned safety direction during generation. CASG is composed of two components: (i) Conflict-aware Category Identification (CaCI), which identifies the harmful category most aligned with the model's evolving generative state, and (ii) Conflict-resolving Guidance Application (CrGA), which applies safety steering solely along the identified category to avoid multi-category interference. CASG can be applied to both latent-space and text-space safeguards. Experiments on T2I safety benchmarks demonstrate CASG's state-of-the-art performance, reducing the harmful rate by up to 15.4% compared to existing methods.
• 摘要：文本到图像 (T2I) 扩散模型在生成高质量图像方面取得了显着进步，同时引发了有关有害内容生成的潜在安全问题。人们提出了基于安全指导的方法，通过引导发电远离有害区域来减轻有害输出，其中这些区域根据预定义的关键字在多个有害类别中进行平均。然而，这些方法未能捕捉到不同危害类别之间复杂的相互作用，从而导致“有害冲突”，即减轻一种危害可能会无意中放大另一种危害，从而增加总体危害率。为了解决这个问题，我们提出了冲突感知自适应安全指南（CASG），这是一个无需培训的框架，可以在生成过程中动态识别和应用类别一致的安全方向。 CASG 由两个部分组成：(i) 冲突感知类别识别 (CaCI)，它识别与模型不断发展的生成状态最相符的有害类别；(ii) 冲突解决指导应用程序 (CrGA)，它仅沿着已识别的类别应用安全指导，以避免多类别干扰。 CASG 可应用于潜在空间和文本空间保护。 T2I安全基准实验证明了CASG最先进的性能，与现有方法相比，有害率降低了高达15.4%。

Title: TextPecker: Rewarding Structural Anomaly Quantification for Enhancing Visual Text Rendering

• Authors: Hanshen Zhu, Yuliang Liu, Xuecheng Wu, An-Lan Wang, Hao Feng, Dingkang Yang, Chao Feng, Can Huang, Jingqun Tang, Xiang Bai
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.20903
• Pdf URL: https://arxiv.org/pdf/2602.20903
• Copy Paste: [[2602.20903]] TextPecker: Rewarding Structural Anomaly Quantification for Enhancing Visual Text Rendering(https://arxiv.org/abs/2602.20903)
• Keywords: generation
• Abstract: Visual Text Rendering (VTR) remains a critical challenge in text-to-image generation, where even advanced models frequently produce text with structural anomalies such as distortion, blurriness, and misalignment. However, we find that leading MLLMs and specialist OCR models largely fail to perceive these structural anomalies, creating a critical bottleneck for both VTR evaluation and RL-based optimization. As a result, even state-of-the-art generators (e.g., SeedDream4.0, Qwen-Image) still struggle to render structurally faithful text. To address this, we propose TextPecker, a plug-and-play structural anomaly perceptive RL strategy that mitigates noisy reward signals and works with any textto-image generator. To enable this capability, we construct a recognition dataset with character-level structural-anomaly annotations and develop a stroke-editing synthesis engine to expand structural-error coverage. Experiments show that TextPecker consistently improves diverse text-to-image models; even on the well-optimized Qwen-Image, it significantly yields average gains of 4% in structural fidelity and 8.7% in semantic alignment for Chinese text rendering, establishing a new state-of-the-art in high-fidelity VTR. Our work fills a gap in VTR optimization, providing a foundational step towards reliable and structural faithful visual text generation.
• 摘要：视觉文本渲染 (VTR) 仍然是文本到图像生成中的一个关键挑战，即使是先进的模型也经常生成具有结构异常的文本，例如扭曲、模糊和未对齐。然而，我们发现领先的 MLLM 和专业 OCR 模型在很大程度上无法感知这些结构异常，从而为 VTR 评估和基于 RL 的优化造成了关键瓶颈。因此，即使是最先进的生成器（例如 SeedDream4.0、Qwen-Image）仍然难以渲染结构上忠实的文本。为了解决这个问题，我们提出了 TextPecker，这是一种即插即用的结构异常感知 RL 策略，可以减轻嘈杂的奖励信号，并可与任何文本到图像生成器配合使用。为了实现此功能，我们构建了一个具有字符级结构异常注释的识别数据集，并开发了一个笔画编辑合成引擎来扩展结构错误覆盖范围。实验表明，TextPecker 持续改进了各种文本到图像模型；即使在优化良好的 Qwen-Image 上，中文文本渲染的结构保真度平均提高 4%，语义对齐平均提高 8.7%，建立了高保真 VTR 的新的最先进技术。我们的工作填补了 VTR 优化的空白，为生成可靠且结构忠实的视觉文本提供了基础步骤。

Title: Are Multimodal Large Language Models Good Annotators for Image Tagging?

• Authors: Ming-Kun Xie, Jia-Hao Xiao, Zhiqiang Kou, Zhongnian Li, Gang Niu, Masashi Sugiyama
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.20972
• Pdf URL: https://arxiv.org/pdf/2602.20972
• Copy Paste: [[2602.20972]] Are Multimodal Large Language Models Good Annotators for Image Tagging?(https://arxiv.org/abs/2602.20972)
• Keywords: generation
• Abstract: Image tagging, a fundamental vision task, traditionally relies on human-annotated datasets to train multi-label classifiers, which incurs significant labor and costs. While Multimodal Large Language Models (MLLMs) offer promising potential to automate annotation, their capability to replace human annotators remains underexplored. This paper aims to analyze the gap between MLLM-generated and human annotations and to propose an effective solution that enables MLLM-based annotation to replace manual labeling. Our analysis of MLLM annotations reveals that, under a conservative estimate, MLLMs can reduce annotation cost to as low as one-thousandth of the human cost, mainly accounting for GPU usage, which is nearly negligible compared to manual efforts. Their annotation quality reaches about 50\% to 80\% of human performance, while achieving over 90\% performance on downstream training this http URL by these findings, we propose TagLLM, a novel framework for image tagging, which aims to narrow the gap between MLLM-generated and human annotations. TagLLM comprises two components: Candidates generation, which employs structured group-wise prompting to efficiently produce a compact candidate set that covers as many true labels as possible while reducing subsequent annotation workload; and label disambiguation, which interactively calibrates the semantic concept of categories in the prompts and effectively refines the candidate labels. Extensive experiments show that TagLLM substantially narrows the gap between MLLM-generated and human annotations, especially in downstream training performance, where it closes about 60\% to 80\% of the difference.
• 摘要：图像标记是一项基本的视觉任务，传统上依赖于人工注释的数据集来训练多标签分类器，这会产生大量的劳动力和成本。虽然多模态大型语言模型 (MLLM) 提供了自动化注释的巨大潜力，但它们替代人类注释者的能力仍未得到充分探索。本文旨在分析 MLLM 生成的注释与人类注释之间的差距，并提出一种有效的解决方案，使基于 MLLM 的注释能够取代手动标记。我们对 MLLM 注释的分析表明，根据保守估计，MLLM 可以将注释成本降低至人力成本的千分之一，主要考虑到 GPU 的使用，与手动工作相比，这几乎可以忽略不计。它们的标注质量达到了人类性能的 50\% 到 80\% 左右，同时通过这些发现在下游训练此 http URL 时实现了超过 90\% 的性能，我们提出了 TagLLM，一种新颖的图像标记框架，旨在缩小 MLLM 生成的标注与人类标注之间的差距。 TagLLM 包含两个部分： 候选生成，采用结构化分组提示，高效生成紧凑的候选集，覆盖尽可能多的真实标签，同时减少后续注释工作量；标签消歧，交互式校准提示中类别的语义概念，有效细化候选标签。大量实验表明，TagLLM 大大缩小了 MLLM 生成的注释与人工注释之间的差距，特别是在下游训练性能方面，它缩小了约 60% 到 80% 的差异。

Title: Echoes Over Time: Unlocking Length Generalization in Video-to-Audio Generation Models

• Authors: Christian Simon, MAsato Ishii, Wei-Yao Wang, Koichi Saito, Akio Hayakawa, Dongseok Shim, Zhi Zhong, Shuyang Cui, Shusuke Takahashi, Takashi Shibuya, Yuki Mitsufuji
• Subjects: cs.CV, cs.AI
• Abstract URL: https://arxiv.org/abs/2602.20981
• Pdf URL: https://arxiv.org/pdf/2602.20981
• Copy Paste: [[2602.20981]] Echoes Over Time: Unlocking Length Generalization in Video-to-Audio Generation Models(https://arxiv.org/abs/2602.20981)
• Keywords: generation
• Abstract: Scaling multimodal alignment between video and audio is challenging, particularly due to limited data and the mismatch between text descriptions and frame-level video information. In this work, we tackle the scaling challenge in multimodal-to-audio generation, examining whether models trained on short instances can generalize to longer ones during testing. To tackle this challenge, we present multimodal hierarchical networks so-called MMHNet, an enhanced extension of state-of-the-art video-to-audio models. Our approach integrates a hierarchical method and non-causal Mamba to support long-form audio generation. Our proposed method significantly improves long audio generation up to more than 5 minutes. We also prove that training short and testing long is possible in the video-to-audio generation tasks without training on the longer durations. We show in our experiments that our proposed method could achieve remarkable results on long-video to audio benchmarks, beating prior works in video-to-audio tasks. Moreover, we showcase our model capability in generating more than 5 minutes, while prior video-to-audio methods fall short in generating with long durations.
• 摘要：缩放视频和音频之间的多模态对齐具有挑战性，特别是由于数据有限以及文本描述和帧级视频信息之间的不匹配。在这项工作中，我们解决了多模态音频生成中的扩展挑战，检查在短实例上训练的模型是否可以在测试过程中泛化到更长的实例。为了应对这一挑战，我们提出了称为 MMHNet 的多模式分层网络，它是最先进的视频到音频模型的增强扩展。我们的方法集成了分层方法和非因果 Mamba 以支持长格式音频生成。我们提出的方法显着改善了长达 5 分钟以上的长音频生成。我们还证明，在视频到音频生成任务中，可以进行短训练和长测试，而无需进行较长持续时间的训练。我们在实验中表明，我们提出的方法可以在长视频到音频基准测试中取得显着的结果，在视频到音频任务中击败了先前的工作。此外，我们展示了我们的模型在生成超过 5 分钟的时间方面的能力，而之前的视频转音频方法在生成较长持续时间方面存在不足。

Title: VII: Visual Instruction Injection for Jailbreaking Image-to-Video Generation Models

• Authors: Bowen Zheng, Yongli Xiang, Ziming Hong, Zerong Lin, Chaojian Yu, Tongliang Liu, Xinge You
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.20999
• Pdf URL: https://arxiv.org/pdf/2602.20999
• Copy Paste: [[2602.20999]] VII: Visual Instruction Injection for Jailbreaking Image-to-Video Generation Models(https://arxiv.org/abs/2602.20999)
• Keywords: generation
• Abstract: Image-to-Video (I2V) generation models, which condition video generation on reference images, have shown emerging visual instruction-following capability, allowing certain visual cues in reference images to act as implicit control signals for video generation. However, this capability also introduces a previously overlooked risk: adversaries may exploit visual instructions to inject malicious intent through the image modality. In this work, we uncover this risk by proposing Visual Instruction Injection (VII), a training-free and transferable jailbreaking framework that intentionally disguises the malicious intent of unsafe text prompts as benign visual instructions in the safe reference image. Specifically, VII coordinates a Malicious Intent Reprogramming module to distill malicious intent from unsafe text prompts while minimizing their static harmfulness, and a Visual Instruction Grounding module to ground the distilled intent onto a safe input image by rendering visual instructions that preserve semantic consistency with the original unsafe text prompt, thereby inducing harmful content during I2V generation. Empirically, our extensive experiments on four state-of-the-art commercial I2V models (Kling-v2.5-turbo, Gemini Veo-3.1, Seedance-1.5-pro, and PixVerse-V5) demonstrate that VII achieves Attack Success Rates of up to 83.5% while reducing Refusal Rates to near zero, significantly outperforming existing baselines.
• 摘要：图像到视频 (I2V) 生成模型在参考图像上调节视频生成，已显示出新兴的视觉指令跟踪功能，允许参考图像中的某些视觉提示充当视频生成的隐式控制信号。然而，这种功能也带来了一个以前被忽视的风险：对手可能会利用视觉指令通过图像模态注入恶意意图。在这项工作中，我们通过提出视觉指令注入（VII）来揭示这一风险，这是一种免训练且可转移的越狱框架，有意将不安全文本提示的恶意意图伪装成安全参考图像中的良性视觉指令。具体来说，VII 协调恶意意图重新编程模块，从不安全文本提示中提取恶意意图，同时最大限度地减少其静态危害性，并协调视觉指令接地模块，通过渲染与原始不安全文本提示保持语义一致性的视觉指令，将提取的意图接地到安全输入图像上，从而在 I2V 生成过程中引入有害内容。根据经验，我们对四种最先进的商业 I2V 模型（Kling-v2.5-turbo、Gemini Veo-3.1、Seedance-1.5-pro 和 PixVerse-V5）进行的广泛实验表明，VII 的攻击成功率高达 83.5%，同时将拒绝率降低到接近零，显着优于现有基线。

Title: SOM-VQ: Topology-Aware Tokenization for Interactive Generative Models

• Authors: Alessandro Londei, Denise Lanzieri, Matteo Benati
• Subjects: cs.LG, stat.ML
• Abstract URL: https://arxiv.org/abs/2602.21133
• Pdf URL: https://arxiv.org/pdf/2602.21133
• Copy Paste: [[2602.21133]] SOM-VQ: Topology-Aware Tokenization for Interactive Generative Models(https://arxiv.org/abs/2602.21133)
• Keywords: generation, generative
• Abstract: Vector-quantized representations enable powerful discrete generative models but lack semantic structure in token space, limiting interpretable human control. We introduce SOM-VQ, a tokenization method that combines vector quantization with Self-Organizing Maps to learn discrete codebooks with explicit low-dimensional topology. Unlike standard VQ-VAE, SOM-VQ uses topology-aware updates that preserve neighborhood structure: nearby tokens on a learned grid correspond to semantically similar states, enabling direct geometric manipulation of the latent space. We demonstrate that SOM-VQ produces more learnable token sequences in the evaluated domains while providing an explicit navigable geometry in code space. Critically, the topological organization enables intuitive human-in-the-loop control: users can steer generation by manipulating distances in token space, achieving semantic alignment without frame-level constraints. We focus on human motion generation - a domain where kinematic structure, smooth temporal continuity, and interactive use cases (choreography, rehabilitation, HCI) make topology-aware control especially natural - demonstrating controlled divergence and convergence from reference sequences through simple grid-based sampling. SOM-VQ provides a general framework for interpretable discrete representations applicable to music, gesture, and other interactive generative domains.
• 摘要：矢量量化表示可以实现强大的离散生成模型，但缺乏令牌空间中的语义结构，限制了可解释的人类控制。我们引入了 SOM-VQ，一种将矢量量化与自组织映射相结合的标记化方法，用于学习具有显式低维拓扑的离散码本。与标准 VQ-VAE 不同，SOM-VQ 使用拓扑感知更新来保留邻域结构：学习网格上的附近标记对应于语义上相似的状态，从而能够对潜在空间进行直接几何操作。我们证明 SOM-VQ 在评估的域中产生更多可学习的标记序列，同时在代码空间中提供显式的可导航几何结构。至关重要的是，拓扑组织实现了直观的人机交互控制：用户可以通过操纵令牌空间中的距离来引导生成，从而在没有帧级约束的情况下实现语义对齐。我们专注于人体运动生成——在这个领域，运动结构、平滑的时间连续性和交互式用例（编排、康复、人机交互）使拓扑感知控制变得特别自然——通过简单的基于网格的采样展示参考序列的受控发散和收敛。 SOM-VQ 提供了适用于音乐、手势和其他交互式生成领域的可解释离散表示的通用框架。

Title: UDVideoQA: A Traffic Video Question Answering Dataset for Multi-Object Spatio-Temporal Reasoning in Urban Dynamics

• Authors: Joseph Raj Vishal, Nagasiri Poluri, Katha Naik, Rutuja Patil, Kashyap Hegde Kota, Krishna Vinod, Prithvi Jai Ramesh, Mohammad Farhadi, Yezhou Yang, Bharatesh Chakravarthi
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.21137
• Pdf URL: https://arxiv.org/pdf/2602.21137
• Copy Paste: [[2602.21137]] UDVideoQA: A Traffic Video Question Answering Dataset for Multi-Object Spatio-Temporal Reasoning in Urban Dynamics(https://arxiv.org/abs/2602.21137)
• Keywords: generation
• Abstract: Understanding the complex, multi-agent dynamics of urban traffic remains a fundamental challenge for video language models. This paper introduces Urban Dynamics VideoQA, a benchmark dataset that captures the unscripted real-world behavior of dynamic urban scenes. UDVideoQA is curated from 16 hours of traffic footage recorded at multiple city intersections under diverse traffic, weather, and lighting conditions. It employs an event-driven dynamic blur technique to ensure privacy preservation without compromising scene fidelity. Using a unified annotation pipeline, the dataset contains 28K question-answer pairs generated across 8 hours of densely annotated video, averaging one question per second. Its taxonomy follows a hierarchical reasoning level, spanning basic understanding and attribution to event reasoning, reverse reasoning, and counterfactual inference, enabling systematic evaluation of both visual grounding and causal reasoning. Comprehensive experiments benchmark 10 SOTA VideoLMs on UDVideoQA and 8 models on a complementary video question generation benchmark. Results reveal a persistent perception-reasoning gap, showing models that excel in abstract inference often fail with fundamental visual grounding. While models like Gemini Pro achieve the highest zero-shot accuracy, fine-tuning the smaller Qwen2.5-VL 7B model on UDVideoQA bridges this gap, achieving performance comparable to proprietary systems. In VideoQGen, Gemini 2.5 Pro, and Qwen3 Max generate the most relevant and complex questions, though all models exhibit limited linguistic diversity, underscoring the need for human-centric evaluation. The UDVideoQA suite, including the dataset, annotation tools, and benchmarks for both VideoQA and VideoQGen, provides a foundation for advancing robust, privacy-aware, and real-world multimodal reasoning. UDVideoQA is available at this https URL.
• 摘要：了解城市交通复杂的多智能体动态仍然是视频语言模型的基本挑战。本文介绍了 Urban Dynamics VideoQA，这是一个基准数据集，可捕获动态城市场景的无脚本现实行为。 UDVideoQA 根据在不同交通、天气和照明条件下在多个城市十字路口录制的 16 小时交通录像进行整理。它采用事件驱动的动态模糊技术来确保隐私保护，同时又不影响场景保真度。使用统一的注释管道，该数据集包含在 8 小时的密集注释视频中生成的 28K 问答对，平均每秒一个问题。其分类遵循分层推理水平，涵盖对事件推理、逆向推理和反事实推理的基本理解和归因，从而能够对视觉基础和因果推理进行系统评估。综合实验在 UDVideoQA 上对 10 个 SOTA VideoLM 进行基准测试，在补充视频问题生成基准上对 8 个模型进行基准测试。结果揭示了持续存在的感知推理差距，表明擅长抽象推理的模型往往在基本视觉基础上失败。虽然 Gemini Pro 等模型实现了最高的零射击精度，但在 UDVideoQA 上微调较小的 Qwen2.5-VL 7B 模型弥补了这一差距，实现了与专有系统相当的性能。在 VideoQGen、Gemini 2.5 Pro 和 Qwen3 Max 中，尽管所有模型都表现出有限的语言多样性，但生成了最相关和最复杂的问题，这强调了以人为中心的评估的必要性。 UDVideoQA 套件包括数据集、注释工具以及 VideoQA 和 VideoQGen 的基准，为推进稳健、隐私意识和现实世界的多模态推理奠定了基础。 UDVideoQA 可通过此 https URL 获取。

Title: SynthRender and IRIS: Open-Source Framework and Dataset for Bidirectional Sim-Real Transfer in Industrial Object Perception

• Authors: Jose Moises Araya-Martinez, Thushar Tom, Adrián Sanchis Reig, Pablo Rey Valiente, Jens Lambrecht, Jörg Krüger
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.21141
• Pdf URL: https://arxiv.org/pdf/2602.21141
• Copy Paste: [[2602.21141]] SynthRender and IRIS: Open-Source Framework and Dataset for Bidirectional Sim-Real Transfer in Industrial Object Perception(https://arxiv.org/abs/2602.21141)
• Keywords: generation
• Abstract: Object perception is fundamental for tasks such as robotic material handling and quality inspection. However, modern supervised deep-learning perception models require large datasets for robust automation under semi-uncontrolled conditions. The cost of acquiring and annotating such data for proprietary parts is a major barrier for widespread deployment. In this context, we release SynthRender, an open source framework for synthetic image generation with Guided Domain Randomization capabilities. Furthermore, we benchmark recent Reality-to-Simulation techniques for 3D asset creation from 2D images of real parts. Combined with Domain Randomization, these synthetic assets provide low-overhead, transferable data even for parts lacking 3D files. We also introduce IRIS, the Industrial Real-Sim Imagery Set, containing 32 categories with diverse textures, intra-class variation, strong inter-class similarities and about 20,000 labels. Ablations on multiple benchmarks outline guidelines for efficient data generation with SynthRender. Our method surpasses existing approaches, achieving 99.1% mAP@50 on a public robotics dataset, 98.3% mAP@50 on an automotive benchmark, and 95.3% mAP@50 on IRIS.
• 摘要：物体感知对于机器人材料处理和质量检查等任务至关重要。然而，现代监督深度学习感知模型需要大量数据集才能在半不受控条件下实现稳健的自动化。获取和注释专有部件的此类数据的成本是广泛部署的主要障碍。在此背景下，我们发布了 SynthRender，这是一个具有引导域随机化功能的合成图像生成开源框架。此外，我们还对最新的现实到模拟技术进行了基准测试，以根据真实零件的 2D 图像创建 3D 资产。与域随机化相结合，这些合成资产甚至可以为缺少 3D 文件的零件提供低开销、可传输的数据。我们还推出了 IRIS，工业实景图像集，包含 32 个类别，具有不同的纹理、类内差异、类间强烈相似性和约 20,000 个标签。多个基准测试的消融概述了使用 SynthRender 高效生成数据的指南。我们的方法超越了现有方法，在公共机器人数据集上实现了 99.1% mAP@50，在汽车基准上实现了 98.3% mAP@50，在 IRIS 上实现了 95.3% mAP@50。

Title: SPRITETOMESH: Automatic Mesh Generation for 2D Skeletal Animation Using Learned Segmentation and Contour-Aware Vertex Placement

• Authors: Bastien Gimbert
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.21153
• Pdf URL: https://arxiv.org/pdf/2602.21153
• Copy Paste: [[2602.21153]] SPRITETOMESH: Automatic Mesh Generation for 2D Skeletal Animation Using Learned Segmentation and Contour-Aware Vertex Placement(https://arxiv.org/abs/2602.21153)
• Keywords: generation
• Abstract: We present SPRITETOMESH, a fully automatic pipeline for converting 2D game sprite images into triangle meshes compatible with skeletal animation frameworks such as Spine2D. Creating animation-ready meshes is traditionally a tedious manual process requiring artists to carefully place vertices along visual boundaries, a task that typically takes 15-60 minutes per sprite. Our method addresses this through a hybrid learned-algorithmic approach. A segmentation network (EfficientNet-B0 encoder with U-Net decoder) trained on over 100,000 sprite-mask pairs from 172 games achieves an IoU of 0.87, providing accurate binary masks from arbitrary input images. From these masks, we extract exterior contour vertices using Douglas-Peucker simplification with adaptive arc subdivision, and interior vertices along visual boundaries detected via bilateral-filtered multi-channel Canny edge detection with contour-following placement. Delaunay triangulation with mask-based centroid filtering produces the final mesh. Through controlled experiments, we demonstrate that direct vertex position prediction via neural network heatmap regression is fundamentally not viable for this task: the heatmap decoder consistently fails to converge (loss plateau at 0.061) while the segmentation decoder trains normally under identical conditions. We attribute this to the inherently artistic nature of vertex placement - the same sprite can be meshed validly in many different ways. This negative result validates our hybrid design: learned segmentation where ground truth is unambiguous, algorithmic placement where domain heuristics are appropriate. The complete pipeline processes a sprite in under 3 seconds, representing a speedup of 300x-1200x over manual creation. We release our trained model to the game development community.
• 摘要：我们推出了 SPRITETOMESH，这是一个全自动管道，用于将 2D 游戏精灵图像转换为与 Spine2D 等骨骼动画框架兼容的三角形网格。创建动画就绪网格传统上是一个繁琐的手动过程，需要艺术家沿着视觉边界仔细放置顶点，这项任务通常每个精灵需要 15-60 分钟。我们的方法通过混合学习算法方法解决了这个问题。分割网络（带有 U-Net 解码器的 EfficientNet-B0 编码器）在来自 172 个游戏的超过 100,000 个精灵掩码对上进行训练，实现了 0.87 的 IoU，从任意输入图像中提供准确的二进制掩码。从这些掩模中，我们使用 Douglas-Peucker 简化和自适应弧细分提取外部轮廓顶点，并通过双边滤波多通道 Canny 边缘检测和轮廓跟踪放置沿视觉边界检测内部顶点。具有基于掩模的质心过滤的 Delaunay 三角测量产生最终的网格。通过受控实验，我们证明通过神经网络热图回归进行直接顶点位置预测对于此任务来说根本上是不可行的：热图解码器始终无法收敛（损失稳定在 0.061），而分割解码器在相同条件下正常训练。我们将此归因于顶点放置的固有艺术本质 - 相同的精灵可以通过多种不同的方式进行有效的网格划分。这个负面结果验证了我们的混合设计：在地面事实明确的情况下进行学习分割，在领域启发法适用的情况下进行算法放置。完整的管道在 3 秒内处理一个精灵，比手动创建速度提高了 300 倍至 1200 倍。我们向游戏开发社区发布经过训练的模型。

Title: Seeing Through Words: Controlling Visual Retrieval Quality with Language Models

• Authors: Jianglin Lu, Simon Jenni, Kushal Kafle, Jing Shi, Handong Zhao, Yun Fu
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.21175
• Pdf URL: https://arxiv.org/pdf/2602.21175
• Copy Paste: [[2602.21175]] Seeing Through Words: Controlling Visual Retrieval Quality with Language Models(https://arxiv.org/abs/2602.21175)
• Keywords: generative
• Abstract: Text-to-image retrieval is a fundamental task in vision-language learning, yet in real-world scenarios it is often challenged by short and underspecified user queries. Such queries are typically only one or two words long, rendering them semantically ambiguous, prone to collisions across diverse visual interpretations, and lacking explicit control over the quality of retrieved images. To address these issues, we propose a new paradigm of quality-controllable retrieval, which enriches short queries with contextual details while incorporating explicit notions of image quality. Our key idea is to leverage a generative language model as a query completion function, extending underspecified queries into descriptive forms that capture fine-grained visual attributes such as pose, scene, and aesthetics. We introduce a general framework that conditions query completion on discretized quality levels, derived from relevance and aesthetic scoring models, so that query enrichment is not only semantically meaningful but also quality-aware. The resulting system provides three key advantages: 1) flexibility, it is compatible with any pretrained vision-language model (VLMs) without modification; 2) transparency, enriched queries are explicitly interpretable by users; and 3) controllability, enabling retrieval results to be steered toward user-preferred quality levels. Extensive experiments demonstrate that our proposed approach significantly improves retrieval results and provides effective quality control, bridging the gap between the expressive capacity of modern VLMs and the underspecified nature of short user queries. Our code is available at this https URL.
• 摘要：文本到图像检索是视觉语言学习中的一项基本任务，但在现实场景中，它经常受到简短且不明确的用户查询的挑战。此类查询通常只有一两个单词长，导致语义模糊，容易在不同的视觉解释之间发生冲突，并且缺乏对检索图像质量的明确控制。为了解决这些问题，我们提出了一种新的质量可控检索范例，它用上下文细节丰富了简短的查询，同时结合了图像质量的明确概念。我们的关键思想是利用生成语言模型作为查询完成功能，将未指定的查询扩展到描述性形式，以捕获细粒度的视觉属性，例如姿势、场景和美学。我们引入了一个通用框架，该框架在离散质量级别上条件查询完成，该质量级别源自相关性和美学评分模型，因此查询丰富不仅在语义上有意义，而且具有质量意识。由此产生的系统具有三个关键优势：1）灵活性，无需修改即可与任何预训练的视觉语言模型（VLM）兼容； 2) 透明、丰富的查询可由用户明确解释； 3）可控性，使检索结果能够转向用户偏好的质量水平。大量实验表明，我们提出的方法显着改善了检索结果并提供了有效的质量控制，弥补了现代 VLM 的表达能力与短用户查询的未指定性质之间的差距。我们的代码可以在这个 https URL 上找到。

Title: The Diffusion Duality, Chapter II: $Ψ$-Samplers and Efficient Curriculum

• Authors: Justin Deschenaux, Caglar Gulcehre, Subham Sekhar Sahoo
• Subjects: cs.LG
• Abstract URL: https://arxiv.org/abs/2602.21185
• Pdf URL: https://arxiv.org/pdf/2602.21185
• Copy Paste: [[2602.21185]] The Diffusion Duality, Chapter II: $Ψ$-Samplers and Efficient Curriculum(https://arxiv.org/abs/2602.21185)
• Keywords: generation, generative
• Abstract: Uniform-state discrete diffusion models excel at few-step generation and guidance due to their ability to self-correct, making them preferred over autoregressive or Masked diffusion models in these settings. However, their sampling quality plateaus with ancestral samplers as the number of steps increases. We introduce a family of Predictor-Corrector (PC) samplers for discrete diffusion that generalize prior methods and apply to arbitrary noise processes. When paired with uniform-state diffusion, our samplers outperform ancestral sampling on both language and image modeling, achieving lower generative perplexity at matched unigram entropy on OpenWebText and better FID/IS scores on CIFAR10. Crucially, unlike conventional samplers, our PC methods continue to improve with more sampling steps. Taken together, these findings call into question the assumption that Masked diffusion is the inevitable future of diffusion-based language modeling. Beyond sampling, we develop a memory-efficient curriculum for the Gaussian relaxation training phase, reducing training time by 25% and memory by 33% compared to Duo while maintaining comparable perplexity on OpenWebText and LM1B and strong downstream performance. We release code, checkpoints, and a video-tutorial on: this https URL
• 摘要：均匀状态离散扩散模型由于具有自我校正能力，因此在几步生成和指导方面表现出色，这使得它们在这些设置中优于自回归或掩模扩散模型。然而，随着步骤数量的增加，他们的采样质量与祖先采样器持平。我们引入了一系列用于离散扩散的预测校正器 (PC) 采样器，它们概括了先前的方法并适用于任意噪声过程。当与均匀状态扩散配合使用时，我们的采样器在语言和图像建模方面都优于祖先采样，在 OpenWebText 上匹配一元熵时实现更低的生成困惑，并在 CIFAR10 上实现更好的 FID/IS 分数。至关重要的是，与传统采样器不同，我们的 PC 方法通过更多采样步骤不断改进。总而言之，这些发现对“掩蔽扩散是基于扩散的语言建模不可避免的未来”的假设提出了质疑。除了采样之外，我们还为高斯松弛训练阶段开发了内存高效的课程，与 Duo 相比，训练时间减少了 25%，内存减少了 33%，同时在 OpenWebText 和 LM1B 上保持了相当的困惑度以及强大的下游性能。我们在以下位置发布代码、检查点和视频教程：此 https URL

Title: Human Video Generation from a Single Image with 3D Pose and View Control

• Authors: Tiantian Wang, Chun-Han Yao, Tao Hu, Mallikarjun Byrasandra Ramalinga Reddy, Ming-Hsuan Yang, Varun Jampani
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.21188
• Pdf URL: https://arxiv.org/pdf/2602.21188
• Copy Paste: [[2602.21188]] Human Video Generation from a Single Image with 3D Pose and View Control(https://arxiv.org/abs/2602.21188)
• Keywords: generation
• Abstract: Recent diffusion methods have made significant progress in generating videos from single images due to their powerful visual generation capabilities. However, challenges persist in image-to-video synthesis, particularly in human video generation, where inferring view-consistent, motion-dependent clothing wrinkles from a single image remains a formidable problem. In this paper, we present Human Video Generation in 4D (HVG), a latent video diffusion model capable of generating high-quality, multi-view, spatiotemporally coherent human videos from a single image with 3D pose and view control. HVG achieves this through three key designs: (i) Articulated Pose Modulation, which captures the anatomical relationships of 3D joints via a novel dual-dimensional bone map and resolves self-occlusions across views by introducing 3D information; (ii) View and Temporal Alignment, which ensures multi-view consistency and alignment between a reference image and pose sequences for frame-to-frame stability; and (iii) Progressive Spatio-Temporal Sampling with temporal alignment to maintain smooth transitions in long multi-view animations. Extensive experiments on image-to-video tasks demonstrate that HVG outperforms existing methods in generating high-quality 4D human videos from diverse human images and pose inputs.
• 摘要：最近的扩散方法由于其强大的视觉生成能力，在从单个图像生成视频方面取得了重大进展。然而，图像到视频的合成仍然存在挑战，特别是在人类视频生成方面，从单个图像推断视图一致、运动相关的衣服皱纹仍然是一个艰巨的问题。在本文中，我们提出了 4D 人类视频生成 (HVG)，这是一种潜在视频扩散模型，能够从具有 3D 姿势和视图控制的单个图像生成高质量、多视图、时空连贯的人类视频。 HVG 通过三个关键设计实现了这一目标：(i) 关节姿势调制，通过新颖的二维骨图捕获 3D 关节的解剖关系，并通过引入 3D 信息解决跨视图的自遮挡问题； (ii) 视图和时间对齐，确保参考图像和姿势序列之间的多视图一致性和对齐，以实现帧到帧的稳定性； (iii) 渐进式时空采样与时间对齐，以保持长多视图动画中的平滑过渡。对图像到视频任务的大量实验表明，HVG 在从不同的人类图像和姿势输入生成高质量 4D 人类视频方面优于现有方法。

Title: Why Pass@k Optimization Can Degrade Pass@1: Prompt Interference in LLM Post-training

• Authors: Anas Barakat, Souradip Chakraborty, Khushbu Pahwa, Amrit Singh Bedi
• Subjects: cs.LG, cs.AI
• Abstract URL: https://arxiv.org/abs/2602.21189
• Pdf URL: https://arxiv.org/pdf/2602.21189
• Copy Paste: [[2602.21189]] Why Pass@k Optimization Can Degrade Pass@1: Prompt Interference in LLM Post-training(https://arxiv.org/abs/2602.21189)
• Keywords: generation
• Abstract: Pass@k is a widely used performance metric for verifiable large language model tasks, including mathematical reasoning, code generation, and short-answer reasoning. It defines success if any of $k$ independently sampled solutions passes a verifier. This multi-sample inference metric has motivated inference-aware fine-tuning methods that directly optimize pass@$k$. However, prior work reports a recurring trade-off: pass@k improves while pass@1 degrades under such methods. This trade-off is practically important because pass@1 often remains a hard operational constraint due to latency and cost budgets, imperfect verifier coverage, and the need for a reliable single-shot fallback. We study the origin of this trade-off and provide a theoretical characterization of when pass@k policy optimization can reduce pass@1 through gradient conflict induced by prompt interference. We show that pass@$k$ policy gradients can conflict with pass@1 gradients because pass@$k$ optimization implicitly reweights prompts toward low-success prompts; when these prompts are what we term negatively interfering, their upweighting can rotate the pass@k update direction away from the pass@1 direction. We illustrate our theoretical findings with large language model experiments on verifiable mathematical reasoning tasks.
• 摘要：Pass@k 是一种广泛使用的性能指标，用于可验证的大型语言模型任务，包括数学推理、代码生成和简答推理。如果 $k$ 个独立采样的解决方案中的任何一个通过了验证器，则定义为成功。这种多样本推理指标激发了推理感知微调方法，可以直接优化 pass@$k$。然而，之前的工作报告了一个反复出现的权衡：在这种方法下，pass@k 得到改善，而 pass@1 则退化。这种权衡实际上很重要，因为由于延迟和成本预算、不完善的验证器覆盖范围以及可靠的单次回退的需要，pass@1 通常仍然是一个严格的操作约束。我们研究了这种权衡的起源，并提供了 pass@k 策略优化何时可以通过即时干扰引起的梯度冲突来减少 pass@1 的理论特征。我们证明 pass@$k$ 策略梯度可能与 pass@1 梯度冲突，因为 pass@$k$ 优化隐式地将提示重新加权为低成功提示；当这些提示是我们所说的负面干扰时，它们的权重增加可以使 pass@k 更新方向远离 pass@1 方向。我们通过可验证的数学推理任务的大型语言模型实验来说明我们的理论发现。