2026-02-23

Title: Duality Models: An Embarrassingly Simple One-step Generation Paradigm

• Authors: Peng Sun, Xinyi Shang, Tao Lin, Zhiqiang Shen
• Subjects: cs.LG
• Abstract URL: https://arxiv.org/abs/2602.17682
• Pdf URL: https://arxiv.org/pdf/2602.17682
• Copy Paste: [[2602.17682]] Duality Models: An Embarrassingly Simple One-step Generation Paradigm(https://arxiv.org/abs/2602.17682)
• Keywords: generation, generative
• Abstract: Consistency-based generative models like Shortcut and MeanFlow achieve impressive results via a target-aware design for solving the Probability Flow ODE (PF-ODE). Typically, such methods introduce a target time $r$ alongside the current time $t$ to modulate outputs between a local multi-step derivative ($r = t$) and a global few-step integral ($r = 0$). However, the conventional "one input, one output" paradigm enforces a partition of the training budget, often allocating a significant portion (e.g., 75% in MeanFlow) solely to the multi-step objective for stability. This separation forces a trade-off: allocating sufficient samples to the multi-step objective leaves the few-step generation undertrained, which harms convergence and limits scalability. To this end, we propose Duality Models (DuMo) via a "one input, dual output" paradigm. Using a shared backbone with dual heads, DuMo simultaneously predicts velocity $v_t$ and flow-map $u_t$ from a single input $x_t$. This applies geometric constraints from the multi-step objective to every sample, bounding the few-step estimation without separating training objectives, thereby significantly improving stability and efficiency. On ImageNet 256 $\times$ 256, a 679M Diffusion Transformer with SD-VAE achieves a state-of-the-art (SOTA) FID of 1.79 in just 2 steps. Code is available at: this https URL
• 摘要：Shortcut 和 MeanFlow 等基于一致性的生成模型通过目标感知设计来求解概率流 ODE (PF-ODE)，取得了令人印象深刻的结果。通常，此类方法会在当前时间 $t$ 旁边引入目标时间 $r$，以在局部多步导数 ($r = t$) 和全局少步积分 ($r = 0$) 之间调节输出。然而，传统的“一输入，一输出”范式强制划分训练预算，通常将很大一部分（例如，MeanFlow 中的 75%）仅分配给多步骤目标以实现稳定性。这种分离迫使一种权衡：为多步目标分配足够的样本会使少步生成训练不足，这会损害收敛性并限制可扩展性。为此，我们通过“单输入，双输出”范例提出对偶模型（DuMo）。使用具有双头的共享主干，DuMo 同时从单个输入 $x_t$ 预测速度 $v_t$ 和流量图 $u_t$。这将多步目标的几何约束应用于每个样本，在不分离训练目标的情况下限制了少步估计，从而显着提高了稳定性和效率。在 ImageNet 256 $\times$ 256 上，具有 SD-VAE 的 679M 扩散变压器只需 2 个步骤即可实现 1.79 的最先进 (SOTA) FID。代码位于：此 https URL

Title: CodeScaler: Scaling Code LLM Training and Test-Time Inference via Execution-Free Reward Models

• Authors: Xiao Zhu, Xinyu Zhou, Boyu Zhu, Hanxu Hu, Mingzhe Du, Haotian Zhang, Huiming Wang, Zhijiang Guo
• Subjects: cs.LG, cs.AI
• Abstract URL: https://arxiv.org/abs/2602.17684
• Pdf URL: https://arxiv.org/pdf/2602.17684
• Copy Paste: [[2602.17684]] CodeScaler: Scaling Code LLM Training and Test-Time Inference via Execution-Free Reward Models(https://arxiv.org/abs/2602.17684)
• Keywords: generation
• Abstract: Reinforcement Learning from Verifiable Rewards (RLVR) has driven recent progress in code large language models by leveraging execution-based feedback from unit tests, but its scalability is fundamentally constrained by the availability and reliability of high-quality test cases. We propose CodeScaler, an execution-free reward model designed to scale both reinforcement learning training and test-time inference for code generation. CodeScaler is trained on carefully curated preference data derived from verified code problems and incorporates syntax-aware code extraction and validity-preserving reward shaping to ensure stable and robust optimization. Across five coding benchmarks, CodeScaler improves Qwen3-8B-Base by an average of +11.72 points, outperforming binary execution-based RL by +1.82 points, and enables scalable reinforcement learning on synthetic datasets without any test cases. At inference time, CodeScaler serves as an effective test-time scaling method, achieving performance comparable to unit test approaches while providing a 10-fold reduction in latency. Moreover, CodeScaler surpasses existing reward models on RM-Bench not only in the code domain (+3.3 points), but also in general and reasoning domains (+2.7 points on average).
• 摘要：可验证奖励的强化学习 (RLVR) 通过利用单元测试基于执行的反馈推动了代码大语言模型的最新进展，但其可扩展性从根本上受到高质量测试用例的可用性和可靠性的限制。我们提出了 CodeScaler，这是一种无需执行的奖励模型，旨在扩展强化学习训练和代码生成的测试时推理。 CodeScaler 经过精心策划的偏好数据的训练，这些数据源自经过验证的代码问题，并结合了语法感知代码提取和有效性保持奖励塑造，以确保稳定和稳健的优化。在五个编码基准测试中，CodeScaler 将 Qwen3-8B-Base 平均提高了 11.72 分，比基于二进制执行的 RL 提高了 1.82 分，并且无需任何测试用例即可在合成数据集上实现可扩展的强化学习。在推理时，CodeScaler 可以作为一种有效的测试时间扩展方法，实现与单元测试方法相当的性能，同时将延迟减少 10 倍。此外，CodeScaler 不仅在代码领域（+3.3 分），而且在一般领域和推理领域（平均+2.7 分）都超越了 RM-Bench 上现有的奖励模型。

Title: AnCoder: Anchored Code Generation via Discrete Diffusion Models

• Authors: Anton Xue, Litu Rout, Constantine Caramanis, Sanjay Shakkottai
• Subjects: cs.LG, cs.PL
• Abstract URL: https://arxiv.org/abs/2602.17688
• Pdf URL: https://arxiv.org/pdf/2602.17688
• Copy Paste: [[2602.17688]] AnCoder: Anchored Code Generation via Discrete Diffusion Models(https://arxiv.org/abs/2602.17688)
• Keywords: generation
• Abstract: Diffusion language models offer a compelling alternative to autoregressive code generation, enabling global planning and iterative refinement of complex program logic. However, existing approaches fail to respect the rigid structure of programming languages and, as a result, often produce broken programs that fail to execute. To address this, we introduce AnchorTree, a framework that explicitly anchors the diffusion process using structured, hierarchical priors native to code. Specifically, AnchorTree uses the abstract syntax tree to prioritize resolving syntactically and semantically salient tokens, such as keywords (e.g., if, while) and identifiers (e.g., variable names), thereby establishing a structural scaffold that guides the remaining generation. We validate this framework via AnCoder, a family of models showing that structurally anchored diffusion offers a parameter-efficient path to high-quality code generation.
• 摘要：扩散语言模型为自回归代码生成提供了一种引人注目的替代方案，支持复杂程序逻辑的全局规划和迭代细化。然而，现有的方法未能尊重编程语言的严格结构，因此常常会产生无法执行的损坏程序。为了解决这个问题，我们引入了 AnchorTree，这是一个使用代码原生的结构化、分层先验显式锚定扩散过程的框架。具体来说，AnchorTree 使用抽象语法树来优先解析语法和语义上显着的标记，例如关键字（例如 if、while）和标识符（例如变量名），从而建立指导剩余生成的结构支架。我们通过 AnCoder 验证了这个框架，该模型系列表明结构锚定扩散为高质量代码生成提供了一条参数有效的路径。

Title: Tethered Reasoning: Decoupling Entropy from Hallucination in Quantized LLMs via Manifold Steering

• Authors: Craig Atkinson
• Subjects: cs.LG, cs.CL
• Abstract URL: https://arxiv.org/abs/2602.17691
• Pdf URL: https://arxiv.org/pdf/2602.17691
• Copy Paste: [[2602.17691]] Tethered Reasoning: Decoupling Entropy from Hallucination in Quantized LLMs via Manifold Steering(https://arxiv.org/abs/2602.17691)
• Keywords: generation
• Abstract: Quantized language models face a fundamental dilemma: low sampling temperatures yield repetitive, mode-collapsed outputs, while high temperatures (T > 2.0) cause trajectory divergence and semantic incoherence. We present HELIX, a geometric framework that decouples output entropy from hallucination by tethering hidden-state trajectories to a pre-computed truthfulness manifold. HELIX computes a Unified Truth Score (UTS) combining token-level semantic entropy with Mahalanobis distance from the manifold. When UTS indicates trajectory divergence, graduated steering vectors redirect activations toward structurally coherent regions while affecting only 0.2-2.5% of tokens. On 4-bit quantized Granite 4.0 H Small (32B/9B active, hybrid Mamba-Transformer): GSM8K maintains 88.84% accuracy at T = 3.0 (2.81pp degradation from T = 0.5); MMLU maintains 72.49% across 14,042 questions (1.24pp degradation). This demonstrates that high-temperature hallucination is primarily trajectory divergence rather than semantic collapse. Notably, steering the sparse Transformer attention layers (~10% of layers) is sufficient to correct drift in the Mamba-2 state-space formulation. Geometric tethering reveals a previously-masked High-Entropy Creative Reservoir. At T > 2.0, steered outputs exhibit 5-20% idea duplication versus 70-80% at conservative settings. Cross-architecture validation (Qwen3-30B-A3B MOE) confirms this phenomenon is architecture-independent, with 46.7% higher unique concept generation. HELIX acts as a syntax tether, enabling exploration of semantic diversity without violating the logical backbone required for valid output. This enables Multi-Temperature Synthesis, generating 200% more unique concepts than single-temperature inference.
• 摘要：量化语言模型面临着一个根本性的困境：低采样温度会产生重复的模式崩溃输出，而高温（T > 2.0）会导致轨迹发散和语义不连贯。我们提出了 HELIX，一种几何框架，通过将隐藏状态轨迹束缚到预先计算的真实性流形，将输出熵与幻觉解耦。 HELIX 将标记级语义熵与距流形的马哈拉诺比斯距离相结合来计算统一真值分数 (UTS)。当 UTS 指示轨迹发散时，分级转向向量将激活重定向到结构一致的区域，同时仅影响 0.2-2.5% 的标记。在 4 位量化 Granite 4.0 H Small（32B/9B 有源、混合 Mamba-Transformer）上：GSM8K 在 T = 3.0 时保持 88.84% 的准确度（从 T = 0.5 开始下降 2.81pp）； MMLU 在 14,042 个问题中保持 72.49%（降级 1.24 个百分点）。这表明高温幻觉主要是轨迹发散而不是语义崩溃。值得注意的是，控制稀疏 Transformer 注意力层（约 10% 的层）足以纠正 Mamba-2 状态空间公式中的漂移。几何束缚揭示了一个先前被掩盖的高熵创意库。当 T > 2.0 时，引导输出表现出 5-20% 的想法重复，而保守设置下则为 70-80%。跨架构验证 (Qwen3-30B-A3B MOE) 证实这种现象与架构无关，独特概念生成量提高了 46.7%。 HELIX 充当语法系绳，能够在不违反有效输出所需的逻辑主干的情况下探索语义多样性。这使得多温度综合成为可能，产生的独特概念比单温度推理多 200%。

Title: EXACT: Explicit Attribute-Guided Decoding-Time Personalization

• Authors: Xin Yu, Hanwen Xing, Lingzhou Xue
• Subjects: cs.LG, cs.AI, cs.IR
• Abstract URL: https://arxiv.org/abs/2602.17695
• Pdf URL: https://arxiv.org/pdf/2602.17695
• Copy Paste: [[2602.17695]] EXACT: Explicit Attribute-Guided Decoding-Time Personalization(https://arxiv.org/abs/2602.17695)
• Keywords: generation
• Abstract: Achieving personalized alignment requires adapting large language models to each user's evolving context. While decoding-time personalization offers a scalable alternative to training-time methods, existing methods largely rely on implicit, less interpretable preference representations and impose a rigid, context-agnostic user representation, failing to account for how preferences shift across prompts. We introduce EXACT, a new decoding-time personalization that aligns generation with limited pairwise preference feedback using a predefined set of interpretable attributes. EXACT first identifies user-specific attribute subsets by maximizing the likelihood of preferred responses in the offline stage. Then, for online inference, EXACT retrieves the most semantically relevant attributes for an incoming prompt and injects them into the context to steer generation. We establish theoretical approximation guarantees for the proposed algorithm under mild assumptions, and provably show that our similarity-based retrieval mechanism effectively mitigates contextual preference shifts, adapting to disparate tasks without pooling conflicting preferences. Extensive experiments on human-annotated preference datasets demonstrate that EXACT consistently outperforms strong baselines, including preference modeling accuracy and personalized generation quality.
• 摘要：实现个性化调整需要使大型语言模型适应每个用户不断变化的上下文。虽然解码时个性化提供了训练时方法的可扩展替代方案，但现有方法在很大程度上依赖于隐式的、难以解释的偏好表示，并强加了严格的、与上下文无关的用户表示，无法考虑偏好如何在提示之间变化。我们引入了 EXACT，一种新的解码时个性化，它使用一组预定义的可解释属性将生成与有限的成对偏好反馈对齐。 EXACT 首先通过最大化离线阶段首选响应的可能性来识别用户特定的属性子集。然后，对于在线推理，EXACT 检索传入提示的语义上最相关的属性，并将它们注入上下文中以引导生成。我们在温和的假设下为所提出的算法建立了理论近似保证，并证明了我们基于相似性的检索机制有效地减轻了上下文偏好的变化，适应不同的任务而不汇集冲突的偏好。对人类注释的偏好数据集进行的大量实验表明，EXACT 始终优于强大的基线，包括偏好建模准确性和个性化生成质量。

Title: Pimp My LLM: Leveraging Variability Modeling to Tune Inference Hyperparameters

• Authors: Nada Zine, Clément Quinton, Romain Rouvoy
• Subjects: cs.LG, cs.SE
• Abstract URL: https://arxiv.org/abs/2602.17697
• Pdf URL: https://arxiv.org/pdf/2602.17697
• Copy Paste: [[2602.17697]] Pimp My LLM: Leveraging Variability Modeling to Tune Inference Hyperparameters(https://arxiv.org/abs/2602.17697)
• Keywords: generation
• Abstract: Large Language Models (LLMs) are being increasingly used across a wide range of tasks. However, their substantial computational demands raise concerns about the energy efficiency and sustainability of both training and inference. Inference, in particular, dominates total compute usage, making its optimization crucial. Recent research has explored optimization techniques and analyzed how configuration choices influence energy consumption. Yet, the vast configuration space of inference servers makes exhaustive empirical evaluation infeasible due to combinatorial explosion. In this paper, we introduce a new perspective on this problem by treating LLMs as configurable systems and applying variability management techniques to systematically analyze inference-time configuration choices. We evaluate our approach on the Hugging Face Transformers library by representing generation hyperparameters and their constraints using a feature-based variability model, sampling representative configurations, measuring their energy consumption, latency, accuracy, and learning predictive models from the collected data. Our results show that variability modeling effectively manages the complexity of LLM inference configurations. It enables systematic analysis of hyperparameters effects and interactions, reveals trade-offs, and supports accurate prediction of inference behavior from a limited number of measurements. Overall, this work opens a new research direction that bridges software engineering and machine learning by leveraging variability modeling for the efficient and sustainable configuration of LLMs.
• 摘要：大型语言模型 (LLM) 越来越多地用于各种任务。然而，它们大量的计算需求引起了人们对训练和推理的能源效率和可持续性的担忧。尤其是推理，在总计算使用中占主导地位，因此其优化至关重要。最近的研究探索了优化技术并分析了配置选择如何影响能耗。然而，由于组合爆炸，推理服务器巨大的配置空间使得详尽的经验评估变得不可行。在本文中，我们通过将法学硕士视为可配置系统并应用可变性管理技术来系统地分析推理时间配置选择，介绍了解决此问题的新视角。我们通过使用基于特征的可变性模型表示生成超参数及其约束、对代表性配置进行采样、测量其能耗、延迟、准确性以及从收集的数据中学习预测模型来评估我们在 Hugging Face Transformers 库上的方法。我们的结果表明，可变性建模有效地管理了 LLM 推理配置的复杂性。它能够对超参数效应和相互作用进行系统分析，揭示权衡，并支持根据有限数量的测量准确预测推理行为。总的来说，这项工作开辟了一个新的研究方向，通过利用可变性模型来实现法学硕士的高效和可持续配置，从而在软件工程和机器学习之间架起桥梁。

Title: Parallel Complex Diffusion for Scalable Time Series Generation

• Authors: Rongyao Cai, Yuxi Wan, Kexin Zhang, Ming Jin, Zhiqiang Ge, Qingsong Wen, Yong Liu
• Subjects: cs.LG
• Abstract URL: https://arxiv.org/abs/2602.17706
• Pdf URL: https://arxiv.org/pdf/2602.17706
• Copy Paste: [[2602.17706]] Parallel Complex Diffusion for Scalable Time Series Generation(https://arxiv.org/abs/2602.17706)
• Keywords: generation, generative
• Abstract: Modeling long-range dependencies in time series generation poses a fundamental trade-off between representational capacity and computational efficiency. Traditional temporal diffusion models suffer from local entanglement and the $\mathcal{O}(L^2)$ cost of attention mechanisms. We address these limitations by introducing PaCoDi (Parallel Complex Diffusion), a spectral-native architecture that decouples generative modeling in the frequency domain. PaCoDi fundamentally alters the problem topology: the Fourier Transform acts as a diagonalizing operator, converting locally coupled temporal signals into globally decorrelated spectral components. Theoretically, we prove the Quadrature Forward Diffusion and Conditional Reverse Factorization theorem, demonstrating that the complex diffusion process can be split into independent real and imaginary branches. We bridge the gap between this decoupled theory and data reality using a \textbf{Mean Field Theory (MFT) approximation} reinforced by an interactive correction mechanism. Furthermore, we generalize this discrete DDPM to continuous-time Frequency SDEs, rigorously deriving the Spectral Wiener Process describe the differential spectral Brownian motion limit. Crucially, PaCoDi exploits the Hermitian Symmetry of real-valued signals to compress the sequence length by half, achieving a 50% reduction in attention FLOPs without information loss. We further derive a rigorous Heteroscedastic Loss to handle the non-isotropic noise distribution on the compressed manifold. Extensive experiments show that PaCoDi outperforms existing baselines in both generation quality and inference speed, offering a theoretically grounded and computationally efficient solution for time series modeling.
• 摘要：对时间序列生成中的远程依赖性进行建模提出了表示能力和计算效率之间的基本权衡。传统的时间扩散模型受到局部纠缠和注意力机制 $\mathcal{O}(L^2)$ 成本的影响。我们通过引入 PaCoDi（并行复数扩散）来解决这些限制，这是一种在频域中解耦生成建模的频谱原生架构。 PaCoDi 从根本上改变了问题拓扑：傅里叶变换充当对角化算子，将局部耦合的时间信号转换为全局去相关的频谱分量。理论上，我们证明了正交前向扩散和条件逆分解定理，证明复杂的扩散过程可以分为独立的实部和虚部。我们使用由交互式校正机制强化的\textbf{平均场理论（MFT）近似}弥合了这种解耦理论和数据现实之间的差距。此外，我们将这种离散 DDPM 推广到连续时间频率 SDE，严格推导描述微分谱布朗运动极限的谱维纳过程。至关重要的是，PaCoDi 利用实值信号的 Hermitian 对称性将序列长度压缩一半，从而在不丢失信息的情况下将注意力 FLOP 减少 50%。我们进一步推导出严格的异方差损失来处理压缩流形上的非各向同性噪声分布。大量实验表明，PaCoDi 在生成质量和推理速度方面均优于现有基线，为时间序列建模提供了理论基础和计算高效的解决方案。

Title: CLUTCH: Contextualized Language model for Unlocking Text-Conditioned Hand motion modelling in the wild

• Authors: Balamurugan Thambiraja, Omid Taheri, Radek Danecek, Giorgio Becherini, Gerard Pons-Moll, Justus Thies
• Subjects: cs.CV, cs.LG
• Abstract URL: https://arxiv.org/abs/2602.17770
• Pdf URL: https://arxiv.org/pdf/2602.17770
• Copy Paste: [[2602.17770]] CLUTCH: Contextualized Language model for Unlocking Text-Conditioned Hand motion modelling in the wild(https://arxiv.org/abs/2602.17770)
• Keywords: generation
• Abstract: Hands play a central role in daily life, yet modeling natural hand motions remains underexplored. Existing methods that tackle text-to-hand-motion generation or hand animation captioning rely on studio-captured datasets with limited actions and contexts, making them costly to scale to "in-the-wild" settings. Further, contemporary models and their training schemes struggle to capture animation fidelity with text-motion alignment. To address this, we (1) introduce '3D Hands in the Wild' (3D-HIW), a dataset of 32K 3D hand-motion sequences and aligned text, and (2) propose CLUTCH, an LLM-based hand animation system with two critical innovations: (a) SHIFT, a novel VQ-VAE architecture to tokenize hand motion, and (b) a geometric refinement stage to finetune the LLM. To build 3D-HIW, we propose a data annotation pipeline that combines vision-language models (VLMs) and state-of-the-art 3D hand trackers, and apply it to a large corpus of egocentric action videos covering a wide range of scenarios. To fully capture motion in-the-wild, CLUTCH employs SHIFT, a part-modality decomposed VQ-VAE, which improves generalization and reconstruction fidelity. Finally, to improve animation quality, we introduce a geometric refinement stage, where CLUTCH is co-supervised with a reconstruction loss applied directly to decoded hand motion parameters. Experiments demonstrate state-of-the-art performance on text-to-motion and motion-to-text tasks, establishing the first benchmark for scalable in-the-wild hand motion modelling. Code, data and models will be released.
• 摘要：手在日常生活中发挥着核心作用，但对自然手部动作的建模仍未得到充分探索。处理文本到手部动作生成或手部动画字幕的现有方法依赖于工作室捕获的具有有限动作和上下文的数据集，这使得它们扩展到“野外”设置的成本高昂。此外，当代模型及其训练方案很难通过文本运动对齐来捕捉动画保真度。为了解决这个问题，我们（1）引入了“3D Hands in the Wild”（3D-HIW），这是一个 32K 3D 手部动作序列和对齐文本的数据集，（2）提出了 CLUTCH，一个基于 LLM 的手部动画系统，具有两项关键创新：（a）SHIFT，一种新颖的 VQ-VAE 架构，用于标记手部动作，以及（b）用于微调 LLM 的几何细化阶段。为了构建 3D-HIW，我们提出了一种数据注释管道，该管道结合了视觉语言模型 (VLM) 和最先进的 3D 手部跟踪器，并将其应用于涵盖各种场景的以自我为中心的动作视频的大型语料库。为了完全捕捉野外运动，CLUTCH 采用了 SHIFT，这是一种部分模态分解的 VQ-VAE，可提高泛化和重建保真度。最后，为了提高动画质量，我们引入了几何细化阶段，其中 CLUTCH 与直接应用于解码的手部运动参数的重建损失进行共同监督。实验展示了文本到运动和运动到文本任务的最先进性能，为可扩展的野外手部运动建模建立了第一个基准。代码、数据和模型将被发布。

Title: Multi-material Multi-physics Topology Optimization with Physics-informed Gaussian Process Priors

• Authors: Xiangyu Sun, Shirin Hosseinmardi, Amin Yousefpour, Ramin Bostanabad
• Subjects: cs.LG
• Abstract URL: https://arxiv.org/abs/2602.17783
• Pdf URL: https://arxiv.org/pdf/2602.17783
• Copy Paste: [[2602.17783]] Multi-material Multi-physics Topology Optimization with Physics-informed Gaussian Process Priors(https://arxiv.org/abs/2602.17783)
• Keywords: super-resolution
• Abstract: Machine learning (ML) has been increasingly used for topology optimization (TO). However, most existing ML-based approaches focus on simplified benchmark problems due to their high computational cost, spectral bias, and difficulty in handling complex physics. These limitations become more pronounced in multi-material, multi-physics problems whose objective or constraint functions are not self-adjoint. To address these challenges, we propose a framework based on physics-informed Gaussian processes (PIGPs). In our approach, the primary, adjoint, and design variables are represented by independent GP priors whose mean functions are parametrized via neural networks whose architectures are particularly beneficial for surrogate modeling of PDE solutions. We estimate all parameters of our model simultaneously by minimizing a loss that is based on the objective function, multi-physics potential energy functionals, and design-constraints. We demonstrate the capability of the proposed framework on benchmark TO problems such as compliance minimization, heat conduction optimization, and compliant mechanism design under single- and multi-material settings. Additionally, we leverage thermo-mechanical TO with single- and multi-material options as a representative multi-physics problem. We also introduce differentiation and integration schemes that dramatically accelerate the training process. Our results demonstrate that the proposed PIGP framework can effectively solve coupled multi-physics and design problems simultaneously -- generating super-resolution topologies with sharp interfaces and physically interpretable material distributions. We validate these results using open-source codes and the commercial software package COMSOL.
• 摘要：机器学习 (ML) 越来越多地用于拓扑优化 (TO)。然而，大多数现有的基于机器学习的方法都专注于简化的基准问题，因为它们的计算成本高、频谱偏差以及处理复杂物理的困难。这些限制在目标函数或约束函数不自共的多材料、多物理问题中变得更加明显。为了应对这些挑战，我们提出了一个基于物理信息高斯过程（PIGP）的框架。在我们的方法中，主要变量、伴随变量和设计变量由独立的 GP 先验表示，其平均函数通过神经网络进行参数化，神经网络的架构特别有利于 PDE 解决方案的代理建模。我们通过最小化基于目标函数、多物理势能泛函和设计约束的损失来同时估计模型的所有参数。我们展示了所提出的框架在单材料和多材料设置下的柔顺最小化、热传导优化和柔顺机构设计等基准 TO 问题上的能力。此外，我们利用具有单材料和多材料选项的热机械 TO 作为代表性的多物理问题。我们还引入了差异化和集成方案，大大加快了培训过程。我们的结果表明，所提出的 PIGP 框架可以有效地同时解决耦合的多物理场和设计问题 - 生成具有清晰界面和物理可解释材料分布的超分辨率拓扑。我们使用开源代码和商业软件包 COMSOL 验证这些结果。

Title: LGD-Net: Latent-Guided Dual-Stream Network for HER2 Scoring with Task-Specific Domain Knowledge

• Authors: Peide Zhu, Linbin Lu, Zhiqin Chen, Xiong Chen
• Subjects: cs.CV, eess.IV
• Abstract URL: https://arxiv.org/abs/2602.17793
• Pdf URL: https://arxiv.org/pdf/2602.17793
• Copy Paste: [[2602.17793]] LGD-Net: Latent-Guided Dual-Stream Network for HER2 Scoring with Task-Specific Domain Knowledge(https://arxiv.org/abs/2602.17793)
• Keywords: generation
• Abstract: It is a critical task to evalaute HER2 expression level accurately for breast cancer evaluation and targeted treatment therapy selection. However, the standard multi-step Immunohistochemistry (IHC) staining is resource-intensive, expensive, and time-consuming, which is also often unavailable in many areas. Consequently, predicting HER2 levels directly from H&E slides has emerged as a potential alternative solution. It has been shown to be effective to use virtual IHC images from H&E images for automatic HER2 scoring. However, the pixel-level virtual staining methods are computationally expensive and prone to reconstruction artifacts that can propagate diagnostic errors. To address these limitations, we propose the Latent-Guided Dual-Stream Network (LGD-Net), a novel framework that employes cross-modal feature hallucination instead of explicit pixel-level image generation. LGD-Net learns to map morphological H&E features directly to the molecular latent space, guided by a teacher IHC encoder during training. To ensure the hallucinated features capture clinically relevant phenotypes, we explicitly regularize the model training with task-specific domain knowledge, specifically nuclei distribution and membrane staining intensity, via lightweight auxiliary regularization tasks. Extensive experiments on the public BCI dataset demonstrate that LGD-Net achieves state-of-the-art performance, significantly outperforming baseline methods while enabling efficient inference using single-modality H&E inputs.
• 摘要：准确评估HER2表达水平是乳腺癌评估和靶向治疗选择的关键任务。然而，标准的多步骤免疫组织化学 (IHC) 染色资源密集、昂贵且耗时，在许多地区通常也无法实现。因此，直接从 H&E 玻片预测 HER2 水平已成为一种潜在的替代解决方案。事实证明，使用来自 H&E 图像的虚拟 IHC 图像进行自动 HER2 评分是有效的。然而，像素级虚拟染色方法的计算成本很高，并且容易出现重建伪影，从而传播诊断错误。为了解决这些限制，我们提出了潜在引导双流网络（LGD-Net），这是一种采用跨模态特征幻觉而不是显式像素级图像生成的新颖框架。 LGD-Net 在训练期间由教师 IHC 编码器指导下，学习将形态 H&E 特征直接映射到分子潜在空间。为了确保幻觉特征捕获临床相关表型，我们通过轻量级辅助正则化任务，使用特定于任务的领域知识（特别是细胞核分布和膜染色强度）明确地正则化模型训练。对公共 BCI 数据集的大量实验表明，LGD-Net 实现了最先进的性能，显着优于基线方法，同时使用单模态 H&E 输入实现高效推理。

Title: Enabling Training-Free Text-Based Remote Sensing Segmentation

• Authors: Jose Sosa, Danila Rukhovich, Anis Kacem, Djamila Aouada
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.17799
• Pdf URL: https://arxiv.org/pdf/2602.17799
• Copy Paste: [[2602.17799]] Enabling Training-Free Text-Based Remote Sensing Segmentation(https://arxiv.org/abs/2602.17799)
• Keywords: generative
• Abstract: Recent advances in Vision Language Models (VLMs) and Vision Foundation Models (VFMs) have opened new opportunities for zero-shot text-guided segmentation of remote sensing imagery. However, most existing approaches still rely on additional trainable components, limiting their generalisation and practical applicability. In this work, we investigate to what extent text-based remote sensing segmentation can be achieved without additional training, by relying solely on existing foundation models. We propose a simple yet effective approach that integrates contrastive and generative VLMs with the Segment Anything Model (SAM), enabling a fully training-free or lightweight LoRA-tuned pipeline. Our contrastive approach employs CLIP as mask selector for SAM's grid-based proposals, achieving state-of-the-art open-vocabulary semantic segmentation (OVSS) in a completely zero-shot setting. In parallel, our generative approach enables reasoning and referring segmentation by generating click prompts for SAM using GPT-5 in a zero-shot setting and a LoRA-tuned Qwen-VL model, with the latter yielding the best results. Extensive experiments across 19 remote sensing benchmarks, including open-vocabulary, referring, and reasoning-based tasks, demonstrate the strong capabilities of our approach. Code will be released at this https URL.
• 摘要：视觉语言模型（VLM）和视觉基础模型（VFM）的最新进展为遥感图像的零样本文本引导分割开辟了新的机会。然而，大多数现有方法仍然依赖于额外的可训练组件，限制了它们的泛化和实际适用性。在这项工作中，我们研究了仅依靠现有基础模型，无需额外训练即可在多大程度上实现基于文本的遥感分割。我们提出了一种简单而有效的方法，将对比式和生成式 VLM 与分段任意模型 (SAM) 集成，从而实现完全免训练或轻量级 LoRA 调整的管道。我们的对比方法采用 CLIP 作为 SAM 基于网格的提案的掩码选择器，在完全零样本设置中实现最先进的开放词汇语义分割 (OVSS)。与此同时，我们的生成方法通过在零样本设置中使用 GPT-5 和 LoRA 调整的 Qwen-VL 模型生成 SAM 的点击提示来实现推理和引用分割，后者产生最佳结果。跨越 19 个遥感基准的广泛实验，包括开放词汇、引用和基于推理的任务，证明了我们方法的强大功能。代码将在此 https URL 发布。

Title: Avoid What You Know: Divergent Trajectory Balance for GFlowNets

• Authors: Pedro Dall'Antonia, Tiago da Silva, Daniel Csillag, Salem Lahlou, Diego Mesquita
• Subjects: cs.LG, stat.ML
• Abstract URL: https://arxiv.org/abs/2602.17827
• Pdf URL: https://arxiv.org/pdf/2602.17827
• Copy Paste: [[2602.17827]] Avoid What You Know: Divergent Trajectory Balance for GFlowNets(https://arxiv.org/abs/2602.17827)
• Keywords: generative
• Abstract: Generative Flow Networks (GFlowNets) are a flexible family of amortized samplers trained to generate discrete and compositional objects with probability proportional to a reward function. However, learning efficiency is constrained by the model's ability to rapidly explore diverse high-probability regions during training. To mitigate this issue, recent works have focused on incentivizing the exploration of unvisited and valuable states via curiosity-driven search and self-supervised random network distillation, which tend to waste samples on already well-approximated regions of the state space. In this context, we propose Adaptive Complementary Exploration (ACE), a principled algorithm for the effective exploration of novel and high-probability regions when learning GFlowNets. To achieve this, ACE introduces an exploration GFlowNet explicitly trained to search for high-reward states in regions underexplored by the canonical GFlowNet, which learns to sample from the target distribution. Through extensive experiments, we show that ACE significantly improves upon prior work in terms of approximation accuracy to the target distribution and discovery rate of diverse high-reward states.
• 摘要：生成流网络 (GFlowNets) 是一个灵活的摊销采样器系列，经过训练可以生成离散和组合对象，其概率与奖励函数成正比。然而，学习效率受到模型在训练过程中快速探索不同高概率区域的能力的限制。为了缓解这个问题，最近的工作重点是通过好奇心驱动的搜索和自我监督的随机网络蒸馏来激励对未访问过的有价值的状态的探索，这往往会在已经很好近似的状态空间区域上浪费样本。在这种背景下，我们提出了自适应互补探索（ACE），这是一种在学习 GFlowNet 时有效探索新颖和高概率区域的原则算法。为了实现这一目标，ACE 引入了一种经过明确训练的探索 GFlowNet，用于在规范 GFlowNet 未充分探索的区域中搜索高奖励状态，该模型学习从目标分布中进行采样。通过大量的实验，我们表明 ACE 在目标分布的近似精度和各种高奖励状态的发现率方面比之前的工作有了显着的改进。

Title: Causality by Abstraction: Symbolic Rule Learning in Multivariate Timeseries with Large Language Models

• Authors: Preetom Biswas, Giulia Pedrielli, K. Selçuk Candan
• Subjects: cs.LG
• Abstract URL: https://arxiv.org/abs/2602.17829
• Pdf URL: https://arxiv.org/pdf/2602.17829
• Copy Paste: [[2602.17829]] Causality by Abstraction: Symbolic Rule Learning in Multivariate Timeseries with Large Language Models(https://arxiv.org/abs/2602.17829)
• Keywords: generation
• Abstract: Inferring causal relations in timeseries data with delayed effects is a fundamental challenge, especially when the underlying system exhibits complex dynamics that cannot be captured by simple functional mappings. Traditional approaches often fail to produce generalized and interpretable explanations, as multiple distinct input trajectories may yield nearly indistinguishable outputs. In this work, we present ruleXplain, a framework that leverages Large Language Models (LLMs) to extract formal explanations for input-output relations in simulation-driven dynamical systems. Our method introduces a constrained symbolic rule language with temporal operators and delay semantics, enabling LLMs to generate verifiable causal rules through structured prompting. ruleXplain relies on the availability of a principled model (e.g., a simulator) that maps multivariate input time series to output time series. Within ruleXplain, the simulator is used to generate diverse counterfactual input trajectories that yield similar target output, serving as candidate explanations. Such counterfactual inputs are clustered and provided as context to the LLM, which is tasked with the generation of symbolic rules encoding the joint temporal trends responsible for the patterns observable in the output times series. A closed-loop refinement process ensures rule consistency and semantic validity. We validate the framework using the PySIRTEM epidemic simulator, mapping testing rate inputs to daily infection counts; and the EnergyPlus building energy simulator, observing temperature and solar irradiance inputs to electricity needs. For validation, we perform three classes of experiments: (1) the efficacy of the ruleset through input reconstruction; (2) ablation studies evaluating the causal encoding of the ruleset; and (3) generalization tests of the extracted rules across unseen output trends with varying phase dynamics.
• 摘要：推断具有延迟效应的时间序列数据中的因果关系是一项基本挑战，特别是当底层系统表现出无法通过简单函数映射捕获的复杂动态时。传统方法通常无法产生概括且可解释的解释，因为多个不同的输入轨迹可能会产生几乎无法区分的输出。在这项工作中，我们提出了ruleXplain，这是一个利用大型语言模型（LLM）为模拟驱动的动态系统中的输入输出关系提取正式解释的框架。我们的方法引入了带有时间运算符和延迟语义的约束符号规则语言，使法学硕士能够通过结构化提示生成可验证的因果规则。 RuleXplain 依赖于将多元输入时间序列映射到输出时间序列的原理模型（例如模拟器）的可用性。在ruleXplain中，模拟器用于生成不同的反事实输入轨迹，这些轨迹产生相似的目标输出，作为候选解释。这些反事实输入被聚类并作为LLM的上下文提供，LLM的任务是生成符号规则，编码负责输出时间序列中可观察到的模式的联合时间趋势。闭环细化过程确保规则一致性和语义有效性。我们使用 PySIRTEM 流行病模拟器验证框架，将测试率输入映射到每日感染计数； EnergyPlus 建筑能源模拟器，用于观察温度和太阳辐照度对电力需求的输入。为了验证，我们进行了三类实验：（1）通过输入重建规则集的功效； (2) 评估规则集因果编码的消融研究； (3) 对具有不同阶段动态的未见输出趋势的提取规则进行泛化测试。

Title: Financial time series augmentation using transformer based GAN architecture

• Authors: Andrzej Podobiński, Jarosław A. Chudziak
• Subjects: cs.LG, cs.AI
• Abstract URL: https://arxiv.org/abs/2602.17865
• Pdf URL: https://arxiv.org/pdf/2602.17865
• Copy Paste: [[2602.17865]] Financial time series augmentation using transformer based GAN architecture(https://arxiv.org/abs/2602.17865)
• Keywords: generative
• Abstract: Time-series forecasting is a critical task across many domains, from engineering to economics, where accurate predictions drive strategic decisions. However, applying advanced deep learning models in challenging, volatile domains like finance is difficult due to the inherent limitation and dynamic nature of financial time series data. This scarcity often results in sub-optimal model training and poor generalization. The fundamental challenge lies in determining how to reliably augment scarce financial time series data to enhance the predictive accuracy of deep learning forecasting models. Our main contribution is a demonstration of how Generative Adversarial Networks (GANs) can effectively serve as a data augmentation tool to overcome data scarcity in the financial domain. Specifically, we show that training a Long Short-Term Memory (LSTM) forecasting model on a dataset augmented with synthetic data generated by a transformer-based GAN (TTS-GAN) significantly improves the forecasting accuracy compared to using real data alone. We confirm these results across different financial time series (Bitcoin and S\&P500 price data) and various forecasting horizons. Furthermore, we propose a novel, time series specific quality metric that combines Dynamic Time Warping (DTW) and a modified Deep Dataset Dissimilarity Measure (DeD-iMs) to reliably monitor the training progress and evaluate the quality of the generated data. These findings provide compelling evidence for the benefits of GAN-based data augmentation in enhancing financial predictive capabilities.
• 摘要：时间序列预测是从工程到经济学等许多领域的一项关键任务，准确的预测可以推动战略决策。然而，由于金融时间序列数据固有的局限性和动态性，在金融等具有挑战性、不稳定的领域应用先进的深度学习模型是很困难的。这种稀缺性通常会导致模型训练欠佳和泛化能力差。根本挑战在于确定如何可靠地增强稀缺的金融时间序列数据，以提高深度学习预测模型的预测准确性。我们的主要贡献是演示生成对抗网络（GAN）如何有效地作为数据增强工具来克服金融领域的数据稀缺问题。具体来说，我们表明，与单独使用真实数据相比，在使用基于变压器的 GAN (TTS-GAN) 生成的合成数据增强的数据集上训练长短期记忆 (LSTM) 预测模型可显着提高预测准确性。我们在不同的金融时间序列（比特币和标准普尔 500 价格数据）和不同的预测范围内确认了这些结果。此外，我们提出了一种新颖的时间序列特定质量度量，该度量结合了动态时间规整（DTW）和修改后的深度数据集相异性度量（DeD-iMs），以可靠地监控训练进度并评估生成数据的质量。这些发现为基于 GAN 的数据增强在增强财务预测能力方面的优势提供了令人信服的证据。

Title: A Single Image and Multimodality Is All You Need for Novel View Synthesis

• Authors: Amirhosein Javadi, Chi-Shiang Gau, Konstantinos D. Polyzos, Tara Javidi
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.17909
• Pdf URL: https://arxiv.org/pdf/2602.17909
• Copy Paste: [[2602.17909]] A Single Image and Multimodality Is All You Need for Novel View Synthesis(https://arxiv.org/abs/2602.17909)
• Keywords: generation, generative
• Abstract: Diffusion-based approaches have recently demonstrated strong performance for single-image novel view synthesis by conditioning generative models on geometry inferred from monocular depth estimation. However, in practice, the quality and consistency of the synthesized views are fundamentally limited by the reliability of the underlying depth estimates, which are often fragile under low texture, adverse weather, and occlusion-heavy real-world conditions. In this work, we show that incorporating sparse multimodal range measurements provides a simple yet effective way to overcome these limitations. We introduce a multimodal depth reconstruction framework that leverages extremely sparse range sensing data, such as automotive radar or LiDAR, to produce dense depth maps that serve as robust geometric conditioning for diffusion-based novel view synthesis. Our approach models depth in an angular domain using a localized Gaussian Process formulation, enabling computationally efficient inference while explicitly quantifying uncertainty in regions with limited observations. The reconstructed depth and uncertainty are used as a drop-in replacement for monocular depth estimators in existing diffusion-based rendering pipelines, without modifying the generative model itself. Experiments on real-world multimodal driving scenes demonstrate that replacing vision-only depth with our sparse range-based reconstruction substantially improves both geometric consistency and visual quality in single-image novel-view video generation. These results highlight the importance of reliable geometric priors for diffusion-based view synthesis and demonstrate the practical benefits of multimodal sensing even at extreme levels of sparsity.
• 摘要：基于扩散的方法最近通过调节从单目深度估计推断出的几何形状的生成模型，证明了单图像新颖视图合成的强大性能。然而，在实践中，合成视图的质量和一致性从根本上受到底层深度估计可靠性的限制，在低纹理、恶劣天气和遮挡严重的现实世界条件下，这些估计通常很脆弱。在这项工作中，我们表明，结合稀疏多模态范围测量提供了一种简单而有效的方法来克服这些限制。我们引入了一种多模态深度重建框架，该框架利用极其稀疏的距离感测数据（例如汽车雷达或激光雷达）来生成密集的深度图，作为基于扩散的新颖视图合成的稳健几何条件。我们的方法使用局部高斯过程公式对角域中的深度进行建模，从而实现计算高效的推理，同时明确量化观测有限的区域中的不确定性。重建的深度和不确定性被用作现有基于扩散的渲染管道中单目深度估计器的直接替代品，而无需修改生成模型本身。对现实世界多模态驾驶场景的实验表明，用基于稀疏范围的重建替换仅视觉深度可以显着提高单图像新颖视图视频生成中的几何一致性和视觉质量。这些结果强调了可靠的几何先验对于基于扩散的视图合成的重要性，并证明了即使在极端稀疏的情况下多模态传感的实际好处。

Title: Causal Neighbourhood Learning for Invariant Graph Representations

• Authors: Simi Job, Xiaohui Tao, Taotao Cai, Haoran Xie, Jianming Yong
• Subjects: cs.LG, cs.AI
• Abstract URL: https://arxiv.org/abs/2602.17934
• Pdf URL: https://arxiv.org/pdf/2602.17934
• Copy Paste: [[2602.17934]] Causal Neighbourhood Learning for Invariant Graph Representations(https://arxiv.org/abs/2602.17934)
• Keywords: generation
• Abstract: Graph data often contain noisy and spurious correlations that mask the true causal relationships, which are essential for enabling graph models to make predictions based on the underlying causal structure of the data. Dependence on spurious connections makes it challenging for traditional Graph Neural Networks (GNNs) to generalize effectively across different graphs. Furthermore, traditional aggregation methods tend to amplify these spurious patterns, limiting model robustness under distribution shifts. To address these issues, we propose Causal Neighbourhood Learning with Graph Neural Networks (CNL-GNN), a novel framework that performs causal interventions on graph structure. CNL-GNN effectively identifies and preserves causally relevant connections and reduces spurious influences through the generation of counterfactual neighbourhoods and adaptive edge perturbation guided by learnable importance masking and an attention-based mechanism. In addition, by combining structural-level interventions with the disentanglement of causal features from confounding factors, the model learns invariant node representations that are robust and generalize well across different graph structures. Our approach improves causal graph learning beyond traditional feature-based methods, resulting in a robust classification model. Extensive experiments on four publicly available datasets, including multiple domain variants of one dataset, demonstrate that CNL-GNN outperforms state-of-the-art GNN models.
• 摘要：图数据通常包含噪声和虚假相关性，掩盖了真实的因果关系，这对于使图模型能够根据数据的底层因果结构进行预测至关重要。对虚假连接的依赖使得传统的图神经网络（GNN）很难在不同的图上有效地泛化。此外，传统的聚合方法往往会放大这些虚假模式，从而限制了模型在分布变化下的稳健性。为了解决这些问题，我们提出了图神经网络因果邻域学习（CNL-GNN），这是一种对图结构进行因果干预的新颖框架。 CNL-GNN 有效地识别和保留因果相关连接，并通过生成反事实邻域和由可学习重要性掩蔽和基于注意力的机制引导的自适应边缘扰动来减少虚假影响。此外，通过将结构层面的干预与从混杂因素中解开因果特征相结合，该模型可以学习稳健的节点表示，并且可以在不同的图结构中很好地泛化。我们的方法改进了因果图学习，超越了传统的基于特征的方法，从而产生了强大的分类模型。对四个公开可用的数据集（包括一个数据集的多个域变体）进行的广泛实验表明，CNL-GNN 优于最先进的 GNN 模型。

Title: Turbo Connection: Reasoning as Information Flow from Higher to Lower Layers

• Authors: Mohan Tang, Sidi Lu
• Subjects: cs.LG, cs.AI
• Abstract URL: https://arxiv.org/abs/2602.17993
• Pdf URL: https://arxiv.org/pdf/2602.17993
• Copy Paste: [[2602.17993]] Turbo Connection: Reasoning as Information Flow from Higher to Lower Layers(https://arxiv.org/abs/2602.17993)
• Keywords: generation
• Abstract: Complex problems, whether in math, logic, or planning, are solved by humans through a sequence of steps where the result of one step informs the next. In this work, we adopt the perspective that the reasoning power of Transformers is fundamentally limited by a fixed maximum number of steps along any latent path of computation. To address this, we introduce Turbo Connection (TurboConn), a novel architecture that overcomes the fixed-depth constraint by routing multiple residual connections from the higher-layer hidden states of each token $t$ to the lower layers of token $t+1$. Fine-tuning pre-trained LLMs with our method not only yields accuracy gains of 0.9% to over 10% on benchmarks like GSM8K, Parity, and multi-step arithmetic, but also demonstrates that the density of these backward connections is critical; our dense interaction significantly outperforms "sparse" alternatives that only pass a single hidden state or vector. Notably, TurboConn can be integrated into pre-trained LLMs to overcome task-specific plateaus: while a fine-tuned Qwen-3-1.7B achieves only 53.78% on Parity, adding our architectural modification enables the model to reach 100% accuracy, all without the necessity to retrain the full model from scratch or sophisticated curriculum learning. Our results provide strong empirical evidence that the depth of the computational path is a key factor in reasoning ability, also offering a new mechanism to enhance LLMs without significantly affecting generation latency.
• 摘要：复杂的问题，无论是数学、逻辑还是规划，都是由人类通过一系列步骤来解决，其中一个步骤的结果通知下一步。在这项工作中，我们采用的观点是，变形金刚的推理能力从根本上受到任何潜在计算路径上固定的最大步骤数的限制。为了解决这个问题，我们引入了 Turbo Connection (TurboConn)，这是一种新颖的架构，它通过将多个残差连接从每个令牌 $t$ 的较高层隐藏状态路由到令牌 $t+1$ 的较低层来克服固定深度约束。使用我们的方法对预训练的 LLM 进行微调，不仅可以在 GSM8K、Parity 和多步算术等基准测试中获得 0.9% 到 10% 以上的准确率增益，而且还证明了这些后向连接的密度至关重要；我们的密集交互明显优于仅传递单个隐藏状态或向量的“稀疏”替代方案。值得注意的是，TurboConn 可以集成到预先训练的 LLM 中，以克服特定于任务的平台：虽然经过微调的 Qwen-3-1.7B 在 Parity 上仅达到 53.78%，但添加我们的架构修改使模型能够达到 100% 的准确性，而无需从头开始重新训练完整模型或复杂的课程学习。我们的结果提供了强有力的经验证据，证明计算路径的深度是推理能力的关键因素，同时也提供了一种新的机制来增强 LLM，而不会显着影响生成延迟。

Title: Image Quality Assessment: Exploring Quality Awareness via Memory-driven Distortion Patterns Matching

• Authors: Xuting Lan, Mingliang Zhou, Xuekai Wei, Jielu Yan, Yueting Huang, Huayan Pu, Jun Luo, Weijia Jia
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.18000
• Pdf URL: https://arxiv.org/pdf/2602.18000
• Copy Paste: [[2602.18000]] Image Quality Assessment: Exploring Quality Awareness via Memory-driven Distortion Patterns Matching(https://arxiv.org/abs/2602.18000)
• Keywords: quality assessment
• Abstract: Existing full-reference image quality assessment (FR-IQA) methods achieve high-precision evaluation by analysing feature differences between reference and distorted images. However, their performance is constrained by the quality of the reference image, which limits real-world applications where ideal reference sources are unavailable. Notably, the human visual system has the ability to accumulate visual memory, allowing image quality assessment on the basis of long-term memory storage. Inspired by this biological memory mechanism, we propose a memory-driven quality-aware framework (MQAF), which establishes a memory bank for storing distortion patterns and dynamically switches between dual-mode quality assessment strategies to reduce reliance on high-quality reference images. When reference images are available, MQAF obtains reference-guided quality scores by adaptively weighting reference information and comparing the distorted image with stored distortion patterns in the memory bank. When the reference image is absent, the framework relies on distortion patterns in the memory bank to infer image quality, enabling no-reference quality assessment (NR-IQA). The experimental results show that our method outperforms state-of-the-art approaches across multiple datasets while adapting to both no-reference and full-reference tasks.
• 摘要：现有的全参考图像质量评估（FR-IQA）方法通过分析参考图像和失真图像之间的特征差异来实现高精度评估。然而，它们的性能受到参考图像质量的限制，这限制了无法获得理想参考源的实际应用。值得注意的是，人类视觉系统具有积累视觉记忆的能力，可以在长期记忆存储的基础上进行图像质量评估。受这种生物记忆机制的启发，我们提出了一种内存驱动的质量感知框架（MQAF），它建立了一个用于存储失真模式的记忆库，并在双模式质量评估策略之间动态切换，以减少对高质量参考图像的依赖。当参考图像可用时，MQAF 通过自适应地加权参考信息并将失真图像与存储库中存储的失真模式进行比较，获得参考引导的质量分数。当参考图像不存在时，该框架依靠存储库中的失真模式来推断图像质量，从而实现无参考质量评估（NR-IQA）。实验结果表明，我们的方法在多个数据集上优于最先进的方法，同时适应无参考和全参考任务。

Title: UAOR: Uncertainty-aware Observation Reinjection for Vision-Language-Action Models

• Authors: Jiabing Yang, Yixiang Chen, Yuan Xu, Peiyan Li, Xiangnan Wu, Zichen Wen, Bowen Fang, Tao Yu, Zhengbo Zhang, Yingda Li, Kai Wang, Jing Liu, Nianfeng Liu, Yan Huang, Liang Wang
• Subjects: cs.CV, cs.RO
• Abstract URL: https://arxiv.org/abs/2602.18020
• Pdf URL: https://arxiv.org/pdf/2602.18020
• Copy Paste: [[2602.18020]] UAOR: Uncertainty-aware Observation Reinjection for Vision-Language-Action Models(https://arxiv.org/abs/2602.18020)
• Keywords: generation
• Abstract: Vision-Language-Action (VLA) models leverage pretrained Vision-Language Models (VLMs) as backbones to map images and instructions to actions, demonstrating remarkable potential for generalizable robotic manipulation. To enhance performance, existing methods often incorporate extra observation cues (e.g., depth maps, point clouds) or auxiliary modules (e.g., object detectors, encoders) to enable more precise and reliable task execution, yet these typically require costly data collection and additional training. Inspired by the finding that Feed-Forward Network (FFN) in language models can act as "key-value memory", we propose Uncertainty-aware Observation Reinjection (UAOR), an effective, training-free and plug-and-play module for VLA models. Specifically, when the current language model layer exhibits high uncertainty, measured by Action Entropy, it reinjects key observation information into the next layer's Feed-Forward Network (FFN) through attention retrieval. This mechanism helps VLAs better attend to observations during inference, enabling more confident and faithful action generation. Comprehensive experiments show that our method consistently improves diverse VLA models across simulation and real-world tasks with minimal overhead. Notably, UAOR eliminates the need for additional observation cues or modules, making it a versatile and practical plug-in for existing VLA pipelines. The project page is at this https URL.
• 摘要：视觉语言动作 (VLA) 模型利用预训练的视觉语言模型 (VLM) 作为骨干，将图像和指令映射到动作，展示了通用机器人操作的巨大潜力。为了提高性能，现有方法通常结合额外的观察线索（例如深度图、点云）或辅助模块（例如对象检测器、编码器）以实现更精确和可靠的任务执行，但这些通常需要昂贵的数据收集和额外的训练。受到语言模型中的前馈网络（FFN）可以充当“键值记忆”这一发现的启发，我们提出了不确定性感知观察重注入（UAOR），这是一种有效的、免训练的、即插即用的 VLA 模型模块。具体来说，当当前语言模型层表现出通过动作熵测量的高度不确定性时，它会通过注意力检索将关键观察信息重新注入到下一层的前馈网络（FFN）中。这种机制可以帮助 VLA 在推理过程中更好地关注观察结果，从而实现更加自信和忠实的行动生成。综合实验表明，我们的方法能够以最小的开销持续改进模拟和现实任务中的各种 VLA 模型。值得注意的是，UAOR 不需要额外的观察线索或模块，使其成为现有 VLA 管道的多功能且实用的插件。项目页面位于此 https URL。

Title: Continual-NExT: A Unified Comprehension And Generation Continual Learning Framework

• Authors: Jingyang Qiao, Zhizhong Zhang, Xin Tan, Jingyu Gong, Yanyun Qu, Yuan Xie
• Subjects: cs.LG
• Abstract URL: https://arxiv.org/abs/2602.18055
• Pdf URL: https://arxiv.org/pdf/2602.18055
• Copy Paste: [[2602.18055]] Continual-NExT: A Unified Comprehension And Generation Continual Learning Framework(https://arxiv.org/abs/2602.18055)
• Keywords: generation
• Abstract: Dual-to-Dual MLLMs refer to Multimodal Large Language Models, which can enable unified multimodal comprehension and generation through text and image modalities. Although exhibiting strong instantaneous learning and generalization capabilities, Dual-to-Dual MLLMs still remain deficient in lifelong evolution, significantly affecting continual adaptation to dynamic real-world scenarios. One of the challenges is that learning new tasks inevitably destroys the learned knowledge. Beyond traditional catastrophic forgetting, Dual-to-Dual MLLMs face other challenges, including hallucination, instruction unfollowing, and failures in cross-modal knowledge transfer. However, no standardized continual learning framework for Dual-to-Dual MLLMs has been established yet, leaving these challenges unexplored. Thus, in this paper, we establish Continual-NExT, a continual learning framework for Dual-to-Dual MLLMs with deliberately-architected evaluation metrics. To improve the continual learning capability of Dual-to-Dual MLLMs, we propose an efficient MAGE (Mixture and Aggregation of General LoRA and Expert LoRA) method to further facilitate knowledge transfer across modalities and mitigate forgetting. Extensive experiments demonstrate that MAGE outperforms other continual learning methods and achieves state-of-the-art performance.
• 摘要：Dual-to-Dual MLLM 是指多模态大语言模型，它可以通过文本和图像模态实现统一的多模态理解和生成。尽管表现出强大的瞬时学习和泛化能力，但双对双 MLLM 在终身进化方面仍然存在缺陷，严重影响了对动态现实场景的持续适应。挑战之一是学习新任务不可避免地会破坏所学的知识。除了传统的灾难性遗忘之外，双对双 MLLM 还面临其他挑战，包括幻觉、不遵循指令以及跨模式知识转移失败。然而，目前尚未建立双元 MLLM 的标准化持续学习框架，因此这些挑战尚未得到探索。因此，在本文中，我们建立了 Continual-NExT，这是一个用于双对双 MLLM 的持续学习框架，具有精心设计的评估指标。为了提高双对双 MLLM 的持续学习能力，我们提出了一种有效的 MAGE（通用 LoRA 和专家 LoRA 的混合和聚合）方法，以进一步促进跨模态的知识转移并减少遗忘。大量实验表明，MAGE 优于其他持续学习方法，并实现了最先进的性能。

Title: Temporal Consistency-Aware Text-to-Motion Generation

• Authors: Hongsong Wang, Wenjing Yan, Qiuxia Lai, Xin Geng
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.18057
• Pdf URL: https://arxiv.org/pdf/2602.18057
• Copy Paste: [[2602.18057]] Temporal Consistency-Aware Text-to-Motion Generation(https://arxiv.org/abs/2602.18057)
• Keywords: generation
• Abstract: Text-to-Motion (T2M) generation aims to synthesize realistic human motion sequences from natural language descriptions. While two-stage frameworks leveraging discrete motion representations have advanced T2M research, they often neglect cross-sequence temporal consistency, i.e., the shared temporal structures present across different instances of the same action. This leads to semantic misalignments and physically implausible motions. To address this limitation, we propose TCA-T2M, a framework for temporal consistency-aware T2M generation. Our approach introduces a temporal consistency-aware spatial VQ-VAE (TCaS-VQ-VAE) for cross-sequence temporal alignment, coupled with a masked motion transformer for text-conditioned motion generation. Additionally, a kinematic constraint block mitigates discretization artifacts to ensure physical plausibility. Experiments on HumanML3D and KIT-ML benchmarks demonstrate that TCA-T2M achieves state-of-the-art performance, highlighting the importance of temporal consistency in robust and coherent T2M generation.
• 摘要：文本到动作（T2M）生成旨在从自然语言描述中合成真实的人体动作序列。虽然利用离散运动表示的两阶段框架具有先进的 T2M 研究，但它们经常忽略跨序列时间一致性，即同一动作的不同实例之间存在的共享时间结构。这会导致语义错位和物理上难以置信的运动。为了解决这个限制，我们提出了 TCA-T2M，一个用于时间一致性感知 T2M 生成的框架。我们的方法引入了用于跨序列时间对齐的时间一致性感知空间 VQ-VAE (TCaS-VQ-VAE)，以及用于生成文本条件运动的屏蔽运动变换器。此外，运动学约束块可以减轻离散化伪影，以确保物理合理性。 HumanML3D 和 KIT-ML 基准测试表明 TCA-T2M 实现了最先进的性能，凸显了时间一致性在鲁棒且连贯的 T2M 生成中的重要性。

Title: Balancing Symmetry and Efficiency in Graph Flow Matching

• Authors: Benjamin Honoré, Alba Carballo-Castro, Yiming Qin, Pascal Frossard
• Subjects: cs.LG
• Abstract URL: https://arxiv.org/abs/2602.18084
• Pdf URL: https://arxiv.org/pdf/2602.18084
• Copy Paste: [[2602.18084]] Balancing Symmetry and Efficiency in Graph Flow Matching(https://arxiv.org/abs/2602.18084)
• Keywords: generative
• Abstract: Equivariance is central to graph generative models, as it ensures the model respects the permutation symmetry of graphs. However, strict equivariance can increase computational cost due to added architectural constraints, and can slow down convergence because the model must be consistent across a large space of possible node permutations. We study this trade-off for graph generative models. Specifically, we start from an equivariant discrete flow-matching model, and relax its equivariance during training via a controllable symmetry modulation scheme based on sinusoidal positional encodings and node permutations. Experiments first show that symmetry-breaking can accelerate early training by providing an easier learning signal, but at the expense of encouraging shortcut solutions that can cause overfitting, where the model repeatedly generates graphs that are duplicates of the training set. On the contrary, properly modulating the symmetry signal can delay overfitting while accelerating convergence, allowing the model to reach stronger performance with $19\%$ of the baseline training epochs.
• 摘要：等方差是图生成模型的核心，因为它确保模型尊重图的排列对称性。然而，由于增加了架构约束，严格的等方差会增加计算成本，并且会减慢收敛速度，因为模型必须在可能的节点排列的大空间中保持一致。我们研究图生成模型的这种权衡。具体来说，我们从等变离散流匹配模型开始，并通过基于正弦位置编码和节点排列的可控对称调制方案在训练过程中放松其等变性。实验首先表明，对称性破缺可以通过提供更容易的学习信号来加速早期训练，但代价是鼓励可能导致过度拟合的捷径解决方案，其中模型重复生成与训练集重复的图。相反，适当调制对称信号可以延迟过拟合，同时加速收敛，使模型在 $19\%$ 的基线训练周期内达到更强的性能。

Title: DohaScript: A Large-Scale Multi-Writer Dataset for Continuous Handwritten Hindi Text

• Authors: Kunwar Arpit Singh, Ankush Prakash, Haroon R Lone
• Subjects: cs.CV, cs.AI, cs.LG
• Abstract URL: https://arxiv.org/abs/2602.18089
• Pdf URL: https://arxiv.org/pdf/2602.18089
• Copy Paste: [[2602.18089]] DohaScript: A Large-Scale Multi-Writer Dataset for Continuous Handwritten Hindi Text(https://arxiv.org/abs/2602.18089)
• Keywords: generative
• Abstract: Despite having hundreds of millions of speakers, handwritten Devanagari text remains severely underrepresented in publicly available benchmark datasets. Existing resources are limited in scale, focus primarily on isolated characters or short words, and lack controlled lexical content and writer level diversity, which restricts their utility for modern data driven handwriting analysis. As a result, they fail to capture the continuous, fused, and structurally complex nature of Devanagari handwriting, where characters are connected through a shared shirorekha (horizontal headline) and exhibit rich ligature formations. We introduce DohaScript, a large scale, multi writer dataset of handwritten Hindi text collected from 531 unique contributors. The dataset is designed as a parallel stylistic corpus, in which all writers transcribe the same fixed set of six traditional Hindi dohas (couplets). This controlled design enables systematic analysis of writer specific variation independent of linguistic content, and supports tasks such as handwriting recognition, writer identification, style analysis, and generative modeling. The dataset is accompanied by non identifiable demographic metadata, rigorous quality curation based on objective sharpness and resolution criteria, and page level layout difficulty annotations that facilitate stratified benchmarking. Baseline experiments demonstrate clear quality separation and strong generalization to unseen writers, highlighting the dataset's reliability and practical value. DohaScript is intended to serve as a standardized and reproducible benchmark for advancing research on continuous handwritten Devanagari text in low resource script settings.
• 摘要：尽管拥有数亿使用者，但手写天城文文本在公开可用的基准数据集中的代表性仍然严重不足。现有资源规模有限，主要集中在孤立的字符或短词上，缺乏受控的词汇内容和作者水平的多样性，这限制了它们在现代数据驱动的手写分析中的实用性。因此，它们无法捕捉天成体手写体的连续、融合和结构复杂的本质，其中字符通过共享的 shirorekha（水平标题）连接并表现出丰富的连字形式。我们介绍 DohaScript，这是一个大规模、多作者手写印地语文本数据集，从 531 位独特的贡献者收集。该数据集被设计为一个平行的文体语料库，其中所有作家都转录相同的固定组六个传统印地语多哈（对联）。这种受控设计能够对独立于语言内容的作者特定变化进行系统分析，并支持手写识别、作者识别、风格分析和生成建模等任务。该数据集伴随着不可识别的人口统计元数据、基于客观清晰度和分辨率标准的严格质量管理，以及促进分层基准测试的页面级布局难度注释。基线实验向未见过的作者展示了清晰的质量分离和强大的泛化能力，突出了数据集的可靠性和实用价值。 DohaScript 旨在作为标准化和可重复的基准，以推进低资源脚本环境中连续手写梵文文本的研究。

Title: Predict to Skip: Linear Multistep Feature Forecasting for Efficient Diffusion Transformers

• Authors: Hanshuai Cui, Zhiqing Tang, Qianli Ma, Zhi Yao, Weijia Jia
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.18093
• Pdf URL: https://arxiv.org/pdf/2602.18093
• Copy Paste: [[2602.18093]] Predict to Skip: Linear Multistep Feature Forecasting for Efficient Diffusion Transformers(https://arxiv.org/abs/2602.18093)
• Keywords: generation
• Abstract: Diffusion Transformers (DiT) have emerged as a widely adopted backbone for high-fidelity image and video generation, yet their iterative denoising process incurs high computational costs. Existing training-free acceleration methods rely on feature caching and reuse under the assumption of temporal stability. However, reusing features for multiple steps may lead to latent drift and visual degradation. We observe that model outputs evolve smoothly along much of the diffusion trajectory, enabling principled predictions rather than naive reuse. Based on this insight, we propose \textbf{PrediT}, a training-free acceleration framework that formulates feature prediction as a linear multistep problem. We employ classical linear multistep methods to forecast future model outputs from historical information, combined with a corrector that activates in high-dynamics regions to prevent error accumulation. A dynamic step modulation mechanism adaptively adjusts the prediction horizon by monitoring the feature change rate. Together, these components enable substantial acceleration while preserving generation fidelity. Extensive experiments validate that our method achieves up to $5.54\times$ latency reduction across various DiT-based image and video generation models, while incurring negligible quality degradation.
• 摘要：扩散变压器（DiT）已成为广泛采用的高保真图像和视频生成的骨干，但其迭代去噪过程会产生高昂的计算成本。现有的免训练加速方法依赖于时间稳定性假设下的特征缓存和重用。然而，在多个步骤中重用特征可能会导致潜在漂移和视觉退化。我们观察到模型输出沿着大部分扩散轨迹平稳演变，从而实现有原则的预测而不是幼稚的重用。基于这一见解，我们提出了 \textbf{PrediT}，这是一种免训练加速框架，它将特征预测表述为线性多步问题。我们采用经典的线性多步方法根据历史信息预测未来的模型输出，并结合在高动态区域激活的校正器以防止误差累积。动态步进调制机制通过监控特征变化率来自适应调整预测范围。这些组件共同实现了大幅加速，同时保持了生成保真度。大量实验验证，我们的方法在各种基于 DiT 的图像和视频生成模型中实现了高达 5.54 美元×$ 的延迟减少，同时引起的质量下降可以忽略不计。

Title: Flow Matching with Injected Noise for Offline-to-Online Reinforcement Learning

• Authors: Yongjae Shin, Jongseong Chae, Jongeui Park, Youngchul Sung
• Subjects: cs.LG, cs.AI
• Abstract URL: https://arxiv.org/abs/2602.18117
• Pdf URL: https://arxiv.org/pdf/2602.18117
• Copy Paste: [[2602.18117]] Flow Matching with Injected Noise for Offline-to-Online Reinforcement Learning(https://arxiv.org/abs/2602.18117)
• Keywords: generative
• Abstract: Generative models have recently demonstrated remarkable success across diverse domains, motivating their adoption as expressive policies in reinforcement learning (RL). While they have shown strong performance in offline RL, particularly where the target distribution is well defined, their extension to online fine-tuning has largely been treated as a direct continuation of offline pre-training, leaving key challenges unaddressed. In this paper, we propose Flow Matching with Injected Noise for Offline-to-Online RL (FINO), a novel method that leverages flow matching-based policies to enhance sample efficiency for offline-to-online RL. FINO facilitates effective exploration by injecting noise into policy training, thereby encouraging a broader range of actions beyond those observed in the offline dataset. In addition to exploration-enhanced flow policy training, we combine an entropy-guided sampling mechanism to balance exploration and exploitation, allowing the policy to adapt its behavior throughout online fine-tuning. Experiments across diverse, challenging tasks demonstrate that FINO consistently achieves superior performance under limited online budgets.
• 摘要：生成模型最近在不同领域取得了显着的成功，促使它们被采用作为强化学习（RL）中的表达策略。虽然它们在离线强化学习中表现出了强劲的性能，特别是在目标分布明确的情况下，但它们对在线微调的扩展在很大程度上被视为离线预训练的直接延续，而导致关键挑战没有得到解决。在本文中，我们提出了离线到在线 RL 的注入噪声流匹配（FINO），这是一种利用基于流匹配的策略来提高离线到在线 RL 样本效率的新方法。 FINO 通过在政策培训中注入噪音来促进有效探索，从而鼓励采取离线数据集中观察到的更广泛的行动。除了探索增强的流策略训练之外，我们还结合了熵引导采样机制来平衡探索和利用，使策略能够在整个在线微调过程中调整其行为。跨各种具有挑战性的任务的实验表明，FINO 在有限的在线预算下始终能够实现卓越的性能。

Title: LERD: Latent Event-Relational Dynamics for Neurodegenerative Classification

• Authors: Hairong Chen, Yicheng Feng, Ziyu Jia, Samir Bhatt, Hengguan Huang
• Subjects: cs.LG, cs.AI
• Abstract URL: https://arxiv.org/abs/2602.18195
• Pdf URL: https://arxiv.org/pdf/2602.18195
• Copy Paste: [[2602.18195]] LERD: Latent Event-Relational Dynamics for Neurodegenerative Classification(https://arxiv.org/abs/2602.18195)
• Keywords: generation, generative
• Abstract: Alzheimer's disease (AD) alters brain electrophysiology and disrupts multichannel EEG dynamics, making accurate and clinically useful EEG-based diagnosis increasingly important for screening and disease monitoring. However, many existing approaches rely on black-box classifiers and do not explicitly model the underlying dynamics that generate observed signals. To address these limitations, we propose LERD, an end-to-end Bayesian electrophysiological neural dynamical system that infers latent neural events and their relational structure directly from multichannel EEG without event or interaction annotations. LERD combines a continuous-time event inference module with a stochastic event-generation process to capture flexible temporal patterns, while incorporating an electrophysiology-inspired dynamical prior to guide learning in a principled way. We further provide theoretical analysis that yields a tractable bound for training and stability guarantees for the inferred relational dynamics. Extensive experiments on synthetic benchmarks and two real-world AD EEG cohorts demonstrate that LERD consistently outperforms strong baselines and yields physiology-aligned latent summaries that help characterize group-level dynamical differences.
• 摘要：阿尔茨海默病 (AD) 会改变大脑电生理学并破坏多通道脑电图动态，使得基于脑电图的准确且临床有用的诊断对于筛查和疾病监测变得越来越重要。然而，许多现有方法依赖于黑盒分类器，并且没有明确地对生成观察信号的底层动态进行建模。为了解决这些局限性，我们提出了 LERD，这是一种端到端的贝叶斯电生理神经动力系统，可以直接从多通道脑电图推断潜在的神经事件及其关系结构，而无需事件或交互注释。 LERD 将连续时间事件推理模块与随机事件生成过程相结合，以捕获灵活的时间模式，同时结合电生理学启发的动力学，以有原则的方式指导学习。我们进一步提供理论分析，为推断的关系动态提供训练的易处理范围和稳定性保证。对综合基准和两个现实世界 AD EEG 队列的广泛实验表明，LERD 始终优于强大的基线，并产生符合生理学的潜在总结，有助于表征群体水平的动态差异。

Title: A Self-Supervised Approach on Motion Calibration for Enhancing Physical Plausibility in Text-to-Motion

• Authors: Gahyeon Shim, Soogeun Park, Hyemin Ahn
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.18199
• Pdf URL: https://arxiv.org/pdf/2602.18199
• Copy Paste: [[2602.18199]] A Self-Supervised Approach on Motion Calibration for Enhancing Physical Plausibility in Text-to-Motion(https://arxiv.org/abs/2602.18199)
• Keywords: generation
• Abstract: Generating semantically aligned human motion from textual descriptions has made rapid progress, but ensuring both semantic and physical realism in motion remains a challenge. In this paper, we introduce the Distortion-aware Motion Calibrator (DMC), a post-hoc module that refines physically implausible motions (e.g., foot floating) while preserving semantic consistency with the original textual description. Rather than relying on complex physical modeling, we propose a self-supervised and data-driven approach, whereby DMC learns to obtain physically plausible motions when an intentionally distorted motion and the original textual descriptions are given as inputs. We evaluate DMC as a post-hoc module to improve motions obtained from various text-to-motion generation models and demonstrate its effectiveness in improving physical plausibility while enhancing semantic consistency. The experimental results show that DMC reduces FID score by 42.74% on T2M and 13.20% on T2M-GPT, while also achieving the highest R-Precision. When applied to high-quality models like MoMask, DMC improves the physical plausibility of motions by reducing penetration by 33.0% as well as adjusting floating artifacts closer to the ground-truth reference. These results highlight that DMC can serve as a promising post-hoc motion refinement framework for any kind of text-to-motion models by incorporating textual semantics and physical plausibility.
• 摘要：从文本描述生成语义一致的人体运动已经取得了快速进展，但确保运动中的语义和物理真实性仍然是一个挑战。在本文中，我们介绍了失真感知运动校准器（DMC），这是一个事后模块，可以细化物理上不可信的运动（例如脚漂浮），同时保持与原始文本描述的语义一致性。我们提出了一种自我监督和数据驱动的方法，而不是依赖于复杂的物理建模，当故意扭曲的运动和原始文本描述作为输入给出时，DMC 学习获得物理上合理的运动。我们将 DMC 评估为事后模块，用于改进从各种文本到运动生成模型获得的运动，并证明其在提高物理合理性同时增强语义一致性方面的有效性。实验结果表明，DMC 在 T2M 上使 FID 分数降低了 42.74%，在 T2M-GPT 上降低了 13.20%，同时还实现了最高的 R-Precision。当应用于 MoMask 等高质量模型时，DMC 通过将穿透率降低 33.0% 并将浮动伪影调整为更接近地面实况参考，从而提高了运动的物理合理性。这些结果强调，通过结合文本语义和物理合理性，DMC 可以作为任何类型的文本到运动模型的有前途的事后运动细化框架。

Title: Generative Model via Quantile Assignment

• Authors: Georgi Hrusanov, Oliver Y. Chén, Julien S. Bodelet
• Subjects: cs.LG
• Abstract URL: https://arxiv.org/abs/2602.18216
• Pdf URL: https://arxiv.org/pdf/2602.18216
• Copy Paste: [[2602.18216]] Generative Model via Quantile Assignment(https://arxiv.org/abs/2602.18216)
• Keywords: generative
• Abstract: Deep Generative models (DGMs) play two key roles in modern machine learning: (i) producing new information (e.g., image synthesis) and (ii) reducing dimensionality. However, traditional architectures often rely on auxiliary networks such as encoders in Variational Autoencoders (VAEs) or discriminators in Generative Adversarial Networks (GANs), which introduce training instability, computational overhead, and risks like mode collapse. We present NeuroSQL, a new generative paradigm that eliminates the need for auxiliary networks by learning low-dimensional latent representations implicitly. NeuroSQL leverages an asymptotic approximation that expresses the latent variables as the solution to an optimal transportation problem. Specifically, NeuroSQL learns the latent variables by solving a linear assignment problem and then passes the latent information to a standalone generator. We benchmark its performance against GANs, VAEs, and a budget-matched diffusion baseline on four datasets: handwritten digits (MNIST), faces (CelebA), animal faces (AFHQ), and brain images (OASIS). Compared to VAEs, GANs, and diffusion models: (1) in terms of image quality, NeuroSQL achieves overall lower mean pixel distance between synthetic and authentic images and stronger perceptual/structural fidelity; (2) computationally, NeuroSQL requires the least training time; and (3) practically, NeuroSQL provides an effective solution for generating synthetic data with limited training samples. By embracing quantile assignment rather than an encoder, NeuroSQL provides a fast, stable, and robust way to generate synthetic data with minimal information loss.
• 摘要：深度生成模型 (DGM) 在现代机器学习中发挥着两个关键作用：(i) 生成新信息（例如图像合成）和 (ii) 降低维度。然而，传统架构通常依赖于辅助网络，例如变分自动编码器 (VAE) 中的编码器或生成对抗网络 (GAN) 中的判别器，这会带来训练不稳定、计算开销和模式崩溃等风险。我们提出了 NeuroSQL，一种新的生成范式，它通过隐式学习低维潜在表示来消除对辅助网络的需求。 NeuroSQL 利用渐近近似将潜在变量表示为最优运输问题的解决方案。具体来说，NeuroSQL 通过解决线性分配问题来学习潜在变量，然后将潜在信息传递给独立的生成器。我们在四个数据集上根据 GAN、VAE 和预算匹配的扩散基线对其性能进行基准测试：手写数字 (MNIST)、面部 (CelebA)、动物面部 (AFHQ) 和大脑图像 (OASIS)。与 VAE、GAN 和扩散模型相比：（1）在图像质量方面，NeuroSQL 整体上实现了合成图像与真实图像之间较低的平均像素距离以及更强的感知/结构保真度； (2)在计算上，NeuroSQL需要最少的训练时间； (3) 实际上，NeuroSQL 提供了一种利用有限训练样本生成合成数据的有效解决方案。通过采用分位数分配而不是编码器，NeuroSQL 提供了一种快速、稳定且强大的方式来生成合成数据，同时信息损失最小。

Title: Variational Distributional Neuron

• Authors: Yves Ruffenach
• Subjects: cs.LG
• Abstract URL: https://arxiv.org/abs/2602.18250
• Pdf URL: https://arxiv.org/pdf/2602.18250
• Copy Paste: [[2602.18250]] Variational Distributional Neuron(https://arxiv.org/abs/2602.18250)
• Keywords: generation
• Abstract: We propose a proof of concept for a variational distributional neuron: a compute unit formulated as a VAE brick, explicitly carrying a prior, an amortized posterior and a local ELBO. The unit is no longer a deterministic scalar but a distribution: computing is no longer about propagating values, but about contracting a continuous space of possibilities under constraints. Each neuron parameterizes a posterior, propagates a reparameterized sample and is regularized by the KL term of a local ELBO - hence, the activation is distributional. This "contraction" becomes testable through local constraints and can be monitored via internal measures. The amount of contextual information carried by the unit, as well as the temporal persistence of this information, are locally tuned by distinct constraints. This proposal addresses a structural tension: in sequential generation, causality is predominantly organized in the symbolic space and, even when latents exist, they often remain auxiliary, while the effective dynamics are carried by a largely deterministic decoder. In parallel, probabilistic latent models capture factors of variation and uncertainty, but that uncertainty typically remains borne by global or parametric mechanisms, while units continue to propagate scalars - hence the pivot question: if uncertainty is intrinsic to computation, why does the compute unit not carry it explicitly? We therefore draw two axes: (i) the composition of probabilistic constraints, which must be made stable, interpretable and controllable; and (ii) granularity: if inference is a negotiation of distributions under constraints, should the primitive unit remain deterministic or become distributional? We analyze "collapse" modes and the conditions for a "living neuron", then extend the contribution over time via autoregressive priors over the latent, per unit.
• 摘要：我们提出了变分分布神经元的概念证明：一个计算单元，被表述为 VAE 砖块，明确地携带先验、摊销后验和局部 ELBO。该单位不再是确定性的标量，而是分布：计算不再是关于传播值，而是关于在约束下收缩连续的可能性空间。每个神经元参数化后验，传播重新参数化的样本，并通过局部 ELBO 的 KL 项进行正则化 - 因此，激活是分布式的。这种“收缩”可以通过局部约束进行测试，并且可以通过内部措施进行监控。该单元携带的上下文信息量以及该信息的时间持久性通过不同的约束进行本地调整。该提议解决了结构紧张：在顺序生成中，因果关系主要在符号空间中组织，即使存在潜在因素，它们通常仍然是辅助的，而有效的动态则由很大程度上确定性的解码器承载。与此同时，概率潜在模型捕获变化和不确定性的因素，但这种不确定性通常仍然由全局或参数机制承担，而单元继续传播标量 - 因此关键问题是：如果不确定性是计算所固有的，为什么计算单元不明确地携带它？因此，我们画了两个轴：（i）概率约束的组成，必须使其稳定、可解释和可控； (ii) 粒度：如果推理是在约束下对分布进行协商，那么原始单元应该保持确定性还是变成分布性的？我们分析“崩溃”模式和“活神经元”的条件，然后通过每单位潜在神经元的自回归先验随时间延长贡献。

Title: DEIG: Detail-Enhanced Instance Generation with Fine-Grained Semantic Control

• Authors: Shiyan Du, Conghan Yue, Xinyu Cheng, Dongyu Zhang
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.18282
• Pdf URL: https://arxiv.org/pdf/2602.18282
• Copy Paste: [[2602.18282]] DEIG: Detail-Enhanced Instance Generation with Fine-Grained Semantic Control(https://arxiv.org/abs/2602.18282)
• Keywords: generation
• Abstract: Multi-Instance Generation has advanced significantly in spatial placement and attribute binding. However, existing approaches still face challenges in fine-grained semantic understanding, particularly when dealing with complex textual descriptions. To overcome these limitations, we propose DEIG, a novel framework for fine-grained and controllable multi-instance generation. DEIG integrates an Instance Detail Extractor (IDE) that transforms text encoder embeddings into compact, instance-aware representations, and a Detail Fusion Module (DFM) that applies instance-based masked attention to prevent attribute leakage across instances. These components enable DEIG to generate visually coherent multi-instance scenes that precisely match rich, localized textual descriptions. To support fine-grained supervision, we construct a high-quality dataset with detailed, compositional instance captions generated by VLMs. We also introduce DEIG-Bench, a new benchmark with region-level annotations and multi-attribute prompts for both humans and objects. Experiments demonstrate that DEIG consistently outperforms existing approaches across multiple benchmarks in spatial consistency, semantic accuracy, and compositional generalization. Moreover, DEIG functions as a plug-and-play module, making it easily integrable into standard diffusion-based pipelines.
• 摘要：多实例生成在空间放置和属性绑定方面取得了显着进步。然而，现有方法在细粒度语义理解方面仍然面临挑战，特别是在处理复杂的文本描述时。为了克服这些限制，我们提出了 DEIG，一种用于细粒度且可控的多实例生成的新颖框架。 DEIG 集成了一个实例细节提取器 (IDE)，将文本编码器嵌入转换为紧凑的实例感知表示，以及一个细节融合模块 (DFM)，该模块应用基于实例的屏蔽注意力以防止跨实例的属性泄漏。这些组件使 DEIG 能够生成视觉上连贯的多实例场景，这些场景精确匹配丰富的本地化文本描述。为了支持细粒度的监督，我们构建了一个高质量的数据集，其中包含由 VLM 生成的详细的组合实例标题。我们还推出了 DEIG-Bench，这是一个新的基准，具有针对人类和物体的区域级注释和多属性提示。实验表明，DEIG 在多个基准测试中在空间一致性、语义准确性和组合泛化方面始终优于现有方法。此外，DEIG 充当即插即用模块，使其可以轻松集成到基于扩散的标准管道中。

Title: Analyzing and Improving Chain-of-Thought Monitorability Through Information Theory

• Authors: Usman Anwar, Tim Bakker, Dana Kianfar, Cristina Pinneri, Christos Louizos
• Subjects: cs.LG, cs.AI, cs.CL, cs.IT
• Abstract URL: https://arxiv.org/abs/2602.18297
• Pdf URL: https://arxiv.org/pdf/2602.18297
• Copy Paste: [[2602.18297]] Analyzing and Improving Chain-of-Thought Monitorability Through Information Theory(https://arxiv.org/abs/2602.18297)
• Keywords: generation
• Abstract: Chain-of-thought (CoT) monitors are LLM-based systems that analyze reasoning traces to detect when outputs may exhibit attributes of interest, such as test-hacking behavior during code generation. In this paper, we use information-theoretic analysis to show that non-zero mutual information between CoT and output is a necessary but not sufficient condition for CoT monitorability. We identify two sources of approximation error that may undermine the performance of CoT monitors in practice: information gap, which measures the extent to which the monitor can extract the information available in CoT, and elicitation error, which measures the extent to which the monitor approximates the optimal monitoring function. We further demonstrate that CoT monitorability can be systematically improved through targeted training objectives. To this end, we propose two complementary approaches: (a) an oracle-based method that directly rewards the monitored model for producing CoTs that maximize monitor accuracy, and (b) a more practical, label-free approach that maximizes conditional mutual information between outputs and CoTs. Across multiple different environments, we show both methods significantly improve monitor accuracy while preventing CoT degeneration even when training against a monitor, thereby mitigating reward hacking when the task reward is imperfectly specified.
• 摘要：思想链 (CoT) 监视器是基于 LLM 的系统，可分析推理轨迹以检测输出何时可能表现出感兴趣的属性，例如代码生成期间的测试黑客行为。在本文中，我们使用信息论分析表明，CoT 和输出之间的非零互信息是 CoT 可监控性的必要但非充分条件。我们确定了在实践中可能损害 CoT 监控器性能的两个近似误差来源：信息差距（衡量监控器可以提取 CoT 中可用信息的程度）和启发误差（衡量监控器逼近最佳监控功能的程度）。我们进一步证明，可以通过有针对性的培训目标来系统地提高 CoT 可监控性。为此，我们提出了两种互补的方法：（a）基于预言机的方法，直接奖励监控模型以生成最大化监控精度的 CoT；（b）更实用的无标签方法，最大化输出和 CoT 之间的条件互信息。在多个不同的环境中，我们展示了这两种方法都显着提高了监视器的准确性，同时即使在针对监视器进行训练时也能防止 CoT 退化，从而在任务奖励指定不完善时减轻奖励黑客行为。

Title: Multi-Level Conditioning by Pairing Localized Text and Sketch for Fashion Image Generation

• Authors: Ziyue Liu, Davide Talon, Federico Girella, Zanxi Ruan, Mattia Mondo, Loris Bazzani, Yiming Wang, Marco Cristani
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.18309
• Pdf URL: https://arxiv.org/pdf/2602.18309
• Copy Paste: [[2602.18309]] Multi-Level Conditioning by Pairing Localized Text and Sketch for Fashion Image Generation(https://arxiv.org/abs/2602.18309)
• Keywords: generation
• Abstract: Sketches offer designers a concise yet expressive medium for early-stage fashion ideation by specifying structure, silhouette, and spatial relationships, while textual descriptions complement sketches to convey material, color, and stylistic details. Effectively combining textual and visual modalities requires adherence to the sketch visual structure when leveraging the guidance of localized attributes from text. We present LOcalized Text and Sketch with multi-level guidance (LOTS), a framework that enhances fashion image generation by combining global sketch guidance with multiple localized sketch-text pairs. LOTS employs a Multi-level Conditioning Stage to independently encode local features within a shared latent space while maintaining global structural coordination. Then, the Diffusion Pair Guidance stage integrates both local and global conditioning via attention-based guidance within the diffusion model's multi-step denoising process. To validate our method, we develop Sketchy, the first fashion dataset where multiple text-sketch pairs are provided per image. Sketchy provides high-quality, clean sketches with a professional look and consistent structure. To assess robustness beyond this setting, we also include an "in the wild" split with non-expert sketches, featuring higher variability and imperfections. Experiments demonstrate that our method strengthens global structural adherence while leveraging richer localized semantic guidance, achieving improvement over state-of-the-art. The dataset, platform, and code are publicly available.
• 摘要：草图通过指定结构、轮廓和空间关系，为设计师提供了一种简洁而富有表现力的早期时尚构思媒介，而文字描述则补充了草图，以传达材料、颜色和风格细节。有效结合文本和视觉方式需要在利用文本本地化属性的指导时遵守草图视觉结构。我们提出了具有多级指导（LOTS）的本地化文本和草图，这是一个通过将全局草图指导与多个本地化草图文本对相结合来增强时尚图像生成的框架。 LOTS 采用多级调节阶段在共享潜在空间内独立编码局部特征，同时保持全局结构协调。然后，扩散对指导阶段通过扩散模型的多步骤去噪过程中基于注意力的指导来整合局部和全局调节。为了验证我们的方法，我们开发了 Sketchy，这是第一个时尚数据集，其中每个图像提供多个文本草图对。 Sketchy 提供高质量、干净的草图，具有专业的外观和一致的结构。为了评估超出此设置的稳健性，我们还包括与非专家草图的“野外”分割，具有更高的可变性和缺陷。实验表明，我们的方法增强了全局结构依从性，同时利用更丰富的本地化语义指导，实现了对最先进技术的改进。数据集、平台和代码是公开的。

Title: Generated Reality: Human-centric World Simulation using Interactive Video Generation with Hand and Camera Control

• Authors: Linxi Xie, Lisong C. Sun, Ashley Neall, Tong Wu, Shengqu Cai, Gordon Wetzstein
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2602.18422
• Pdf URL: https://arxiv.org/pdf/2602.18422
• Copy Paste: [[2602.18422]] Generated Reality: Human-centric World Simulation using Interactive Video Generation with Hand and Camera Control(https://arxiv.org/abs/2602.18422)
• Keywords: generation, generative
• Abstract: Extended reality (XR) demands generative models that respond to users' tracked real-world motion, yet current video world models accept only coarse control signals such as text or keyboard input, limiting their utility for embodied interaction. We introduce a human-centric video world model that is conditioned on both tracked head pose and joint-level hand poses. For this purpose, we evaluate existing diffusion transformer conditioning strategies and propose an effective mechanism for 3D head and hand control, enabling dexterous hand--object interactions. We train a bidirectional video diffusion model teacher using this strategy and distill it into a causal, interactive system that generates egocentric virtual environments. We evaluate this generated reality system with human subjects and demonstrate improved task performance as well as a significantly higher level of perceived amount of control over the performed actions compared with relevant baselines.
• 摘要：扩展现实（XR）需要生成模型来响应用户跟踪的现实世界运动，但当前的视频世界模型仅接受粗略的控制信号，例如文本或键盘输入，限制了它们在实体交互中的实用性。我们引入了一种以人为中心的视频世界模型，该模型以跟踪的头部姿势和关节级手部姿势为条件。为此，我们评估了现有的扩散变压器调节策略，并提出了一种有效的 3D 头部和手部控制机制，实现灵巧的手-物体交互。我们使用这种策略训练双向视频传播模型教师，并将其提炼成一个因果交互系统，生成以自我为中心的虚拟环境。我们用人类受试者评估了这个生成的现实系统，并证明了与相关基线相比，任务绩效得到了改善，并且对所执行的操作的感知控制程度显着提高。

Title: The Geometry of Noise: Why Diffusion Models Don't Need Noise Conditioning

• Authors: Mojtaba Sahraee-Ardakan, Mauricio Delbracio, Peyman Milanfar
• Subjects: cs.LG, cs.CV, eess.IV
• Abstract URL: https://arxiv.org/abs/2602.18428
• Pdf URL: https://arxiv.org/pdf/2602.18428
• Copy Paste: [[2602.18428]] The Geometry of Noise: Why Diffusion Models Don't Need Noise Conditioning(https://arxiv.org/abs/2602.18428)
• Keywords: generation, generative
• Abstract: Autonomous (noise-agnostic) generative models, such as Equilibrium Matching and blind diffusion, challenge the standard paradigm by learning a single, time-invariant vector field that operates without explicit noise-level conditioning. While recent work suggests that high-dimensional concentration allows these models to implicitly estimate noise levels from corrupted observations, a fundamental paradox remains: what is the underlying landscape being optimized when the noise level is treated as a random variable, and how can a bounded, noise-agnostic network remain stable near the data manifold where gradients typically diverge? We resolve this paradox by formalizing Marginal Energy, $E_{\text{marg}}(\mathbf{u}) = -\log p(\mathbf{u})$, where $p(\mathbf{u}) = \int p(\mathbf{u}|t)p(t)dt$ is the marginal density of the noisy data integrated over a prior distribution of unknown noise levels. We prove that generation using autonomous models is not merely blind denoising, but a specific form of Riemannian gradient flow on this Marginal Energy. Through a novel relative energy decomposition, we demonstrate that while the raw Marginal Energy landscape possesses a $1/t^p$ singularity normal to the data manifold, the learned time-invariant field implicitly incorporates a local conformal metric that perfectly counteracts the geometric singularity, converting an infinitely deep potential well into a stable attractor. We also establish the structural stability conditions for sampling with autonomous models. We identify a ``Jensen Gap'' in noise-prediction parameterizations that acts as a high-gain amplifier for estimation errors, explaining the catastrophic failure observed in deterministic blind models. Conversely, we prove that velocity-based parameterizations are inherently stable because they satisfy a bounded-gain condition that absorbs posterior uncertainty into a smooth geometric drift.
• 摘要：自主（与噪声无关）生成模型，例如平衡匹配和盲扩散，通过学习单个时不变矢量场来挑战标准范式，该矢量场无需显式噪声水平调节即可运行。虽然最近的工作表明，高维集中允许这些模型隐式地估计来自损坏的观测值的噪声水平，但仍然存在一个基本的悖论：当噪声水平被视为随机变量时，正在优化的潜在景观是什么，以及有界的、与噪声无关的网络如何在梯度通常发散的数据流形附近保持稳定？我们通过形式化边际能量 $E_{\text{marg}}(\mathbf{u}) = -\log p(\mathbf{u})$ 来解决这个悖论，其中 $p(\mathbf{u}) = \int p(\mathbf{u}|t)p(t)dt$ 是在未知噪声水平的先验分布上积分的噪声数据的边际密度。我们证明，使用自主模型生成不仅仅是盲目去噪，而是该边际能量上黎曼梯度流的特定形式。通过一种新颖的相对能量分解，我们证明了虽然原始边际能量景观具有垂直于数据流形的 $1/t^p$ 奇点，但学习的时不变场隐式地包含了一个完美抵消几何奇点的局部共形度量，将无限深的势阱转换为稳定的吸引子。我们还建立了自主模型采样的结构稳定性条件。我们在噪声预测参数化中发现了一个“詹森间隙”，它充当估计误差的高增益放大器，解释了在确定性盲模型中观察到的灾难性故障。相反，我们证明基于速度的参数化本质上是稳定的，因为它们满足有界增益条件，将后验不确定性吸收为平滑的几何漂移。