2026-03-04

Title: Forecasting as Rendering: A 2D Gaussian Splatting Framework for Time Series Forecasting

• Authors: Yixin Wang, Yifan Hu, Peiyuan Liu, Naiqi Li, Dai Tao, Shu-Tao Xia
• Subjects: cs.LG, cs.AI, cs.CV
• Abstract URL: https://arxiv.org/abs/2603.02220
• Pdf URL: https://arxiv.org/pdf/2603.02220
• Copy Paste: [[2603.02220]] Forecasting as Rendering: A 2D Gaussian Splatting Framework for Time Series Forecasting(https://arxiv.org/abs/2603.02220)
• Keywords: generation, generative
• Abstract: Time series forecasting (TSF) remains a challenging problem due to the intricate entanglement of intraperiod-fluctuations and interperiod-trends. While recent advances have attempted to reshape 1D sequences into 2D period-phase representations, they suffer from two principal this http URL, treating reshaped tensors as static images results in a topological mismatch, as standard spatial operators sever chronological continuity at grid boundaries. Secondly, relying on uniform fixed-size representations allocates modeling capacity inefficiently and fails to provide the adaptive resolution required for compressible, non-stationary temporal patterns. To address these limitations, we introduce TimeGS, a novel framework that fundamentally shifts the forecasting paradigm from regression to 2D generative rendering. By reconceptualizing the future sequence as a continuous latent surface, TimeGS utilizes the inherent anisotropy of Gaussian kernels to adaptively model complex variations with flexible geometric alignment. To realize this, we introduce a Multi-Basis Gaussian Kernel Generation (MB-GKG) block that synthesizes kernels from a fixed dictionary to stabilize optimization, and a Multi-Period Chronologically Continuous Rasterization (MP-CCR) block that enforces strict temporal continuity across periodic boundaries. Comprehensive experiments on standard benchmark datasets demonstrate that TimeGS attains state-of-the-art performance.
• 摘要：由于周期内波动和周期间趋势错综复杂的交织，时间序列预测（TSF）仍然是一个具有挑战性的问题。虽然最近的进展尝试将一维序列重塑为二维周期相位表示，但它们受到两个主要问题的困扰：将重塑的张量视为静态图像会导致拓扑不匹配，因为标准空间运算符会切断网格边界处的时间连续性。其次，依赖统一的固定大小表示会低效地分配建模能力，并且无法提供可压缩、非平稳时间模式所需的自适应分辨率。为了解决这些限制，我们引入了 TimeGS，这是一种新颖的框架，从根本上将预测范式从回归转变为 2D 生成渲染。通过将未来序列重新概念化为连续的潜在表面，TimeGS 利用高斯核固有的各向异性，通过灵活的几何对齐来自适应地建模复杂的变化。为了实现这一点，我们引入了多基础高斯核生成（MB-GKG）块，它从固定字典合成核以稳定优化，以及多周期时间连续光栅化（MP-CCR）块，它在周期边界上强制执行严格的时间连续性。对标准基准数据集的综合实验表明，TimeGS 达到了最先进的性能。

Title: Generalized Discrete Diffusion with Self-Correction

• Authors: Linxuan Wang, Ziyi Wang, Yikun Bai, Wei Deng, Guang Lin, Qifan Song
• Subjects: cs.LG, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.02230
• Pdf URL: https://arxiv.org/pdf/2603.02230
• Copy Paste: [[2603.02230]] Generalized Discrete Diffusion with Self-Correction(https://arxiv.org/abs/2603.02230)
• Keywords: generation
• Abstract: Self-correction is an effective technique for maintaining parallel sampling in discrete diffusion models with minimal performance degradation. Prior work has explored self-correction at inference time or during post-training; however, such approaches often suffer from limited generalization and may impair reasoning performance. GIDD pioneers pretraining-based self-correction via a multi-step BERT-style uniform-absorbing objective. However, GIDD relies on a continuous interpolation-based pipeline with opaque interactions between uniform transitions and absorbing masks, which complicates hyperparameter tuning and hinders practical performance. In this work, we propose a Self-Correcting Discrete Diffusion (SCDD) model to reformulate pretrained self-correction with explicit state transitions and learn directly in discrete time. Our framework also simplifies the training noise schedule, eliminates a redundant remasking step, and relies exclusively on uniform transitions to learn self-correction. Experiments at the GPT-2 scale demonstrate that our method enables more efficient parallel decoding while preserving generation quality.
• 摘要：自校正是一种在离散扩散模型中保持并行采样且性能下降最小的有效技术。之前的工作已经探索了推理时或训练后的自我纠正；然而，此类方法通常泛化能力有限，并且可能会损害推理性能。 GIDD 通过多步 BERT 式统一吸收目标，开创了基于预训练的自我校正。然而，GIDD 依赖于基于连续插值的管​​道，均匀过渡和吸收掩模之间的相互作用不透明，这使超参数调整变得复杂并阻碍了实际性能。在这项工作中，我们提出了一种自校正离散扩散（SCDD）模型，通过显式状态转换重新制定预训练的自校正，并在离散时间内直接学习。我们的框架还简化了训练噪声计划，消除了冗余的重新屏蔽步骤，并且完全依赖统一的转换来学习自我校正。 GPT-2 规模的实验表明，我们的方法可以在保持生成质量的同时实现更高效的并行解码。

Title: Talking with Verifiers: Automatic Specification Generation for Neural Network Verification

• Authors: Yizhak Y. Elboher, Reuven Peleg, Zhouxing Shi, Guy Katz, Jan Křetínský
• Subjects: cs.LG, cs.AI, cs.SE
• Abstract URL: https://arxiv.org/abs/2603.02235
• Pdf URL: https://arxiv.org/pdf/2603.02235
• Copy Paste: [[2603.02235]] Talking with Verifiers: Automatic Specification Generation for Neural Network Verification(https://arxiv.org/abs/2603.02235)
• Keywords: generation
• Abstract: Neural network verification tools currently support only a narrow class of specifications, typically expressed as low-level constraints over raw inputs and outputs. This limitation significantly hinders their adoption and practical applicability across diverse application domains where correctness requirements are naturally expressed at a higher semantic level. This challenge is rooted in the inherent nature of deep neural networks, which learn internal representations that lack an explicit mapping to human-understandable features. To address this, we bridge this gap by introducing a novel component to the verification pipeline, making existing verification tools applicable to a broader range of domains and specification styles. Our framework enables users to formulate specifications in natural language, which are then automatically analyzed and translated into formal verification queries compatible with state-of-the-art neural network verifiers. We evaluate our approach on both structured and unstructured datasets, demonstrating that it successfully verifies complex semantic specifications that were previously inaccessible. Our results show that this translation process maintains high fidelity to user intent while incurring low computational overhead, thereby substantially extending the applicability of formal DNN verification to real-world, high-level requirements.
• 摘要：神经网络验证工具目前仅支持一小类规范，通常表示为对原始输入和输出的低级约束。这种限制极大地阻碍了它们在不同应用领域的采用和实际适用性，在这些应用领域中，正确性要求自然地在更高的语义级别上表达。这一挑战植根于深度神经网络的固有本质，深度神经网络学习的内部表示缺乏与人类可理解特征的明确映射。为了解决这个问题，我们通过在验证管道中引入一个新颖的组件来弥补这一差距，使现有的验证工具适用于更广泛的领域和规范样式。我们的框架使用户能够用自然语言制定规范，然后自动分析并翻译成与最先进的神经网络验证器兼容的形式验证查询。我们在结构化和非结构化数据集上评估我们的方法，证明它成功验证了以前无法访问的复杂语义规范。我们的结果表明，该翻译过程保持了对用户意图的高保真度，同时计算开销较低，从而大大扩展了形式 DNN 验证对现实世界的高级要求的适用性。

Title: CUDABench: Benchmarking LLMs for Text-to-CUDA Generation

• Authors: Jiace Zhu, Wentao Chen, Qi Fan, Zhixing Ren, Junying Wu, Xing Zhe Chai, Chotiwit Rungrueangwutthinon, Yehan Ma, An Zou
• Subjects: cs.LG, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.02236
• Pdf URL: https://arxiv.org/pdf/2603.02236
• Copy Paste: [[2603.02236]] CUDABench: Benchmarking LLMs for Text-to-CUDA Generation(https://arxiv.org/abs/2603.02236)
• Keywords: generation, generative
• Abstract: Recent studies have demonstrated the potential of Large Language Models (LLMs) in generating GPU Kernels. Current benchmarks focus on the translation of high-level languages into CUDA, overlooking the more general and challenging task of text-to-CUDA generation. Furthermore, given the hardware-specific and performance-critical features of GPU programming, accurately assessing the performance of LLM-generated GPU programs is nontrivial. In this work, we introduce CUDABench, a comprehensive benchmark designed to evaluate the text-to-CUDA capabilities of LLMs. First, we construct CUDABench-Set, which covers Breadth-Depth-Difficulty evaluation space in diverse application domains, including artificial intelligence, scientific computing, and data analytics, etc. Furthermore, we propose CUDABench-Score and Generative Verification Pipeline that assess (1) compilation correctness, (2) functional consistency through execution-based verification, and (3) a novel roofline-based metric, Performance-Score. Benchmarking state-of-the-art LLMs reveals insightful findings and challenges of text-to-CUDA, such as a notable mismatch between high compilation success rates and low functional correctness, a lack of domain-specific algorithmic knowledge, and suboptimal utilization of GPU hardware resources. Our benchmark is available at this https URL.
• 摘要：最近的研究证明了大型语言模型 (LLM) 在生成 GPU 内核方面的潜力。当前的基准测试侧重于将高级语言转换为 CUDA，而忽略了文本到 CUDA 生成这一更普遍且更具挑战性的任务。此外，考虑到 GPU 编程的硬件特定性和性能关键特征，准确评估 LLM 生成的 GPU 程序的性能并非易事。在这项工作中，我们介绍了 CUDABench，这是一个综合基准测试，旨在评估法学硕士的文本到 CUDA 的能力。首先，我们构建了 CUDABench-Set，它涵盖了不同应用领域的广度-深度-难度评估空间，包括人工智能、科学计算和数据分析等。此外，我们提出了 CUDABench-Score 和生成验证管道，用于评估（1）编译正确性，（2）通过基于执行的验证实现功能一致性，以及（3）一种新颖的基于屋顶的指标 Performance-Score。对最先进的法学硕士进行基准测试揭示了文本到 CUDA 的深刻发现和挑战，例如高编译成功率和低功能正确性之间的显着不匹配、缺乏特定领域的算法知识以及 GPU 硬件资源的次优利用。我们的基准测试可以在这个 https URL 上找到。

Title: Graph Attention Based Prioritization of Disease Responsible Genes from Multimodal Alzheimer's Network

• Authors: Binon Teji, Subhajit Bandyopadhyay, Swarup Roy
• Subjects: cs.LG
• Abstract URL: https://arxiv.org/abs/2603.02273
• Pdf URL: https://arxiv.org/pdf/2603.02273
• Copy Paste: [[2603.02273]] Graph Attention Based Prioritization of Disease Responsible Genes from Multimodal Alzheimer's Network(https://arxiv.org/abs/2603.02273)
• Keywords: generative
• Abstract: Prioritizing disease-associated genes is central to understanding the molecular mechanisms of complex disorders such as Alzheimer's disease (AD). Traditional network-based approaches rely on static centrality measures and often fail to capture cross-modal biological heterogeneity. We propose NETRA (Node Evaluation through Transformer-based Representation and Attention), a multimodal graph transformer framework that replaces heuristic centrality metrics with attention-driven relevance scoring. Using AD as a case study, gene regulatory networks are independently constructed from microarray, single-cell RNA-seq, and single-nucleus RNA-seq data. Random-walk sequences derived from these networks are used to train a BERT-based model for learning global gene embeddings, while modality-specific gene expression profiles are compressed using variational autoencoders. These representations are integrated with auxiliary biological networks, including protein-protein interactions, Gene Ontology semantic similarity, and diffusion-based gene similarity, into a unified multimodal graph. A graph transformer assigns NETRA scores that quantify gene relevance in a disease-specific and context-aware manner. Gene set enrichment analysis shows that NETRA achieves a normalized enrichment score of about 3.9 for the Alzheimer's disease pathway, substantially outperforming classical centrality measures and diffusion models. Top-ranked genes enrich multiple neurodegenerative pathways, recover a known late-onset AD susceptibility locus at chr12q13, and reveal conserved cross-disease gene modules. The framework preserves biologically realistic heavy-tailed network topology and is readily extensible to other complex disorders.
• 摘要：优先考虑疾病相关基因对于理解阿尔茨海默病 (AD) 等复杂疾病的分子机制至关重要。传统的基于网络的方法依赖于静态中心性度量，并且通常无法捕获跨模式的生物异质性。我们提出 NETRA（通过基于 Transformer 的表示和注意力的节点评估），这是一种多模态图转换器框架，用注意力驱动的相关性评分取代启发式中心性指标。以 AD 作为案例研究，基因调控网络是根据微阵列、单细胞 RNA-seq 和单核 RNA-seq 数据独立构建的。来自这些网络的随机游走序列用于训练基于 BERT 的模型来学习全局基因嵌入，同时使用变分自动编码器压缩特定模态的基因表达谱。这些表示与辅助生物网络（包括蛋白质-蛋白质相互作用、基因本体语义相似性和基于扩散的基因相似性）集成到统一的多模态图中。图形转换器分配 NETRA 分数，以特定于疾病和上下文感知的方式量化基因相关性。基因集富集分析表明，NETRA 在阿尔茨海默病通路中实现了约 3.9 的标准化富集分数，大大优于经典的中心性测量和扩散模型。排名靠前的基因丰富了多种神经退行性通路，恢复了 chr12q13 上已知的晚发 AD 易感位点，并揭示了保守的跨疾病基因模块。该框架保留了生物学上真实的重尾网络拓扑，并且很容易扩展到其他复杂的疾病。

Title: Beyond Prompt Degradation: Prototype-guided Dual-pool Prompting for Incremental Object Detection

• Authors: Yaoteng Zhang, Zhou Qing, Junyu Gao, Qi Wang
• Subjects: cs.CV, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.02286
• Pdf URL: https://arxiv.org/pdf/2603.02286
• Copy Paste: [[2603.02286]] Beyond Prompt Degradation: Prototype-guided Dual-pool Prompting for Incremental Object Detection(https://arxiv.org/abs/2603.02286)
• Keywords: generation
• Abstract: Incremental Object Detection (IOD) aims to continuously learn new object categories without forgetting previously learned ones. Recently, prompt-based methods have gained popularity for their replay-free design and parameter efficiency. However, due to prompt coupling and prompt drift, these methods often suffer from prompt degradation during continual adaptation. To address these issues, we propose a novel prompt-decoupled framework called PDP. PDP innovatively designs a dual-pool prompt decoupling paradigm, which consists of a shared pool used to capture task-general knowledge for forward transfer, and a private pool used to learn task-specific discriminative features. This paradigm explicitly separates task-general and task-specific prompts, preventing interference between prompts and mitigating prompt coupling. In addition, to counteract prompt drift resulting from inconsistent supervision where old foreground objects are treated as background in subsequent tasks, PDP introduces a Prototypical Pseudo-Label Generation (PPG) module. PPG can dynamically update the class prototype space during training and use the class prototypes to further filter valuable pseudo-labels, maintaining supervisory signal consistency throughout the incremental process. PDP achieves state-of-the-art performance on MS-COCO (with a 9.2\% AP improvement) and PASCAL VOC (with a 3.3\% AP improvement) benchmarks, highlighting its potential in balancing stability and plasticity. The code and dataset are released at: this https URL\_IOD/tree/main
• 摘要：增量对象检测（IOD）旨在不断学习新的对象类别，而不会忘记以前学过的对象类别。最近，基于提示的方法因其无重放设计和参数效率而受到欢迎。然而，由于快速耦合和快速漂移，这些方法经常在持续适应过程中遭受快速退化。为了解决这些问题，我们提出了一种新颖的提示解耦框架，称为 PDP。 PDP创新性地设计了双池提示解耦范式，其中包括用于捕获任务通用知识以进行前向传输的共享池和用于学习特定于任务的判别特征的私有池。该范例明确地将一般任务提示和特定任务提示分开，防止提示之间的干扰并减轻提示耦合。此外，为了抵消由于不一致的监督（旧的前景对象在后续任务中被视为背景）而导致的快速漂移，PDP 引入了原型伪标签生成（PPG）模块。 PPG可以在训练过程中动态更新类原型空间，并利用类原型进一步过滤有价值的伪标签，在整个增量过程中保持监督信号的一致性。 PDP 在 MS-COCO（AP 提升 9.2%）和 PASCAL VOC（AP 提升 3.3%）基准上实现了最先进的性能，凸显了其在平衡稳定性和可塑性方面的潜力。代码和数据集发布于：此 https URL\_IOD/tree/main

Title: Preconditioned Score and Flow Matching

• Authors: Shadab Ahamed, Eshed Gal, Simon Ghyselincks, Md Shahriar Rahim Siddiqui, Moshe Eliasof, Eldad Haber
• Subjects: cs.LG, cs.AI, cs.CV
• Abstract URL: https://arxiv.org/abs/2603.02337
• Pdf URL: https://arxiv.org/pdf/2603.02337
• Copy Paste: [[2603.02337]] Preconditioned Score and Flow Matching(https://arxiv.org/abs/2603.02337)
• Keywords: generative
• Abstract: Flow matching and score-based diffusion train vector fields under intermediate distributions $p_t$, whose geometry can strongly affect their optimization. We show that the covariance $\Sigma_t$ of $p_t$ governs optimization bias: when $\Sigma_t$ is ill-conditioned, and gradient-based training rapidly fits high-variance directions while systematically under-optimizing low-variance modes, leading to learning that plateaus at suboptimal weights. We formalize this effect in analytically tractable settings and propose reversible, label-conditional \emph{preconditioning} maps that reshape the geometry of $p_t$ by improving the conditioning of $\Sigma_t$ without altering the underlying generative model. Rather than accelerating early convergence, preconditioning primarily mitigates optimization stagnation by enabling continued progress along previously suppressed directions. Across MNIST latent flow matching, and additional high-resolution datasets, we empirically track conditioning diagnostics and distributional metrics and show that preconditioning consistently yields better-trained models by avoiding suboptimal plateaus.
• 摘要：流匹配和基于分数的扩散训练中间分布 $p_t$ 下的向量场，其几何形状可以强烈影响其优化。我们表明，$p_t$ 的协方差 $\Sigma_t$ 控制着优化偏差：当 $\Sigma_t$ 处于病态时，基于梯度的训练会快速适应高方差方向，同时系统性地欠优化低方差模式，从而导致学习在次优权重处达到稳定状态。我们在分析上易处理的设置中形式化了这种效应，并提出了可逆的、标签条件的 \emph{preconditioning} 映射，通过改进 $\Sigma_t$ 的条件来重塑 $p_t$ 的几何形状，而不改变底层的生成模型。预处理不是加速早期收敛，而是主要通过沿着先前抑制的方向持续前进来缓解优化停滞。通过 MNIST 潜在流匹配和其他高分辨率数据集，我们凭经验跟踪条件诊断和分布指标，并表明预处理通过避免次优平台始终能够产生更好的训练模型。

Title: Rigidity-Aware Geometric Pretraining for Protein Design and Conformational Ensembles

• Authors: Zhanghan Ni, Yanjing Li, Zeju Qiu, Bernhard Schölkopf, Hongyu Guo, Weiyang Liu, Shengchao Liu
• Subjects: cs.LG, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.02406
• Pdf URL: https://arxiv.org/pdf/2603.02406
• Copy Paste: [[2603.02406]] Rigidity-Aware Geometric Pretraining for Protein Design and Conformational Ensembles(https://arxiv.org/abs/2603.02406)
• Keywords: generation, generative
• Abstract: Generative models have recently advanced $\textit{de novo}$ protein design by learning the statistical regularities of natural structures. However, current approaches face three key limitations: (1) Existing methods cannot jointly learn protein geometry and design tasks, where pretraining can be a solution; (2) Current pretraining methods mostly rely on local, non-rigid atomic representations for property prediction downstream tasks, limiting global geometric understanding for protein generation tasks; and (3) Existing approaches have yet to effectively model the rich dynamic and conformational information of protein structures. To overcome these issues, we introduce $\textbf{RigidSSL}$ ($\textit{Rigidity-Aware Self-Supervised Learning}$), a geometric pretraining framework that front-loads geometry learning prior to generative finetuning. Phase I (RigidSSL-Perturb) learns geometric priors from 432K structures from the AlphaFold Protein Structure Database with simulated perturbations. Phase II (RigidSSL-MD) refines these representations on 1.3K molecular dynamics trajectories to capture physically realistic transitions. Underpinning both phases is a bi-directional, rigidity-aware flow matching objective that jointly optimizes translational and rotational dynamics to maximize mutual information between conformations. Empirically, RigidSSL variants improve designability by up to 43\% while enhancing novelty and diversity in unconditional generation. Furthermore, RigidSSL-Perturb improves the success rate by 5.8\% in zero-shot motif scaffolding and RigidSSL-MD captures more biophysically realistic conformational ensembles in G protein-coupled receptor modeling. The code is available at: this https URL.
• 摘要：生成模型最近通过学习自然结构的统计规律推进了 $\textit{de novo}$ 蛋白质设计。然而，当前的方法面临三个关键限制：（1）现有方法无法联合学习蛋白质几何结构和设计任务，而预训练可以作为解决方案； （2）当前的预训练方法大多依赖局部的、非刚性的原子表示来进行属性预测下游任务，限制了蛋白质生成任务的全局几何理解； (3)现有方法尚未有效地模拟蛋白质结构丰富的动态和构象信息。为了克服这些问题，我们引入了 $\textbf{RigidSSL}$ ($\textit{Rigidity-Aware Self-Supervised Learning}$)，这是一种几何预训练框架，可以在生成微调之前预先加载几何学习。第一阶段（RigidSSL-Perturb）通过模拟扰动从 AlphaFold 蛋白质结构数据库的 432K 结构中学习几何先验。第二阶段 (RigidSSL-MD) 在 1.3K 分子动力学轨迹上完善了这些表示，以捕获物理上真实的转变。支持这两个阶段的是双向、刚性感知的流动匹配目标，该目标共同优化平移和旋转动力学，以最大化构象之间的相互信息。根据经验，RigidSSL 变体将可设计性提高了 43%，同时增强了无条件生成的新颖性和多样性。此外，RigidSSL-Perturb 将零次模体支架的成功率提高了 5.8%，而 RigidSSL-MD 在 G 蛋白偶联受体建模中捕获了更符合生物物理真实性的构象整体。该代码位于：此 https URL。

Title: Spectral Regularization for Diffusion Models

• Authors: Satish Chandran, Nicolas Roque dos Santos, Yunshu Wu, Greg Ver Steeg, Evangelos Papalexakis
• Subjects: cs.LG
• Abstract URL: https://arxiv.org/abs/2603.02447
• Pdf URL: https://arxiv.org/pdf/2603.02447
• Copy Paste: [[2603.02447]] Spectral Regularization for Diffusion Models(https://arxiv.org/abs/2603.02447)
• Keywords: generation
• Abstract: Diffusion models are typically trained using pointwise reconstruction objectives that are agnostic to the spectral and multi-scale structure of natural signals. We propose a loss-level spectral regularization framework that augments standard diffusion training with differentiable Fourier- and wavelet-domain losses, without modifying the diffusion process, model architecture, or sampling procedure. The proposed regularizers act as soft inductive biases that encourage appropriate frequency balance and coherent multi-scale structure in generated samples. Our approach is compatible with DDPM, DDIM, and EDM formulations and introduces negligible computational overhead. Experiments on image and audio generation demonstrate consistent improvements in sample quality, with the largest gains observed on higher-resolution, unconditional datasets where fine-scale structure is most challenging to model.
• 摘要：扩散模型通常使用与自然信号的频谱和多尺度结构无关的逐点重建目标进行训练。我们提出了一种损失级谱正则化框架，该框架通过可微的傅立叶域和小波域损失增强标准扩散训练，而无需修改扩散过程、模型架构或采样程序。所提出的正则化器充当软归纳偏差，鼓励生成样本中适当的频率平衡和相干的多尺度结构。我们的方法与 DDPM、DDIM 和 EDM 公式兼容，并且引入的计算开销可以忽略不计。图像和音频生成的实验证明了样本质量的持续改进，在更高分辨率的无条件数据集上观察到最大的增益，其中精细尺度结构最难建模。

Title: MUSE: A Run-Centric Platform for Multimodal Unified Safety Evaluation of Large Language Models

• Authors: Zhongxi Wang, Yueqian Lin, Jingyang Zhang, Hai Helen Li, Yiran Chen
• Subjects: cs.LG, cs.CL, cs.CV, cs.SD, eess.AS
• Abstract URL: https://arxiv.org/abs/2603.02482
• Pdf URL: https://arxiv.org/pdf/2603.02482
• Copy Paste: [[2603.02482]] MUSE: A Run-Centric Platform for Multimodal Unified Safety Evaluation of Large Language Models(https://arxiv.org/abs/2603.02482)
• Keywords: generation
• Abstract: Safety evaluation and red-teaming of large language models remain predominantly text-centric, and existing frameworks lack the infrastructure to systematically test whether alignment generalizes to audio, image, and video inputs. We present MUSE (Multimodal Unified Safety Evaluation), an open-source, run-centric platform that integrates automatic cross-modal payload generation, three multi-turn attack algorithms (Crescendo, PAIR, Violent Durian), provider-agnostic model routing, and an LLM judge with a five-level safety taxonomy into a single browser-based system. A dual-metric framework distinguishes hard Attack Success Rate (Compliance only) from soft ASR (including Partial Compliance), capturing partial information leakage that binary metrics miss. To probe whether alignment generalizes across modality boundaries, we introduce Inter-Turn Modality Switching (ITMS), which augments multi-turn attacks with per-turn modality rotation. Experiments across six multimodal LLMs from four providers show that multi-turn strategies can achieve up to 90-100% ASR against models with near-perfect single-turn refusal. ITMS does not uniformly raise final ASR on already-saturated baselines, but accelerates convergence by destabilizing early-turn defenses, and ablation reveals that the direction of modality effects is model-family-specific rather than universal, underscoring the need for provider-aware cross-modal safety testing.
• 摘要：大型语言模型的安全评估和红队仍然主要以文本为中心，现有框架缺乏系统测试对齐是否泛化到音频、图像和视频输入的基础设施。我们推出了 MUSE（多模式统一安全评估），这是一个以运行为中心的开源平台，它将自动跨模式有效负载生成、三种多轮攻击算法（Crescendo、PAIR、Violent Durian）、与提供商无关的模型路由以及具有五级安全分类的法学硕士法官集成到一个基于浏览器的系统中。双指标框架将硬攻击成功率（仅合规性）与软 ASR（包括部分合规性）区分开来，捕获二进制指标遗漏的部分信息泄漏。为了探究对齐是否可以跨越模态边界，我们引入了轮间模态切换（ITMS），它通过每轮模态旋转来增强多轮攻击。来自四个提供商的六个多模式法学硕士的实验表明，与近乎完美的单轮拒绝模型相比，多轮策略可以实现高达 90-100% 的 ASR。 ITMS 不会在已经饱和的基线上统一提高最终 ASR，而是通过破坏早期防御的稳定性来加速收敛，并且消融表明模态效应的方向是特定于模型系列的而不是通用的，这强调了对提供商感知的跨模态安全测试的需要。

Title: ParEVO: Synthesizing Code for Irregular Data: High-Performance Parallelism through Agentic Evolution

• Authors: Liu Yang, Zeyu Nie, Andrew Liu, Felix Zou, Deniz Altinbüken, Amir Yazdanbakhsh, Quanquan C. Liu
• Subjects: cs.LG, cs.DC, cs.NE, cs.PF
• Abstract URL: https://arxiv.org/abs/2603.02510
• Pdf URL: https://arxiv.org/pdf/2603.02510
• Copy Paste: [[2603.02510]] ParEVO: Synthesizing Code for Irregular Data: High-Performance Parallelism through Agentic Evolution(https://arxiv.org/abs/2603.02510)
• Keywords: generation
• Abstract: The transition from sequential to parallel computing is essential for modern high-performance applications but is hindered by the steep learning curve of concurrent programming. This challenge is magnified for irregular data structures (such as sparse graphs, unbalanced trees, and non-uniform meshes) where static scheduling fails and data dependencies are unpredictable. Current Large Language Models (LLMs) often fail catastrophically on these tasks, generating code plagued by subtle race conditions, deadlocks, and sub-optimal scaling. We bridge this gap with ParEVO, a framework designed to synthesize high-performance parallel algorithms for irregular data. Our contributions include: (1) The Parlay-Instruct Corpus, a curated dataset of 13,820 tasks synthesized via a "Critic-Refine" pipeline that explicitly filters for empirically performant algorithms that effectively utilize Work-Span parallel primitives; (2) specialized DeepSeek, Qwen, and Gemini models fine-tuned to align probabilistic generation with the rigorous semantics of the ParlayLib library; and (3) an Evolutionary Coding Agent (ECA) that improves the "last mile" of correctness by iteratively repairing code using feedback from compilers, dynamic race detectors, and performance profilers. On the ParEval benchmark, ParEVO achieves an average 106x speedup (with a maximum of 1103x) across the suite, and a robust 13.6x speedup specifically on complex irregular graph problems, outperforming state-of-the-art commercial models. Furthermore, our evolutionary approach matches state-of-the-art expert human baselines, achieving up to a 4.1x speedup on specific highly-irregular kernels. Source code and datasets are available at this https URL.
• 摘要：从顺序计算到并行计算的转变对于现代高性能应用程序至关重要，但由于并发编程的陡峭学习曲线而受到阻碍。对于静态调度失败且数据依赖性不可预测的不规则数据结构（例如稀疏图、不平衡树和非均匀网格），这一挑战会被放大。当前的大型语言模型 (LLM) 在执行这些任务时经常会发生灾难性的失败，生成的代码受到微妙的竞争条件、死锁和次优扩展的困扰。我们用 ParEVO 弥补了这一差距，ParEVO 是一个旨在针对不规则数据综合高性能并行算法的框架。我们的贡献包括：(1) Parlay-Instruct Corpus，这是一个由 13,820 个任务组成的精选数据集，通过“Critic-Refine”管道合成，该管道明确筛选有效利用工作跨度并行原语的经验性能算法； (2) 专门的 DeepSeek、Qwen 和 Gemini 模型经过微调，使概率生成与 ParlayLib 库的严格语义保持一致； (3) 进化编码代理 (ECA)，通过使用编译器、动态竞争检测器和性能分析器的反馈迭代修复代码，提高“最后一英里”的正确性。在 ParEval 基准测试中，ParEVO 在整个套件中实现了平均 106 倍加速（最高 1103 倍），特别是在复杂的不规则图问题上实现了 13.6 倍的强劲加速，超越了最先进的商业模型。此外，我们的进化方法与最先进的专家人类基线相匹配，在特定的高度不规则内核上实现了高达 4.1 倍的加速。源代码和数据集可从此 https URL 获取。

Title: Bridging Diffusion Guidance and Anderson Acceleration via Hopfield Dynamics

• Authors: Kwanyoung Kim
• Subjects: cs.LG, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.02531
• Pdf URL: https://arxiv.org/pdf/2603.02531
• Copy Paste: [[2603.02531]] Bridging Diffusion Guidance and Anderson Acceleration via Hopfield Dynamics(https://arxiv.org/abs/2603.02531)
• Keywords: generation, generative
• Abstract: Classifier-Free Guidance (CFG) has significantly enhanced the generative quality of diffusion models by extrapolating between conditional and unconditional outputs. However, its high inference cost and limited applicability to distilled or single-step models have shifted research focus toward attention-space extrapolation. While these methods offer computational efficiency, their theoretical underpinnings remain elusive. In this work, we establish a foundational framework for attention-space extrapolation by modeling attention dynamics as fixed-point iterations within Modern Hopfield Networks. We demonstrate that the extrapolation effect in attention space constitutes a special case of Anderson Acceleration applied to these dynamics. Building on this insight and the weak contraction property, we propose Geometry Aware Attention Guidance (GAG). By decomposing attention updates into parallel and orthogonal components relative to the guidance direction, GAG stabilizes the acceleration process and maximizes guidance efficiency. Our plug-and-play method seamlessly integrates with existing frameworks while significantly improving generation quality.
• 摘要：无分类器指导 (CFG) 通过在条件和无条件输出之间进行推断，显着提高了扩散模型的生成质量。然而，其推理成本高以及对蒸馏模型或单步模型的适用性有限，已将研究重点转向注意空间外推。虽然这些方法提供了计算效率，但它们的理论基础仍然难以捉摸。在这项工作中，我们通过将注意力动态建模为现代 Hopfield 网络中的定点迭代，建立了注意力空间外推的基础框架。我们证明，注意力空间中的外推效应构成了应用于这些动力学的安德森加速的特例。基于这种洞察力和弱收缩特性，我们提出了几何感知注意指导（GAG）。通过将注意力更新分解为相对于引导方向的并行和正交分量，GAG 稳定了加速过程并最大化了引导效率。我们的即插即用方法与现有框架无缝集成，同时显着提高生成质量。

Title: On Discriminative vs. Generative classifiers: Rethinking MLLMs for Action Understanding

• Authors: Zhanzhong Pang, Dibyadip Chatterjee, Fadime Sener, Angela Yao
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.02546
• Pdf URL: https://arxiv.org/pdf/2603.02546
• Copy Paste: [[2603.02546]] On Discriminative vs. Generative classifiers: Rethinking MLLMs for Action Understanding(https://arxiv.org/abs/2603.02546)
• Keywords: generation, generative
• Abstract: Multimodal Large Language Models (MLLMs) have advanced open-world action understanding and can be adapted as generative classifiers for closed-set settings by autoregressively generating action labels as text. However, this approach is inefficient, and shared subwords across action labels introduce semantic overlap, leading to ambiguity in generation. In contrast, discriminative classifiers learn task-specific representations with clear decision boundaries, enabling efficient one-step classification without autoregressive decoding. We first compare generative and discriminative classifiers with MLLMs for closed-set action understanding, revealing the superior accuracy and efficiency of the latter. To bridge the performance gap, we design strategies that elevate generative classifiers toward performance comparable with discriminative ones. Furthermore, we show that generative modeling can complement discriminative classifiers, leading to better performance while preserving efficiency. To this end, we propose Generation-Assisted Discriminative~(GAD) classifier for closed-set action understanding. GAD operates only during fine-tuning, preserving full compatibility with MLLM pretraining. Extensive experiments on temporal action understanding benchmarks demonstrate that GAD improves both accuracy and efficiency over generative methods, achieving state-of-the-art results on four tasks across five datasets, including an average 2.5% accuracy gain and 3x faster inference on our largest COIN benchmark.
• 摘要：多模态大语言模型 (MLLM) 具有先进的开放世界动作理解能力，并且可以通过自动回归生成文本形式的动作标签来适应封闭集设置的生成分类器。然而，这种方法效率低下，并且跨动作标签的共享子词会引入语义重叠，导致生成中的歧义。相比之下，判别式分类器学习具有清晰决策边界的特定于任务的表示，从而无需自回归解码即可实现高效的一步分类。我们首先将生成式和判别式分类器与用于闭集动作理解的 MLLM 进行比较，揭示了后者卓越的准确性和效率。为了缩小性能差距，我们设计了一些策略，将生成分类器的性能提升到与判别性分类器相当的性能。此外，我们表明生成模型可以补充判别分类器，从而在保持效率的同时获得更好的性能。为此，我们提出了用于闭集动作理解的生成辅助判别（GAD）分类器。 GAD 仅在微调期间运行，保持与 MLLM 预训练的完全兼容性。关于时间动作理解基准的大量实验表明，GAD 比生成方法提高了准确性和效率，在五个数据集的四项任务上取得了最先进的结果，包括在我们最大的 COIN 基准上平均准确度提高了 2.5%，推理速度提高了 3 倍。

Title: CAWM-Mamba: A unified model for infrared-visible image fusion and compound adverse weather restoration

• Authors: Huichun Liu, Xiaosong Li, Zhuangfan Huang, Tao Ye, Yang Liu, Haishu Tan
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.02560
• Pdf URL: https://arxiv.org/pdf/2603.02560
• Copy Paste: [[2603.02560]] CAWM-Mamba: A unified model for infrared-visible image fusion and compound adverse weather restoration(https://arxiv.org/abs/2603.02560)
• Keywords: restoration
• Abstract: Multimodal Image Fusion (MMIF) integrates complementary information from various modalities to produce clearer and more informative fused images. MMIF under adverse weather is particularly crucial in autonomous driving and UAV monitoring applications. However, existing adverse weather fusion methods generally only tackle single types of degradation such as haze, rain, or snow, and fail when multiple degradations coexist (e.g., haze+rain, rain+snow). To address this challenge, we propose Compound Adverse Weather Mamba (CAWM-Mamba), the first end-to-end framework that jointly performs image fusion and compound weather restoration with unified shared weights. Our network contains three key components: (1) a Weather-Aware Preprocess Module (WAPM) to enhance degraded visible features and extracts global weather embeddings; (2) a Cross-modal Feature Interaction Module (CFIM) to facilitate the alignment of heterogeneous modalities and exchange of complementary features across modalities; and (3) a Wavelet Space State Block (WSSB) that leverages wavelet-domain decomposition to decouple multi-frequency degradations. WSSB includes Freq-SSM, a module that models anisotropic high-frequency degradation without redundancy, and a unified degradation representation mechanism to further improve generalization across complex compound weather conditions. Extensive experiments on the AWMM-100K benchmark and three standard fusion datasets demonstrate that CAWM-Mamba consistently outperforms state-of-the-art methods in both compound and single-weather scenarios. In addition, our fusion results excel in downstream tasks covering semantic segmentation and object detection, confirming the practical value in real-world adverse weather perception. The source code will be available at this https URL.
• 摘要：多模态图像融合 (MMIF) 集成了来自各种模态的互补信息，以生成更清晰、信息更丰富的融合图像。恶劣天气下的 MMIF 在自动驾驶和无人机监控应用中尤为重要。然而，现有的恶劣天气融合方法通常只能解决单一类型的退化，例如雾霾、雨或雪，并且当多种退化共存时（例如雾霾+雨、雨+雪）会失败。为了应对这一挑战，我们提出了复合恶劣天气曼巴（CAWM-Mamba），这是第一个端到端框架，通过统一的共享权重联合执行图像融合和复合天气恢复。我们的网络包含三个关键组件：（1）天气感知预处理模块（WAPM），用于增强降级的可见特征并提取全球天气嵌入； (2) 跨模态特征交互模块（CFIM），以促进异构模态的对齐和跨模态的互补特征的交换； (3) 小波空间状态块 (WSSB)，利用小波域分解来解耦多频率退化。 WSSB 包括 Freq-SSM，这是一个对各向异性高频退化进行无冗余建模的模块，以及一个统一的退化表示机制，可进一步提高复杂复合天气条件下的泛化能力。对 AWMM-100K 基准和三个标准融合数据集的大量实验表明，CAWM-Mamba 在复合和单一天气场景中始终优于最先进的方法。此外，我们的融合结果在涵盖语义分割和对象检测的下游任务中表现出色，证实了在现实世界恶劣天气感知中的实用价值。源代码将在此 https URL 中提供。

Title: ATD: Improved Transformer with Adaptive Token Dictionary for Image Restoration

• Authors: Leheng Zhang, Wei Long, Yawei Li, Xingyu Zhou, Xiaorui Zhao, Shuhang Gu
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.02581
• Pdf URL: https://arxiv.org/pdf/2603.02581
• Copy Paste: [[2603.02581]] ATD: Improved Transformer with Adaptive Token Dictionary for Image Restoration(https://arxiv.org/abs/2603.02581)
• Keywords: restoration, super-resolution
• Abstract: Recently, Transformers have gained significant popularity in image restoration tasks such as image super-resolution and denoising, owing to their superior performance. However, balancing performance and computational burden remains a long-standing problem for transformer-based architectures. Due to the quadratic complexity of self-attention, existing methods often restrict attention to local windows, resulting in limited receptive field and suboptimal performance. To address this issue, we propose Adaptive Token Dictionary (ATD), a novel transformer-based architecture for image restoration that enables global dependency modeling with linear complexity relative to image size. The ATD model incorporates a learnable token dictionary, which summarizes external image priors (i.e., typical image structures) during the training process. To utilize this information, we introduce a token dictionary cross-attention (TDCA) mechanism that enhances the input features via interaction with the learned dictionary. Furthermore, we exploit the category information embedded in the TDCA attention maps to group input features into multiple categories, each representing a cluster of similar features across the image and serving as an attention group. We also integrate the learned category information into the feed-forward network to further improve feature fusion. ATD and its lightweight version ATD-light, achieve state-of-the-art performance on multiple image super-resolution benchmarks. Moreover, we develop ATD-U, a multi-scale variant of ATD, to address other image restoration tasks, including image denoising and JPEG compression artifacts removal. Extensive experiments demonstrate the superiority of out proposed models, both quantitatively and qualitatively.
• 摘要：近年来，Transformers 凭借其优越的性能在图像超分辨率和去噪等图像恢复任务中获得了广泛的应用。然而，对于基于变压器的架构来说，平衡性能和计算负担仍然是一个长期存在的问题。由于自注意力的二次复杂度，现有方法通常将注意力限制在局部窗口，导致感受野有限和性能不佳。为了解决这个问题，我们提出了自适应令牌字典（ATD），这是一种基于变压器的新型图像恢复架构，能够实现具有相对于图像大小的线性复杂度的全局依赖建模。 ATD 模型包含一个可学习的标记字典，它在训练过程中总结了外部图像先验（即典型的图像结构）。为了利用这些信息，我们引入了令牌字典交叉注意（TDCA）机制，该机制通过与学习的字典交互来增强输入特征。此外，我们利用嵌入在 TDCA 注意力图中的类别信息将输入特征分组为多个类别，每个类别代表图像中相似特征的集群并充当注意力组。我们还将学习到的类别信息集成到前馈网络中，以进一步改进特征融合。 ATD 及其轻量级版本 ATD-light 在多个图像超分辨率基准测试中实现了最先进的性能。此外，我们开发了 ATD-U（ATD 的多尺度变体）来解决其他图像恢复任务，包括图像去噪和 JPEG 压缩伪影去除。大量的实验证明了所提出的模型在定量和定性方面的优越性。

Title: Synthetic-Child: An AIGC-Based Synthetic Data Pipeline for Privacy-Preserving Child Posture Estimation

• Authors: Taowen Zeng
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.02598
• Pdf URL: https://arxiv.org/pdf/2603.02598
• Copy Paste: [[2603.02598]] Synthetic-Child: An AIGC-Based Synthetic Data Pipeline for Privacy-Preserving Child Posture Estimation(https://arxiv.org/abs/2603.02598)
• Keywords: generation
• Abstract: Accurate child posture estimation is critical for AI-powered study companion devices, yet collecting large-scale annotated datasets of children is both expensive and ethically prohibitive due to privacy concerns. We present Synthetic-Child, an AIGC-based synthetic data pipeline that produces photorealistic child posture training images with ground-truth-projected keypoint annotations, requiring zero real child photographs. The pipeline comprises four stages: (1) a programmable 3D child body model (SMPL-X) in Blender generates diverse desk-study poses with IK-constrained anatomical plausibility and automatic COCO-format ground-truth export; (2) a custom PoseInjectorNode feeds 3D-derived skeletons into a dual ControlNet (pose + depth) conditioned on FLUX-1 Dev, synthesizing 12,000 photorealistic images across 10 posture categories with low annotation drift; (3) ViTPose-based confidence filtering and targeted augmentation remove generation failures and improve robustness; (4) RTMPose-M (13.6M params) is fine-tuned on the synthetic data and paired with geometric feature engineering and a lightweight MLP for posture classification, then quantized to INT8 for real-time edge deployment. On a real-child test set (n~300), the FP16 model achieves 71.2 AP -- a +12.5 AP improvement over the COCO-pretrained adult-data baseline at identical model capacity. After INT8 quantization the model retains 70.4 AP while running at 22 FPS on a 0.8-TOPS Rockchip RK3568 NPU. In a single-subject controlled comparison with a commercial posture corrector, our system achieves substantially higher recognition rates across most tested categories and responds ~1.8x faster on average. These results demonstrate that carefully designed AIGC pipelines can substantially reduce dependence on real child imagery while achieving deployment-ready accuracy, with potential applications to other privacy-sensitive domains.
• 摘要：准确的儿童姿势估计对于人工智能驱动的学习配套设备至关重要，但由于隐私问题，收集大规模带注释的儿童数据集不仅成本高昂，而且在道德上令人望而却步。我们推出了 Synthetic-Child，这是一种基于 AIGC 的合成数据管道，可生成具有真实投影关键点注释的逼真儿童姿势训练图像，需要零真实儿童照片。该管道包括四个阶段：(1) Blender 中的可编程 3D 儿童身体模型 (SMPL-X) 生成具有 IK 约束解剖合理性和自动 COCO 格式地面实况导出的多种案头研究姿势； (2) 自定义 PoseInjectorNode 将 3D 衍生骨架输入以 FLUX-1 Dev 为条件的双 ControlNet（姿势 + 深度），合成 10 个姿势类别的 12,000 张真实感图像，注释漂移较低； (3) 基于 ViTPose 的置信度过滤和定向增强消除了生成失败并提高了鲁棒性； (4) RTMPose-M（13.6M 参数）在合成数据上进行微调，并与几何特征工程和轻量级 MLP 配对进行姿势分类，然后量化为 INT8 以进行实时边缘部署。在真实儿童测试集 (n~300) 上，FP16 模型达到 71.2 AP，比相同模型容量下的 COCO 预训练成人数据基线提高了 +12.5 AP。 INT8 量化后，模型在 0.8 TOPS Rockchip RK3568 NPU 上以 22 FPS 运行时保留 70.4 AP。在与商业姿势校正器的单受试者控制比较中，我们的系统在大多数测试类别中实现了更高的识别率，并且平均响应速度快了约 1.8 倍。这些结果表明，精心设计的 AIGC 管道可以大大减少对真实儿童图像的依赖，同时实现部署就绪的准确性，并有可能应用于其他隐私敏感领域。

Title: Real-Time Generative Policy via Langevin-Guided Flow Matching for Autonomous Driving

• Authors: Tianze Zhu, Yinuo Wang, Wenjun Zou, Tianyi Zhang, Likun Wang, Letian Tao, Feihong Zhang, Yao Lyu, Shengbo Eben Li
• Subjects: cs.LG, cs.RO
• Abstract URL: https://arxiv.org/abs/2603.02613
• Pdf URL: https://arxiv.org/pdf/2603.02613
• Copy Paste: [[2603.02613]] Real-Time Generative Policy via Langevin-Guided Flow Matching for Autonomous Driving(https://arxiv.org/abs/2603.02613)
• Keywords: generation, generative
• Abstract: Reinforcement learning (RL) is a fundamental methodology in autonomous driving systems, where generative policies exhibit considerable potential by leveraging their ability to model complex distributions to enhance exploration. However, their inherent high inference latency severely impedes their deployment in real-time decision-making and control. To address this issue, we propose diffusion actor-critic with entropy regulator via flow matching (DACER-F) by introducing flow matching into online RL, enabling the generation of competitive actions in a single inference step. By leveraging Langevin dynamics and gradients of the Q-function, DACER-F dynamically optimizes actions from experience replay toward a target distribution that balances high Q-value information with exploratory behavior. The flow policy is then trained to efficiently learn a mapping from a simple prior distribution to this dynamic target. In complex multi-lane and intersection simulations, DACER-F outperforms baselines diffusion actor-critic with entropy regulator (DACER) and distributional soft actor-critic (DSAC), while maintaining an ultra-low inference latency. DACER-F further demonstrates its scalability on standard RL benchmark DeepMind Control Suite (DMC), achieving a score of 775.8 in the humanoid-stand task and surpassing prior methods. Collectively, these results establish DACER-F as a high-performance and computationally efficient RL algorithm.
• 摘要：强化学习 (RL) 是自动驾驶系统中的一种基本方法，其中生成策略通过利用其对复杂分布进行建模的能力来增强探索，从而展现出巨大的潜力。然而，它们固有的高推理延迟严重阻碍了它们在实时决策和控制中的部署。为了解决这个问题，我们提出了通过流匹配使用熵调节器的扩散行动者批评家（DACER-F），将流匹配引入在线强化学习中，从而能够在单个推理步骤中生成竞争动作。通过利用 Langevin 动力学和 Q 函数梯度，DACER-F 动态优化从经验回放到平衡高 Q 值信息与探索行为的目标分布的操作。然后训练流策略以有效地学习从简单先验分布到该动态目标的映射。在复杂的多车道和交叉口模拟中，DACER-F 的性能优于带有熵调节器的扩散 Actor-Critic (DACER) 和分布式软 Actor-Critic (DSAC)，同时保持超低推理延迟。 DACER-F 进一步展示了其在标准 RL 基准 DeepMind Control Suite (DMC) 上的可扩展性，在人形站立任务中取得了 775.8 的分数，超越了之前的方法。总的来说，这些结果将 DACER-F 确立为高性能且计算高效的 RL 算法。

Title: Direct Reward Fine-Tuning on Poses for Single Image to 3D Human in the Wild

• Authors: Seunguk Do, Minwoo Huh, Joonghyuk Shin, Jaesik Park
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.02619
• Pdf URL: https://arxiv.org/pdf/2603.02619
• Copy Paste: [[2603.02619]] Direct Reward Fine-Tuning on Poses for Single Image to 3D Human in the Wild(https://arxiv.org/abs/2603.02619)
• Keywords: generative
• Abstract: Single-view 3D human reconstruction has achieved remarkable progress through the adoption of multi-view diffusion models, yet the recovered 3D humans often exhibit unnatural poses. This phenomenon becomes pronounced when reconstructing 3D humans with dynamic or challenging poses, which we attribute to the limited scale of available 3D human datasets with diverse poses. To address this limitation, we introduce DrPose, Direct Reward fine-tuning algorithm on Poses, which enables post-training of a multi-view diffusion model on diverse poses without requiring expensive 3D human assets. DrPose trains a model using only human poses paired with single-view images, employing a direct reward fine-tuning to maximize PoseScore, which is our proposed differentiable reward that quantifies consistency between a generated multi-view latent image and a ground-truth human pose. This optimization is conducted on DrPose15K, a novel dataset that was constructed from an existing human motion dataset and a pose-conditioned video generative model. Constructed from abundant human pose sequence data, DrPose15K exhibits a broader pose distribution compared to existing 3D human datasets. We validate our approach through evaluation on conventional benchmark datasets, in-the-wild images, and a newly constructed benchmark, with a particular focus on assessing performance on challenging human poses. Our results demonstrate consistent qualitative and quantitative improvements across all benchmarks. Project page: this https URL.
• 摘要：通过采用多视图扩散模型，单视图 3D 人体重建取得了显着的进展，但恢复后的 3D 人体经常表现出不自然的姿势。当重建具有动态或挑战性姿势的 3D 人体时，这种现象变得更加明显，我们将其归因于具有不同姿势的可用 3D 人体数据集的规模有限。为了解决这个限制，我们引入了 DrPose，即针对姿势的直接奖励微调算法，它可以对不同姿势的多视图扩散模型进行后期训练，而无需昂贵的 3D 人力资产。 DrPose 仅​​使用与单视图图像配对的人体姿势来训练模型，采用直接奖励微调来最大化 PoseScore，这是我们提出的可微奖励，用于量化生成的多视图潜在图像和真实人体姿势之间的一致性。此优化是在 DrPose15K 上进行的，DrPose15K 是一个新颖的数据集，由现有的人体运动数据集和姿势条件视频生成模型构建而成。 DrPose15K 由丰富的人体姿势序列数据构建而成，与现有的 3D 人体数据集相比，表现出更广泛的姿势分布。我们通过对传统基准数据集、野外图像和新构建的基准进行评估来验证我们的方法，特别关注评估具有挑战性的人体姿势的性能。我们的结果表明，所有基准都取得了一致的定性和定量改进。项目页面：此 https URL。

Title: DREAM: Where Visual Understanding Meets Text-to-Image Generation

• Authors: Chao Li, Tianhong Li, Sai Vidyaranya Nuthalapati, Hong-You Chen, Satya Narayan Shukla, Yonghuan Yang, Jun Xiao, Xiangjun Fan, Aashu Singh, Dina Katabi, Shlok Kumar Mishra
• Subjects: cs.CV, cs.LG
• Abstract URL: https://arxiv.org/abs/2603.02667
• Pdf URL: https://arxiv.org/pdf/2603.02667
• Copy Paste: [[2603.02667]] DREAM: Where Visual Understanding Meets Text-to-Image Generation(https://arxiv.org/abs/2603.02667)
• Keywords: generation, generative
• Abstract: Unifying visual representation learning and text-to-image (T2I) generation within a single model remains a central challenge in multimodal learning. We introduce DREAM, a unified framework that jointly optimizes discriminative and generative objectives, while learning strong visual representations. DREAM is built on two key techniques: During training, Masking Warmup, a progressive masking schedule, begins with minimal masking to establish the contrastive alignment necessary for representation learning, then gradually transitions to full masking for stable generative training. At inference, DREAM employs Semantically Aligned Decoding to align partially masked image candidates with the target text and select the best one for further decoding, improving text-image fidelity (+6.3%) without external rerankers. Trained solely on CC12M, DREAM achieves 72.7% ImageNet linear-probing accuracy (+1.1% over CLIP) and an FID of 4.25 (+6.2% over FLUID), with consistent gains in few-shot classification, semantic segmentation, and depth estimation. These results demonstrate that discriminative and generative objectives can be synergistic, allowing unified multimodal models that excel at both visual understanding and generation.
• 摘要：在单个模型中统一视觉表示学习和文本到图像（T2I）生成仍然是多模态学习的核心挑战。我们引入了 DREAM，这是一个统一的框架，可以联合优化判别目标和生成目标，同时学习强大的视觉表示。 DREAM 建立在两个关键技术之上：在训练过程中，掩蔽热身（一种渐进式掩蔽计划）从最小掩蔽开始，以建立表示学习所需的对比对齐，然后逐渐过渡到完全掩蔽以实现稳定的生成训练。在推理时，DREAM 采用语义对齐解码将部分屏蔽的候选图像与目标文本对齐，并选择最佳图像进行进一步解码，无需外部重新排序即可提高文本图像保真度 (+6.3%)。仅在 CC12M 上进行训练，DREAM 实现了 72.7% 的 ImageNet 线性探测精度（比 CLIP 高 1.1%）和 4.25 的 FID（比 FLUID 高 6.2%），在少样本分类、语义分割和深度估计方面具有一致的增益。这些结果表明，判别性目标和生成性目标可以协同作用，从而允许统一的多模态模型在视觉理解和生成方面表现出色。

Title: VisionCreator: A Native Visual-Generation Agentic Model with Understanding, Thinking, Planning and Creation

• Authors: Jinxiang Lai, Zexin Lu, Jiajun He, Rongwei Quan, Wenzhe Zhao, Qinyu Yang, Qi Chen, Qin Lin, Chuyue Li, Tao Gao, Yuhao Shan, Shuai Shao, Song Guo, Qinglin Lu
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.02681
• Pdf URL: https://arxiv.org/pdf/2603.02681
• Copy Paste: [[2603.02681]] VisionCreator: A Native Visual-Generation Agentic Model with Understanding, Thinking, Planning and Creation(https://arxiv.org/abs/2603.02681)
• Keywords: generation
• Abstract: Visual content creation tasks demand a nuanced understanding of design conventions and creative workflows-capabilities challenging for general models, while workflow-based agents lack specialized knowledge for autonomous creative planning. To overcome these challenges, we propose VisionCreator, a native visual-generation agentic model that unifies Understanding, Thinking, Planning, and Creation (UTPC) capabilities within an end-to-end learnable framework. Our work introduces four key contributions: (i) VisGenData-4k and its construction methodology using metacognition-based VisionAgent to generate high-quality creation trajectories with explicit UTPC structures; (ii) The VisionCreator agentic model, optimized through Progressive Specialization Training (PST) and Virtual Reinforcement Learning (VRL) within a high-fidelity simulated environment, enabling stable and efficient acquisition of UTPC capabilities for complex creation tasks; (iii) VisGenBench, a comprehensive benchmark featuring 1.2k test samples across diverse scenarios for standardized evaluation of multi-step visual creation capabilities; (iv) Remarkably, our VisionCreator-8B/32B models demonstrate superior performance over larger closed-source models across multiple evaluation dimensions. Overall, this work provides a foundation for future research in visual-generation agentic systems.
• 摘要：视觉内容创建任务需要对设计惯例和创意工作流程有细致入微的理解，这对一般模型来说是一个挑战，而基于工作流程的代理缺乏自主创意规划的专业知识。为了克服这些挑战，我们提出了 VisionCreator，这是一种本地视觉生成代理模型，它将理解、思考、规划和创造 (UTPC) 功能统一在端到端的可学习框架内。我们的工作介绍了四个关键贡献：（i）VisGenData-4k 及其构建方法，使用基于元认知的 VisionAgent 来生成具有明确 UTPC 结构的高质量创建轨迹； (ii) VisionCreator代理模型，通过高保真模拟环境中的渐进式专业化训练（PST）和虚拟强化学习（VRL）进行优化，能够稳定高效地获取UTPC能力来完成复杂的创建任务； (iii) VisGenBench，一个综合基准，具有跨场景的 1.2k 测试样本，用于标准化评估多步视觉创作能力； (iv) 值得注意的是，我们的 VisionCreator-8B/32B 模型在多个评估维度上表现出优于大型闭源模型的性能。总的来说，这项工作为视觉生成代理系统的未来研究奠定了基础。

Title: FiDeSR: High-Fidelity and Detail-Preserving One-Step Diffusion Super-Resolution

• Authors: Aro Kim, Myeongjin Jang, Chaewon Moon, Youngjin Shin, Jinwoo Jeong, Sang-hyo Park
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.02692
• Pdf URL: https://arxiv.org/pdf/2603.02692
• Copy Paste: [[2603.02692]] FiDeSR: High-Fidelity and Detail-Preserving One-Step Diffusion Super-Resolution(https://arxiv.org/abs/2603.02692)
• Keywords: restoration, super-resolution
• Abstract: Diffusion-based approaches have recently driven remarkable progress in real-world image super-resolution (SR). However, existing methods still struggle to simultaneously preserve fine details and ensure high-fidelity reconstruction, often resulting in suboptimal visual quality. In this paper, we propose FiDeSR, a high-fidelity and detail-preserving one-step diffusion super-resolution framework. During training, we introduce a detail-aware weighting strategy that adaptively emphasizes regions where the model exhibits higher prediction errors. During inference, low- and high-frequency adaptive enhancers further refine the reconstruction without requiring model retraining, enabling flexible enhancement control. To further improve the reconstruction accuracy, FiDeSR incorporates a residual-in-residual noise refinement, which corrects prediction errors in the diffusion noise and enhances fine detail recovery. FiDeSR achieves superior real-world SR performance compared to existing diffusion-based methods, producing outputs with both high perceptual quality and faithful content restoration. The source code will be released at: this https URL.
• 摘要：基于扩散的方法最近推动了现实世界图像超分辨率（SR）的显着进步。然而，现有的方法仍然难以同时保留精细细节并确保高保真重建，通常会导致视觉质量不佳。在本文中，我们提出了 FiDeSR，一种高保真且保留细节的一步扩散超分辨率框架。在训练过程中，我们引入了一种细节感知加权策略，该策略自适应地强调模型表现出较高预测误差的区域。在推理过程中，低频和高频自适应增强器进一步细化重建，无需模型重新训练，从而实现灵活的增强控制。为了进一步提高重建精度，FiDeSR 结合了残差噪声细化，可纠正扩散噪声中的预测误差并增强精细细节恢复。与现有的基于扩散的方法相比，FiDeSR 实现了卓越的现实世界 SR 性能，产生具有高感知质量和忠实内容还原的输出。源代码将发布在：此 https URL。

Title: ShareVerse: Multi-Agent Consistent Video Generation for Shared World Modeling

• Authors: Jiayi Zhu, Jianing Zhang, Yiying Yang, Wei Cheng, Xiaoyun Yuan
• Subjects: cs.CV, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.02697
• Pdf URL: https://arxiv.org/pdf/2603.02697
• Copy Paste: [[2603.02697]] ShareVerse: Multi-Agent Consistent Video Generation for Shared World Modeling(https://arxiv.org/abs/2603.02697)
• Keywords: generation
• Abstract: This paper presents ShareVerse, a video generation framework enabling multi-agent shared world modeling, addressing the gap in existing works that lack support for unified shared world construction with multi-agent interaction. ShareVerse leverages the generation capability of large video models and integrates three key innovations: 1) A dataset for large-scale multi-agent interactive world modeling is built on the CARLA simulation platform, featuring diverse scenes, weather conditions, and interactive trajectories with paired multi-view videos (front/ rear/ left/ right views per agent) and camera data. 2) We propose a spatial concatenation strategy for four-view videos of independent agents to model a broader environment and to ensure internal multi-view geometric consistency. 3) We integrate cross-agent attention blocks into the pretrained video model, which enable interactive transmission of spatial-temporal information across agents, guaranteeing shared world consistency in overlapping regions and reasonable generation in non-overlapping regions. ShareVerse, which supports 49-frame large-scale video generation, accurately perceives the position of dynamic agents and achieves consistent shared world modeling.
• 摘要：本文提出了 ShareVerse，一种支持多智能体共享世界建模的视频生成框架，解决了现有作品缺乏对多智能体交互的统一共享世界构建支持的空白。 ShareVerse 利用大型视频模型的生成能力，并集成了三个关键创新：1）在 CARLA 仿真平台上构建了大规模多智能体交互式世界建模的数据集，具有不同的场景、天气条件和交互式轨迹，以及配对的多视图视频（每个智能体的前/后/左/右视图）和摄像头数据。 2）我们提出了一种针对独立代理的四视图视频的空间串联策略，以建模更广泛的环境并确保内部多视图几何一致性。 3）我们将跨智能体注意力块集成到预训练的视频模型中，从而实现跨智能体的时空信息交互传输，保证重叠区域中共享世界的一致性以及非重叠区域中的合理生成。 ShareVerse支持49帧大规模视频生成，准确感知动态代理的位置，实现一致的共享世界建模。

Title: MiM-DiT: MoE in MoE with Diffusion Transformers for All-in-One Image Restoration

• Authors: Lingshun Kong, Jiawei Zhang, Zhengpeng Duan, Xiaohe Wu, Yueqi Yang, Xiaotao Wang, Dongqing Zou, Lei Lei, Jinshan Pan
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.02710
• Pdf URL: https://arxiv.org/pdf/2603.02710
• Copy Paste: [[2603.02710]] MiM-DiT: MoE in MoE with Diffusion Transformers for All-in-One Image Restoration(https://arxiv.org/abs/2603.02710)
• Keywords: restoration
• Abstract: All-in-one image restoration is challenging because different degradation types, such as haze, blur, noise, and low-light, impose diverse requirements on restoration strategies, making it difficult for a single model to handle them effectively. In this paper, we propose a unified image restoration framework that integrates a dual-level Mixture-of-Experts (MoE) architecture with a pretrained diffusion model. The framework operates at two levels: the Inter-MoE layer adaptively combines expert groups to handle major degradation types, while the Intra-MoE layer further selects specialized sub-experts to address fine-grained variations within each type. This design enables the model to achieve coarse-grained adaptation across diverse degradation categories while performing fine-grained modulation for specific intra-class variations, ensuring both high specialization in handling complex, real-world corruptions. Extensive experiments demonstrate that the proposed method performs favorably against the state-of-the-art approaches on multiple image restoration task.
• 摘要：一体化图像恢复具有挑战性，因为不同的退化类型，如雾霾、模糊、噪声和低光，对恢复策略提出了不同的要求，使得单一模型很难有效地处理它们。在本文中，我们提出了一个统一的图像恢复框架，它将双层专家混合（MoE）架构与预训练的扩散模型集成在一起。该框架在两个层面上运行：MoE 间层自适应地组合专家组来处理主要的退化类型，而 MoE 内层进一步选择专门的子专家来解决每种类型内的细粒度变化。这种设计使模型能够实现跨不同退化类别的粗粒度适应，同时针对特定的类内变化执行细粒度调制，确保在处理复杂的现实世界损坏时具有高度专业化。大量的实验表明，所提出的方法在多图像恢复任务上的性能优于最先进的方法。

Title: From "What" to "How": Constrained Reasoning for Autoregressive Image Generation

• Authors: Ruxue Yan, Xubo Liu, Wenya Guo, Zhengkun Zhang, Ying Zhang, Xiaojie Yuan
• Subjects: cs.CV, cs.MM, eess.IV
• Abstract URL: https://arxiv.org/abs/2603.02712
• Pdf URL: https://arxiv.org/pdf/2603.02712
• Copy Paste: [[2603.02712]] From "What" to "How": Constrained Reasoning for Autoregressive Image Generation(https://arxiv.org/abs/2603.02712)
• Keywords: generation
• Abstract: Autoregressive image generation has seen recent improvements with the introduction of chain-of-thought and reinforcement learning. However, current methods merely specify "What" details to depict by rewriting the input prompt, yet fundamentally fail to reason about "How" to structure the overall image. This inherent limitation gives rise to persistent issues, such as spatial ambiguity directly causing unrealistic object overlaps. To bridge this gap, we propose CoR-Painter, a novel framework that pioneers a "How-to-What" paradigm by introducing Constrained Reasoning to guide the autoregressive generation. Specifically, it first deduces "How to draw" by deriving a set of visual constraints from the input prompt, which explicitly govern spatial relationships, key attributes, and compositional rules. These constraints steer the subsequent generation of a detailed description "What to draw", providing a structurally sound and coherent basis for accurate visual synthesis. Additionally, we introduce a Dual-Objective GRPO strategy that specifically optimizes the textual constrained reasoning and visual projection processes to ensure the coherence and quality of the entire generation pipeline. Extensive experiments on T2I-CompBench, GenEval, and WISE demonstrate that our method achieves state-of-the-art performance, with significant improvements in spatial metrics (e.g., +5.41% on T2I-CompBench).
• 摘要：随着思想链和强化学习的引入，自回归图像生成最近得到了改进。然而，当前的方法仅仅通过重写输入提示来指定要描述“什么”细节，而从根本上无法推理出“如何”来构建整体图像。这种固有的限制引起了持续存在的问题，例如空间模糊性直接导致不切实际的对象重叠。为了弥补这一差距，我们提出了 CoR-Painter，这是一种新颖的框架，通过引入约束推理来指导自回归生成，开创了“如何做”范式。具体来说，它首先通过从输入提示中导出一组视觉约束来推导出“如何绘制”，这些视觉约束明确地控制空间关系、关键属性和构图规则。这些约束引导“画什么”的详细描述的后续生成，为准确的视觉合成提供结构合理且连贯的基础。此外，我们引入了双目标 GRPO 策略，专门优化文本约束推理和视觉投影过程，以确保整个生成流程的连贯性和质量。 T2I-CompBench、GenEval 和 WISE 上的大量实验表明，我们的方法实现了最先进的性能，空间指标显着改进（例如，在 T2I-CompBench 上提高了 5.41%）。

Title: CoShadow: Multi-Object Shadow Generation for Image Compositing via Diffusion Model

• Authors: Waqas Ahmed, Dean Diepeveen, Ferdous Sohel
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.02743
• Pdf URL: https://arxiv.org/pdf/2603.02743
• Copy Paste: [[2603.02743]] CoShadow: Multi-Object Shadow Generation for Image Compositing via Diffusion Model(https://arxiv.org/abs/2603.02743)
• Keywords: generation
• Abstract: Realistic shadow generation is crucial for achieving seamless image compositing, yet existing methods primarily focus on single-object insertion and often fail to generalize when multiple foreground objects are composited into a background scene. In practice, however, modern compositing pipelines and real-world applications often insert multiple objects simultaneously, necessitating shadows that are jointly consistent in terms of geometry, attachment, and location. In this paper, we address the under-explored problem of multi-object shadow generation, aiming to synthesize physically plausible shadows for multiple inserted objects. Our approach exploits the multimodal capabilities of a pre-trained text-to-image diffusion model. An image pathway injects dense, multi-scale features to provide fine-grained spatial guidance, while a text-based pathway encodes per-object shadow bounding boxes as learned positional tokens and fuses them via cross-attention. An attention-alignment loss further grounds these tokens to their corresponding shadow regions. To support this task, we augment the DESOBAv2 dataset by constructing composite scenes with multiple inserted objects and automatically derive prompts combining object category and shadow positioning information. Experimental results demonstrate that our method achieves state-of-the-art performance in both single and multi-object shadow generation settings.
• 摘要：真实的阴影生成对于实现无缝图像合成至关重要，但现有方法主要关注单个对象插入，当多个前景对象合成到背景场景中时通常无法泛化。然而，在实践中，现代合成管道和现实世界的应用程序通常会同时插入多个对象，因此需要在几何形状、附件和位置方面保持一致的阴影。在本文中，我们解决了多对象阴影生成的尚未探索的问题，旨在为多个插入的对象合成物理上合理的阴影。我们的方法利用了预训练的文本到图像扩散模型的多模态功能。图像路径注入密集的多尺度特征以提供细粒度的空间指导，而基于文本的路径将每个对象的阴影边界框编码为学习的位置标记，并通过交叉注意将它们融合。注意力对齐损失进一步将这些标记置于其相应的阴影区域。为了支持此任务，我们通过构建具有多个插入对象的复合场景来扩充 DESOBAv2 数据集，并结合对象类别和阴影定位信息自动导出提示。实验结果表明，我们的方法在单对象和多对象阴影生成设置中均实现了最先进的性能。

Title: ScribeTokens: Fixed-Vocabulary Tokenization of Digital Ink

• Authors: Douglass Wang
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.02805
• Pdf URL: https://arxiv.org/pdf/2603.02805
• Copy Paste: [[2603.02805]] ScribeTokens: Fixed-Vocabulary Tokenization of Digital Ink(https://arxiv.org/abs/2603.02805)
• Keywords: generation
• Abstract: Digital ink -- the coordinate stream captured from stylus or touch input -- lacks a unified representation. Continuous vector representations produce long sequences and suffer from training instability, while existing token representations require large vocabularies, face out-of-vocabulary issues, and underperform vectors on recognition. We propose ScribeTokens, a tokenization that decomposes pen movement into unit pixel steps. Together with two pen-state tokens, this fixed 10-token base vocabulary suffices to represent any digital ink and enables aggressive BPE compression. On handwritten text generation, ScribeTokens dramatically outperforms vectors (17.33% vs. 70.29% CER), showing tokens are far more effective for generation. On recognition, ScribeTokens is the only token representation to outperform vectors without pretraining. We further introduce next-ink-token prediction as a self-supervised pretraining strategy, which consistently improves recognition across all token-based models and accelerates convergence by up to 83x. With pretraining, ScribeTokens achieves the best recognition results across all representations on both datasets (8.27% CER on IAM, 9.83% on DeepWriting).
• 摘要：数字墨水——从手写笔或触摸输入捕获的坐标流——缺乏统一的表示。连续向量表示会产生长序列并受到训练不稳定的影响，而现有的标记表示需要大量词汇表，面临词汇表外问题，并且在识别方面表现不佳。我们提出了 ScribeTokens，一种将笔移动分解为单位像素步骤的标记化。与两个笔状态令牌一起，这个固定的 10 个令牌基本词汇表足以表示任何数字墨水，并实现积极的 BPE 压缩。在手写文本生成方面，ScribeTokens 的性能显着优于向量（17.33% vs. 70.29% CER），这表明令牌的生成效率要高得多。在识别方面，ScribeTokens 是唯一一种在无需预训练的情况下优于向量的标记表示形式。我们进一步引入了下一个墨水标记预测作为一种自我监督的预训练策略，该策略能够持续提高所有基于标记的模型的识别能力，并将收敛速度加快高达 83 倍。通过预训练，ScribeTokens 在两个数据集上的所有表示中实现了最佳识别结果（IAM 上的 CER 为 8.27%，DeepWriting 上的 CER 为 9.83%）。

Title: BrandFusion: A Multi-Agent Framework for Seamless Brand Integration in Text-to-Video Generation

• Authors: Zihao Zhu, Ruotong Wang, Siwei Lyu, Min Zhang, Baoyuan Wu
• Subjects: cs.CV, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.02816
• Pdf URL: https://arxiv.org/pdf/2603.02816
• Copy Paste: [[2603.02816]] BrandFusion: A Multi-Agent Framework for Seamless Brand Integration in Text-to-Video Generation(https://arxiv.org/abs/2603.02816)
• Keywords: generation
• Abstract: The rapid advancement of text-to-video (T2V) models has revolutionized content creation, yet their commercial potential remains largely untapped. We introduce, for the first time, the task of seamless brand integration in T2V: automatically embedding advertiser brands into prompt-generated videos while preserving semantic fidelity to user intent. This task confronts three core challenges: maintaining prompt fidelity, ensuring brand recognizability, and achieving contextually natural integration. To address them, we propose BrandFusion, a novel multi-agent framework comprising two synergistic phases. In the offline phase (advertiser-facing), we construct a Brand Knowledge Base by probing model priors and adapting to novel brands via lightweight fine-tuning. In the online phase (user-facing), five agents jointly refine user prompts through iterative refinement, leveraging the shared knowledge base and real-time contextual tracking to ensure brand visibility and semantic alignment. Experiments on 18 established and 2 custom brands across multiple state-of-the-art T2V models demonstrate that BrandFusion significantly outperforms baselines in semantic preservation, brand recognizability, and integration naturalness. Human evaluations further confirm higher user satisfaction, establishing a practical pathway for sustainable T2V monetization.
• 摘要：文本转视频 (T2V) 模型的快速发展彻底改变了内容创作，但其商业潜力在很大程度上尚未开发。我们首次在 T2V 中引入无缝品牌集成的任务：自动将广告商品牌嵌入到提示生成的视频中，同时保持对用户意图的语义保真度。这项任务面临三个核心挑战：保持即时保真度、确保品牌可识别性以及实现上下文自然整合。为了解决这些问题，我们提出了 BrandFusion，这是一种新颖的多智能体框架，包含两个协同阶段。在离线阶段（面向广告商），我们通过探索模型先验并通过轻量级微调来适应新品牌来构建品牌知识库。在在线阶段（面向用户），五个代理通过迭代细化共同完善用户提示，利用共享知识库和实时上下文跟踪来确保品牌可见性和语义一致性。在多个最先进的 T2V 模型中对 18 个已建立品牌和 2 个定制品牌进行的实验表明，BrandFusion 在语义保留、品牌可识别性和集成自然性方面显着优于基线。人工评估进一步证实了更高的用户满意度，为可持续的 T2V 货币化建立了实用途径。

Title: Toward Early Quality Assessment of Text-to-Image Diffusion Models

• Authors: Huanlei Guo, Hongxin Wei, Bingyi Jing
• Subjects: cs.CV, cs.LG
• Abstract URL: https://arxiv.org/abs/2603.02829
• Pdf URL: https://arxiv.org/pdf/2603.02829
• Copy Paste: [[2603.02829]] Toward Early Quality Assessment of Text-to-Image Diffusion Models(https://arxiv.org/abs/2603.02829)
• Keywords: generation, generative, quality assessment
• Abstract: Recent text-to-image (T2I) diffusion and flow-matching models can produce highly realistic images from natural language prompts. In practical scenarios, T2I systems are often run in a ``generate--then--select'' mode: many seeds are sampled and only a few images are kept for use. However, this pipeline is highly resource-intensive since each candidate requires tens to hundreds of denoising steps, and evaluation metrics such as CLIPScore and ImageReward are post-hoc. In this work, we address this inefficiency by introducing Probe-Select, a plug-in module that enables efficient evaluation of image quality within the generation process. We observe that certain intermediate denoiser activations, even at early timesteps, encode a stable coarse structure, object layout and spatial arrangement--that strongly correlates with final image fidelity. Probe-Select exploits this property by predicting final quality scores directly from early activations, allowing unpromising seeds to be terminated early. Across diffusion and flow-matching backbones, our experiments show that early evaluation at only 20\% of the trajectory accurately ranks candidate seeds and enables selective continuation. This strategy reduces sampling cost by over 60\% while improving the quality of the retained images, demonstrating that early structural signals can effectively guide selective generation without altering the underlying generative model. Code is available at this https URL.
• 摘要：最近的文本到图像（T2I）扩散和流程匹配模型可以根据自然语言提示生成高度逼真的图像。在实际场景中，T2I 系统通常以“生成-然后-选择”模式运行：采样许多种子，只保留少量图像供使用。然而，这个管道是高度资源密集型的，因为每个候选者都需要数十到数百个去噪步骤，并且 CLIPScore 和 ImageReward 等评估指标是事后的。在这项工作中，我们通过引入 Probe-Select 来解决这种低效率问题，这是一个插件模块，可以在生成过程中有效评估图像质量。我们观察到，某些中间降噪器激活，即使在早期时间步长，也会编码稳定的粗结构、对象布局和空间排列——这与最终图像保真度密切相关。 Probe-Select 通过直接从早期激活预测最终质量分数来利用这一特性，从而允许提前终止没有希望的种子。在扩散和流匹配主干上，我们的实验表明，仅对轨迹的 20% 进行早期评估即可准确地对候选种子进行排名，并实现选择性延续。该策略将采样成本降低了 60% 以上，同时提高了保留图像的质量，证明早期结构信号可以有效指导选择性生成，而无需改变底层生成模型。代码可从此 https URL 获取。

Title: Think-as-You-See: Streaming Chain-of-Thought Reasoning for Large Vision-Language Models

• Authors: Jialiang Zhang, Junlong Tong, Junyan Lin, Hao Wu, Yirong Sun, Yunpu Ma, Xiaoyu Shen
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.02872
• Pdf URL: https://arxiv.org/pdf/2603.02872
• Copy Paste: [[2603.02872]] Think-as-You-See: Streaming Chain-of-Thought Reasoning for Large Vision-Language Models(https://arxiv.org/abs/2603.02872)
• Keywords: generation
• Abstract: Large Vision Language Models (LVLMs) exhibit strong Chain-of-Thought (CoT) capabilities, yet most existing paradigms assume full-video availability before inference, a batch-style process misaligned with real-world video streams where information arrives sequentially. Motivated by the streaming nature of video data, we investigate two streaming reasoning paradigms for LVLMs. The first, an interleaved paradigm, alternates between receiving frames and producing partial reasoning but remains constrained by strictly ordered cache updates. To better match streaming inputs, we propose \textbf{Think-as-You-See (TaYS)}, a unified framework enabling true concurrent reasoning. TaYS integrates parallelized CoT generation, stream-constrained training, and stream-parallel inference. It further employs temporally aligned reasoning units, streaming attention masks and positional encodings, and a dual KV-cache that decouples visual encoding from textual reasoning. We evaluate all paradigms on the Qwen2.5-VL family across representative video CoT tasks, including event dynamics analysis, causal reasoning, and thematic understanding. Experiments show that TaYS consistently outperforms both batch and interleaved baselines, improving reasoning performance while substantially reducing time-to-first-token (TTFT) and overall reasoning delay. These results demonstrate the effectiveness of data-aligned streaming reasoning in enabling efficient and responsive video understanding for LVLMs. We release our code at \href{this https URL}{this repository.}
• 摘要：大视觉语言模型 (LVLM) 表现出强大的思想链 (CoT) 功能，但大多数现有范例都假设推理之前具有完整视频可用性，这是一种与信息按顺序到达的现实视频流不一致的批处理式过程。受视频数据流式传输性质的启发，我们研究了 LVLM 的两种流式推理范例。第一种是交错范例，在接收帧和产生部分推理之间交替，但仍然受到严格排序的缓存更新的限制。为了更好地匹配流输入，我们提出了 \textbf{Think-as-You-See (TaYS)}，这是一个能够实现真正并发推理的统一框架。 TaYS 集成了并行 CoT 生成、流约束训练和流并行推理。它还采用了时间对齐的推理单元、流式注意力掩码和位置编码，以及将视觉编码与文本推理分离的双 KV 缓存。我们评估了 Qwen2.5-VL 系列上代表性视频 CoT 任务的所有范式，包括事件动态分析、因果推理和主题理解。实验表明，TaYS 始终优于批处理和交错基线，提高了推理性能，同时大幅减少了首次标记时间 (TTFT) 和整体推理延迟。这些结果证明了数据对齐流推理在为 LVLM 实现高效且响应灵敏的视频理解方面的有效性。我们在 \href{这个 https URL}{这个存储库。} 发布我们的代码。

Title: SIGMark: Scalable In-Generation Watermark with Blind Extraction for Video Diffusion

• Authors: Xinjie Zhu, Zijing Zhao, Hui Jin, Qingxiao Guo, Yilong Ma, Yunhao Wang, Xiaobing Guo, Weifeng Zhang
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.02882
• Pdf URL: https://arxiv.org/pdf/2603.02882
• Copy Paste: [[2603.02882]] SIGMark: Scalable In-Generation Watermark with Blind Extraction for Video Diffusion(https://arxiv.org/abs/2603.02882)
• Keywords: generation
• Abstract: Artificial Intelligence Generated Content (AIGC), particularly video generation with diffusion models, has been advanced rapidly. Invisible watermarking is a key technology for protecting AI-generated videos and tracing harmful content, and thus plays a crucial role in AI safety. Beyond post-processing watermarks which inevitably degrade video quality, recent studies have proposed distortion-free in-generation watermarking for video diffusion models. However, existing in-generation approaches are non-blind: they require maintaining all the message-key pairs and performing template-based matching during extraction, which incurs prohibitive computational costs at scale. Moreover, when applied to modern video diffusion models with causal 3D Variational Autoencoders (VAEs), their robustness against temporal disturbance becomes extremely weak. To overcome these challenges, we propose SIGMark, a Scalable In-Generation watermarking framework with blind extraction for video diffusion. To achieve blind-extraction, we propose to generate watermarked initial noise using a Global set of Frame-wise PseudoRandom Coding keys (GF-PRC), reducing the cost of storing large-scale information while preserving noise distribution and diversity for distortion-free watermarking. To enhance robustness, we further design a Segment Group-Ordering module (SGO) tailored to causal 3D VAEs, ensuring robust watermark inversion during extraction under temporal disturbance. Comprehensive experiments on modern diffusion models show that SIGMark achieves very high bit-accuracy during extraction under both temporal and spatial disturbances with minimal overhead, demonstrating its scalability and robustness. Our project is available at this https URL.
• 摘要：人工智能生成内容（AIGC），特别是具有扩散模型的视频生成，已经迅速发展。隐形水印是保护人工智能生成的视频和追踪有害内容的关键技术，在人工智能安全中发挥着至关重要的作用。除了不可避免地降低视频质量的后处理水印之外，最近的研究还提出了针对视频扩散模型的无失真代内水印。然而，现有的代内方法是非盲目的：它们需要维护所有消息密钥对并在提取过程中执行基于模板的匹配，这会导致大规模的计算成本过高。此外，当应用于具有因果 3D 变分自动编码器 (VAE) 的现代视频扩散模型时，它们对时间干扰的鲁棒性变得非常弱。为了克服这些挑战，我们提出了 SIGMark，这是一种可扩展的一代水印框架，具有视频扩散盲提取功能。为了实现盲提取，我们建议使用全局逐帧伪随机编码密钥（GF-PRC）集生成带水印的初始噪声，从而降低存储大规模信息的成本，同时保留噪声分布和无失真水印的多样性。为了增强鲁棒性，我们进一步设计了一个针对因果 3D VAE 定制的分段组排序模块（SGO），确保在时间扰动下的提取过程中实现鲁棒的水印反演。对现代扩散模型的综合实验表明，SIGMark 在时间和空间干扰下的提取过程中以最小的开销实现了非常高的位精度，证明了其可扩展性和鲁棒性。我们的项目可以通过此 https URL 获取。

Title: SemanticDialect: Semantic-Aware Mixed-Format Quantization for Video Diffusion Transformers

• Authors: Wonsuk Jang, Thierry Tambe
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.02883
• Pdf URL: https://arxiv.org/pdf/2603.02883
• Copy Paste: [[2603.02883]] SemanticDialect: Semantic-Aware Mixed-Format Quantization for Video Diffusion Transformers(https://arxiv.org/abs/2603.02883)
• Keywords: generation
• Abstract: Diffusion Transformers (DiT) achieve strong video generation quality, but their memory and compute costs hinder edge deployment. Quantization can reduce these costs, yet existing methods often degrade video quality under high activation variation and the need to preserve semantic/temporal coherence. We propose SemanticDialect, which advances recent block-wise mixed-format quantization-selecting a per-block optimal format (a dialect) from multiple candidates (a formatbook)-by scaling the formatbook with lookup tables for quantization error and quantized values, enabling efficient per-block format selection and quantization at low online cost. We also introduce activation decomposition that reduces quantization error by re-quantizing and adding back residual errors, with attention-guided salient token selection. We further propose semantic-aware dialect assignment (SeDA) to improve quantized value consistency by sharing a sub-formatbook among semantically correlated tokens. Experiments on video DiT (VDiT) models show that SemanticDialect outperforms prior VDiT quantization methods and fine-grained block-wise format baselines, while approaching FP16 quality on Open-Sora 2.0.
• 摘要：扩散变压器 (DiT) 实现了强大的视频生成质量，但其内存和计算成本阻碍了边缘部署。量化可以降低这些成本，但现有方法通常会在高激活变化和需要保持语义/时间一致性的情况下降低视频质量。我们提出了 SemanticDialect，它推进了最近的逐块混合格式量化——从多个候选（格式簿）中选择每块最佳格式（一种方言）——通过使用量化误差和量化值的查找表来缩放格式簿，从而以较低的在线成本实现高效的每块格式选择和量化。我们还引入了激活分解，通过重新量化和添加残余误差来减少量化误差，并采用注意力引导的显着标记选择。我们进一步提出语义感知方言分配（SeDA），通过在语义相关的标记之间共享子格式手册来提高量化值的一致性。视频 DiT (VDiT) 模型的实验表明，SemanticDialect 的性能优于之前的 VDiT 量化方法和细粒度块格式基线，同时接近 Open-Sora 2.0 上的 FP16 质量。

Title: ProGIC: Progressive and Lightweight Generative Image Compression with Residual Vector Quantization

• Authors: Hao Cao, Chengbin Liang, Wenqi Guo, Zhijin Qin, Jungong Han
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.02897
• Pdf URL: https://arxiv.org/pdf/2603.02897
• Copy Paste: [[2603.02897]] ProGIC: Progressive and Lightweight Generative Image Compression with Residual Vector Quantization(https://arxiv.org/abs/2603.02897)
• Keywords: generative
• Abstract: Recent advances in generative image compression (GIC) have delivered remarkable improvements in perceptual quality. However, many GICs rely on large-scale and rigid models, which severely constrain their utility for flexible transmission and practical deployment in low-bitrate scenarios. To address these issues, we propose Progressive Generative Image Compression (ProGIC), a compact codec built on residual vector quantization (RVQ). In RVQ, a sequence of vector quantizers encodes the residuals stage by stage, each with its own codebook. The resulting codewords sum to a coarse-to-fine reconstruction and a progressive bitstream, enabling previews from partial data. We pair this with a lightweight backbone based on depthwise-separable convolutions and small attention blocks, enabling practical deployment on both GPUs and CPU-only devices. Experimental results show that ProGIC attains comparable compression performance compared with previous methods. It achieves bitrate savings of up to 57.57% on DISTS and 58.83% on LPIPS compared to MS-ILLM on the Kodak dataset. Beyond perceptual quality, ProGIC enables progressive transmission for flexibility, and also delivers over 10 times faster encoding and decoding compared with MS-ILLM on GPUs for efficiency.
• 摘要：生成图像压缩（GIC）的最新进展显着提高了感知质量。然而，许多GIC依赖于大规模且僵化的模型，这严重限制了其在低码率场景下的灵活传输和实际部署。为了解决这些问题，我们提出了渐进生成图像压缩（ProGIC），这是一种基于残差矢量量化（RVQ）的紧凑编解码器。在 RVQ 中，一系列矢量量化器对残差进行逐级编码，每个矢量量化器都有自己的码本。生成的码字求和为从粗到细的重建和渐进比特流，从而可以从部分数据进行预览。我们将其与基于深度可分离卷积和小注意力块的轻量级主干配对，从而实现在 GPU 和仅 CPU 设备上的实际部署。实验结果表明，与之前的方法相比，ProGIC 获得了相当的压缩性能。与柯达数据集上的 MS-ILLM 相比，它在 DISTS 上实现了高达 57.57% 的比特率节省，在 LPIPS 上实现了 58.83% 的比特率节省。除了感知质量之外，ProGIC 还支持渐进式传输以实现灵活性，并且与 GPU 上的 MS-ILLM 相比，编码和解码速度快 10 倍以上，以提高效率。

Title: Eliciting Numerical Predictive Distributions of LLMs Without Autoregression

• Authors: Julianna Piskorz, Katarzyna Kobalczyk, Mihaela van der Schaar
• Subjects: cs.LG, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.02913
• Pdf URL: https://arxiv.org/pdf/2603.02913
• Copy Paste: [[2603.02913]] Eliciting Numerical Predictive Distributions of LLMs Without Autoregression(https://arxiv.org/abs/2603.02913)
• Keywords: generation
• Abstract: Large Language Models (LLMs) have recently been successfully applied to regression tasks -- such as time series forecasting and tabular prediction -- by leveraging their in-context learning abilities. However, their autoregressive decoding process may be ill-suited to continuous-valued outputs, where obtaining predictive distributions over numerical targets requires repeated sampling, leading to high computational cost and inference time. In this work, we investigate whether distributional properties of LLM predictions can be recovered without explicit autoregressive generation. To this end, we study a set of regression probes trained to predict statistical functionals (e.g., mean, median, quantiles) of the LLM's numerical output distribution directly from its internal representations. Our results suggest that LLM embeddings carry informative signals about summary statistics of their predictive distributions, including the numerical uncertainty. This investigation opens up new questions about how LLMs internally encode uncertainty in numerical tasks, and about the feasibility of lightweight alternatives to sampling-based approaches for uncertainty-aware numerical predictions.
• 摘要：最近，大型语言模型 (LLM) 通过利用其上下文学习能力，成功应用于回归任务，例如时间序列预测和表格预测。然而，它们的自回归解码过程可能不适合连续值输出，其中获得数值目标的预测分布需要重复采样，从而导致较高的计算成本和推理时间。在这项工作中，我们研究了是否可以在没有显式自回归生成的情况下恢复 LLM 预测的分布特性。为此，我们研究了一组经过训练的回归探针，用于直接从其内部表示预测法学硕士数值输出分布的统计函数（例如平均值、中位数、分位数）。我们的结果表明，LLM 嵌入携带有关其预测分布的汇总统计信息的信息信号，包括数值不确定性。这项研究提出了新的问题，即法学硕士如何在数值任务中内部编码不确定性，以及基于采样的方法的轻量级替代方案用于不确定性感知数值预测的可行性。

Title: TRACE: Task-Adaptive Reasoning and Representation Learning for Universal Multimodal Retrieval

• Authors: Xiangzhao Hao, Shijie Wang, Tianyu Yang, Tianyue Wang, Haiyun Guo, JinQiao Wang
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.02929
• Pdf URL: https://arxiv.org/pdf/2603.02929
• Copy Paste: [[2603.02929]] TRACE: Task-Adaptive Reasoning and Representation Learning for Universal Multimodal Retrieval(https://arxiv.org/abs/2603.02929)
• Keywords: generative
• Abstract: Universal Multimodal Retrieval requires unified embedding models capable of interpreting diverse user intents, ranging from simple keywords to complex compositional instructions. While Multimodal Large Language Models (MLLMs) possess strong reasoning capabilities, prevailing adaptations confine them to static encoders, underutilizing their generative potential. This encoder-only paradigm struggles with complex intents that demand logical deduction rather than superficial pattern matching. To address this, we introduce TRACE (Task-adaptive Reasoning And Compressing Embeddings). TRACE unifies generative reasoning with discriminative representation learning. It first generates a structured Chain-of-Thought (CoT) to explicitly reason about the query, and subsequently compresses this reasoning trace into a compact embedding via a dedicated token. To train this framework, we construct M-BEIR-CoT, a large-scale dataset featuring a difficulty-aware routing strategy. Experiments on the M-BEIR benchmark establish TRACE as the new state-of-the-art. Crucially, TRACE demonstrates a learned implicit routing behavior. It autonomously activates reasoning for complex queries while bypassing it for simpler ones, achieving an optimal balance between retrieval accuracy and inference throughput. Furthermore, by internalizing the deductive process, TRACE exhibits remarkable zero-shot transferability to unseen domains and novel constraints.
• 摘要：通用多模态检索需要能够解释不同用户意图的统一嵌入模型，从简单的关键字到复杂的组合指令。虽然多模态大语言模型（MLLM）具有强大的推理能力，但普遍的改编将它们限制在静态编码器中，没有充分利用它们的生成潜力。这种仅编码器的范例与复杂的意图作斗争，需要逻辑推导而不是表面的模式匹配。为了解决这个问题，我们引入了 TRACE（任务自适应推理和压缩嵌入）。 TRACE 将生成推理与判别表征学习结合起来。它首先生成一个结构化的思想链（CoT）来显式地推理查询，然后通过专用令牌将该推理轨迹压缩为紧凑的嵌入。为了训练这个框架，我们构建了 M-BEIR-CoT，一个具有难度感知路由策略的大型数据集。 M-BEIR 基准测试将 TRACE 确立为新的最先进技术。至关重要的是，TRACE 展示了学习的隐式路由行为。它自动激活复杂查询的推理，同时绕过简单查询的推理，从而在检索准确性和推理吞吐量之间实现最佳平衡。此外，通过内化演绎过程，TRACE 表现出了对未见领域和新颖约束的卓越的零样本可迁移性。

Title: TC-Padé: Trajectory-Consistent Padé Approximation for Diffusion Acceleration

• Authors: Benlei Cui, Shaoxuan He, Bukun Huang, Zhizeng Ye, Yunyun Sun, Longtao Huang, Hui Xue, Yang Yang, Jingqun Tang, Zhou Zhao, Haiwen Hong
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.02943
• Pdf URL: https://arxiv.org/pdf/2603.02943
• Copy Paste: [[2603.02943]] TC-Padé: Trajectory-Consistent Padé Approximation for Diffusion Acceleration(https://arxiv.org/abs/2603.02943)
• Keywords: generation
• Abstract: Despite achieving state-of-the-art generation quality, diffusion models are hindered by the substantial computational burden of their iterative sampling process. While feature caching techniques achieve effective acceleration at higher step counts (e.g., 50 steps), they exhibit critical limitations in the practical low-step regime of 20-30 steps. As the interval between steps increases, polynomial-based extrapolators like TaylorSeer suffer from error accumulation and trajectory drift. Meanwhile, conventional caching strategies often overlook the distinct dynamical properties of different denoising phases. To address these challenges, we propose Trajectory-Consistent Padé approximation, a feature prediction framework grounded in Padé approximation. By modeling feature evolution through rational functions, our approach captures asymptotic and transitional behaviors more accurately than Taylor-based methods. To enable stable and trajectory-consistent sampling under reduced step counts, TC-Padé incorporates (1) adaptive coefficient modulation that leverages historical cached residuals to detect subtle trajectory transitions, and (2) step-aware prediction strategies tailored to the distinct dynamics of early, mid, and late sampling stages. Extensive experiments on DiT-XL/2, FLUX.1-dev, and Wan2.1 across both image and video generation demonstrate the effectiveness of TC-Padé. For instance, TC-Padé achieves 2.88x acceleration on FLUX.1-dev and 1.72x on Wan2.1 while maintaining high quality across FID, CLIP, Aesthetic, and VBench-2.0 metrics, substantially outperforming existing feature caching methods.
• 摘要：尽管实现了最先进的生成质量，但扩散模型仍因其迭代采样过程的大量计算负担而受到阻碍。虽然特征缓存技术在较高步数（例如 50 步）下实现了有效加速，但它们在 20-30 步的实际低步状态中表现出严重的局限性。随着步骤之间的间隔增加，像 TaylorSeer 这样基于多项式的外推器会遭受误差累积和轨迹漂移。同时，传统的缓存策略常常忽视不同去噪阶段的独特动态特性。为了应对这些挑战，我们提出了轨迹一致的 Padé 近似，这是一种基于 Padé 近似的特征预测框架。通过有理函数对特征演化进行建模，我们的方法比基于泰勒的方法更准确地捕获渐近和过渡行为。为了在减少步数的情况下实现稳定且轨迹一致的采样，TC-Padé 结合了 (1) 自适应系数调制，利用历史缓存残差来检测微妙的轨迹过渡，以及 (2) 针对早期、中期和晚期采样阶段的不同动态量身定制的步感知预测策略。在 DiT-XL/2、FLUX.1-dev 和 Wan2.1 上进行的图像和视频生成方面的大量实验证明了 TC-Padé 的有效性。例如，TC-Padé 在 FLUX.1-dev 上实现了 2.88 倍加速，在 Wan2.1 上实现了 1.72 倍加速，同时在 FID、CLIP、Aesthetic 和 VBench-2.0 指标上保持了高质量，大大优于现有的特征缓存方法。

Title: Integrating Homomorphic Encryption and Synthetic Data in FL for Privacy and Learning Quality

• Authors: Yenan Wang, Carla Fabiana Chiasserini, Elad Michael Schiller
• Subjects: cs.LG
• Abstract URL: https://arxiv.org/abs/2603.02969
• Pdf URL: https://arxiv.org/pdf/2603.02969
• Copy Paste: [[2603.02969]] Integrating Homomorphic Encryption and Synthetic Data in FL for Privacy and Learning Quality(https://arxiv.org/abs/2603.02969)
• Keywords: generation
• Abstract: Federated learning (FL) enables collaborative training of machine learning models without sharing sensitive client data, making it a cornerstone for privacy-critical applications. However, FL faces the dual challenge of ensuring learning quality and robust privacy protection while keeping resource consumption low, particularly when using computationally expensive techniques such as homomorphic encryption (HE). In this work, we enhance an FL process that preserves privacy using HE by integrating it with synthetic data generation and an interleaving strategy. Specifically, our solution, named Alternating Federated Learning (Alt-FL), consists of alternating between local training with authentic data (authentic rounds) and local training with synthetic data (synthetic rounds) and transferring the encrypted and plaintext model parameters on authentic and synthetic rounds (resp.). Our approach improves learning quality (e.g., model accuracy) through datasets enhanced with synthetic data, preserves client data privacy via HE, and keeps manageable encryption and decryption costs through our interleaving strategy. We evaluate our solution against data leakage attacks, such as the DLG attack, demonstrating robust privacy protection. Also, Alt-FL provides 13.4% higher model accuracy and decreases HE-related costs by up to 48% with respect to Selective HE.
• 摘要：联合学习 (FL) 支持机器学习模型的协作训练，而无需共享敏感的客户端数据，使其成为隐私关键型应用程序的基石。然而，FL 面临着双重挑战，即确保学习质量和强大的隐私保护，同时保持较低的资源消耗，特别是在使用同态加密 (HE) 等计算成本高昂的技术时。在这项工作中，我们通过将 HE 与合成数据生成和交错策略集成来增强 FL 过程，以保护隐私。具体来说，我们的解决方案名为交替联邦学习（Alt-FL），包括在使用真实数据（真实轮）的本地训练和使用合成数据（合成轮）的本地训练之间交替，并在真实轮和合成轮上传输加密和明文模型参数（分别）。我们的方法通过使用合成数据增强的数据集来提高学习质量（例如模型准确性），通过 HE 保护客户数据隐私，并通过我们的交错策略保持可管理的加密和解密成本。我们针对数据泄露攻击（例如 DLG 攻击）评估了我们的解决方案，展示了强大的隐私保护能力。此外，与选择性 HE 相比，Alt-FL 的模型精度提高了 13.4%，并将 HE 相关成本降低了 48%。

Title: Why Does RLAIF Work At All?

• Authors: Robin Young
• Subjects: cs.LG, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.03000
• Pdf URL: https://arxiv.org/pdf/2603.03000
• Copy Paste: [[2603.03000]] Why Does RLAIF Work At All?(https://arxiv.org/abs/2603.03000)
• Keywords: generation
• Abstract: Reinforcement Learning from AI Feedback (RLAIF) enables language models to improve by training on their own preference judgments, yet no theoretical account explains why this self-improvement seemingly works for value learning. We propose the latent value hypothesis, that pretraining on internet-scale data encodes human values as directions in representation space, and constitutional prompts elicit these latent values into preference judgments. We formalize this intuition under a linear model where the constitution acts as a projection operator selecting value-relevant directions. Our analysis yields several results. RLAIF improves alignment when the constitution-activated direction correlates with true values better than the model's default generation direction thus explaining the generation-judgment gap; the ceiling on RLAIF quality is determined by how well representations encode values, which scales with model capacity; and adversarial constitutions exist that can activate anti-social value directions encoded from harmful pretraining data. Our account unifies scattered empirical findings including the refusal direction, low-rank safety subspaces, and RLAIF scaling behavior.
• 摘要：AI 反馈强化学习 (RLAIF) 使语言模型能够通过训练自己的偏好判断来改进，但没有理论解释为什么这种自我改进似乎适用于价值学习。我们提出了潜在价值假设，即对互联网规模数据的预训练将人类价值观编码为表示空间中的方向，并且宪法提示将这些潜在价值引入偏好判断。我们在线性模型下形式化了这种直觉，其中宪法充当选择与值相关的方向的投影算子。我们的分析得出了几个结果。当体质激活方向与真实值的相关性优于模型默认生成方向时，RLAIF 会改善对齐，从而解释生成与判断之间的差距； RLAIF 质量的上限取决于表示对值的编码程度，这与模型容量成正比；并且存在对抗性宪法，可以激活从有害的预训练数据编码的反社会价值方向。我们的解释统一了分散的经验发现，包括拒绝方向、低等级安全子空间和 RLAIF 缩放行为。

Title: Breaking the Prototype Bias Loop: Confidence-Aware Federated Contrastive Learning for Highly Imbalanced Clients

• Authors: Tian-Shuang Wu, Shen-Huan Lyu, Ning Chen, Yi-Xiao He, Bing Tang, Baoliu Ye, Qingfu Zhang
• Subjects: cs.LG, cs.DC
• Abstract URL: https://arxiv.org/abs/2603.03007
• Pdf URL: https://arxiv.org/pdf/2603.03007
• Copy Paste: [[2603.03007]] Breaking the Prototype Bias Loop: Confidence-Aware Federated Contrastive Learning for Highly Imbalanced Clients(https://arxiv.org/abs/2603.03007)
• Keywords: generative
• Abstract: Local class imbalance and data heterogeneity across clients often trap prototype-based federated contrastive learning in a prototype bias loop: biased local prototypes induced by imbalanced data are aggregated into biased global prototypes, which are repeatedly reused as contrastive anchors, accumulating errors across communication rounds. To break this loop, we propose Confidence-Aware Federated Contrastive Learning (CAFedCL), a novel framework that improves the prototype aggregation mechanism and strengthens the contrastive alignment guided by prototypes. CAFedCL employs a confidence-aware aggregation mechanism that leverages predictive uncertainty to downweight high-variance local prototypes. In addition, generative augmentation for minority classes and geometric consistency regularization are integrated to stabilize the structure between classes. From a theoretical perspective, we provide an expectation-based analysis showing that our aggregation reduces estimation variance, thereby bounding global prototype drift and ensuring convergence. Extensive experiments under varying levels of class imbalance and data heterogeneity demonstrate that CAFedCL consistently outperforms representative federated baselines in both accuracy and client fairness.
• 摘要：客户端之间的本地类不平衡和数据异质性经常将基于原型的联合对比学习陷入原型偏差循环中：由不平衡数据引起的有偏差的本地原型被聚合成有偏差的全局原型，这些原型被重复重用为对比锚点，在通信轮次中积累错误。为了打破这个循环，我们提出了置信感知联合对比学习（CAFedCL），这是一种新颖的框架，可以改进原型聚合机制并加强原型引导的对比对齐。 CAFedCL 采用置信感知聚合机制，利用预测不确定性来降低高方差局部原型的权重。此外，集成了少数类的生成增强和几何一致性正则化，以稳定类之间的结构。从理论角度来看，我们提供了基于期望的分析，表明我们的聚合减少了估计方差，从而限制了全局原型漂移并确保收敛。在不同级别的类别不平衡和数据异质性下进行的广泛实验表明，CAFedCL 在准确性和客户公平性方面始终优于代表性联邦基线。

Title: Step-Level Sparse Autoencoder for Reasoning Process Interpretation

• Authors: Xuan Yang, Jiayu Liu, Yuhang Lai, Hao Xu, Zhenya Huang, Ning Miao
• Subjects: cs.LG
• Abstract URL: https://arxiv.org/abs/2603.03031
• Pdf URL: https://arxiv.org/pdf/2603.03031
• Copy Paste: [[2603.03031]] Step-Level Sparse Autoencoder for Reasoning Process Interpretation(https://arxiv.org/abs/2603.03031)
• Keywords: generation
• Abstract: Large Language Models (LLMs) have achieved strong complex reasoning capabilities through Chain-of-Thought (CoT) reasoning. However, their reasoning patterns remain too complicated to analyze. While Sparse Autoencoders (SAEs) have emerged as a powerful tool for interpretability, existing approaches predominantly operate at the token level, creating a granularity mismatch when capturing more critical step-level information, such as reasoning direction and semantic transitions. In this work, we propose step-level sparse autoencoder (SSAE), which serves as an analytical tool to disentangle different aspects of LLMs' reasoning steps into sparse features. Specifically, by precisely controlling the sparsity of a step feature conditioned on its context, we form an information bottleneck in step reconstruction, which splits incremental information from background information and disentangles it into several sparsely activated dimensions. Experiments on multiple base models and reasoning tasks show the effectiveness of the extracted features. By linear probing, we can easily predict surface-level information, such as generation length and first token distribution, as well as more complicated properties, such as the correctness and logicality of the step. These observations indicate that LLMs should already at least partly know about these properties during generation, which provides the foundation for the self-verification ability of LLMs. The code is available at this https URL
• 摘要：大型语言模型（LLM）通过思想链（CoT）推理实现了强大的复杂推理能力。然而，他们的推理模式仍然太复杂而难以分析。虽然稀疏自动编码器 (SAE) 已成为可解释性的强大工具，但现有方法主要在标记级别运行，在捕获更关键的步骤级别信息（例如推理方向和语义转换）时会造成粒度不匹配。在这项工作中，我们提出了步骤级稀疏自动编码器（SSAE），它作为一种分析工具，将 LLM 推理步骤的不同方面分解为稀疏特征。具体来说，通过精确控制以其上下文为条件的步骤特征的稀疏性，我们在步骤重建中形成了信息瓶颈，它将增量信息从背景信息中分离出来，并将其分解为几个稀疏激活的维度。多个基础模型和推理任务的实验表明了提取特征的有效性。通过线性探测，我们可以轻松预测表面级信息，例如生成长度和第一个令牌分布，以及更复杂的属性，例如步骤的正确性和逻辑性。这些观察表明，LLM 在生成过程中应该至少部分了解这些属性，这为 LLM 的自我验证能力提供了基础。该代码可在此 https URL 获取

Title: EduVQA: Benchmarking AI-Generated Video Quality Assessment for Education

• Authors: Baoliang Chen, Xinlong Bu, Lingyu Zhu, Hanwei Zhu, Xiangjie Sui
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.03066
• Pdf URL: https://arxiv.org/pdf/2603.03066
• Copy Paste: [[2603.03066]] EduVQA: Benchmarking AI-Generated Video Quality Assessment for Education(https://arxiv.org/abs/2603.03066)
• Keywords: quality assessment
• Abstract: While AI-generated content (AIGC) models have achieved remarkable success in generating photorealistic videos, their potential to support visual, story-driven learning in education remains largely untapped. To close this gap, we present EduAIGV-1k, the first benchmark dataset and evaluation framework dedicated to assessing the quality of AI-generated videos (AIGVs) designed to teach foundational math concepts, such as numbers and geometry, to young learners. EduAIGV-1k contains 1,130 short videos produced by ten state-of-the-art text-to-video (T2V) models using 113 pedagogy-oriented prompts. Each video is accompanied by rich, fine-grained annotations along two complementary axes: (1) Perceptual quality, disentangled into spatial and temporal fidelity, and (2) Prompt alignment, labeled at the word-level and sentence-level to quantify the degree to which each mathematical concept in the prompt is accurately grounded in the generated video. These fine-grained annotations transform each video into a multi-dimensional, interpretable supervision signal, far beyond a single quality score. Leveraging this dense feedback, we introduce EduVQA for both perceptual and alignment quality assessment of AIGVs. In particular, we propose a Structured 2D Mixture-of-Experts (S2D-MoE) module, which enhances the dependency between overall quality and each sub-dimension by shared experts and dynamic 2D gating matrix. Extensive experiments show our EduVQA consistently outperforms existing VQA baselines. Both our dataset and code will be publicly available.
• 摘要：虽然人工智能生成内容 (AIGC) 模型在生成逼真视频方面取得了显着成功，但它们在教育中支持视觉、故事驱动学习的潜力在很大程度上尚未开发。为了弥补这一差距，我们推出了 EduAIGV-1k，这是第一个基准数据集和评估框架，致力于评估人工智能生成视频 (AIGV) 的质量，旨在向年轻学习者教授数字和几何等基础数学概念。 EduAIGV-1k 包含 1,130 个短视频，由 10 个最先进的文本转视频 (T2V) 模型使用 113 个面向教学的提示制作。每个视频都沿着两个互补轴附有丰富、细粒度的注释：(1) 感知质量，分解为空间和时间保真度；(2) 提示对齐，在单词级别和句子级别进行标记，以量化提示中的每个数学概念在生成的视频中准确落地的程度。这些细粒度的注释将每个视频转换为多维、可解释的监督信号，远远超出了单一的质量分数。利用这种密集的反馈，我们引入了 EduVQA，用于 AIGV 的感知和对准质量评估。特别是，我们提出了结构化2D混合专家（S2D-MoE）模块，该模块通过共享专家和动态2D门控矩阵增强了整体质量与每个子维度之间的依赖性。大量实验表明，我们的 EduVQA 始终优于现有的 VQA 基线。我们的数据集和代码都将公开。

Title: AWDiff: An a trous wavelet diffusion model for lung ultrasound image synthesis

• Authors: Maryam Heidari (1), Nantheera Anantrasirichai (1), Steven Walker (2), Rahul Bhatnagar (2), Alin Achim (1) ((1) University of Bristol, UK, (2) Bristol Medical School, University of Bristol, UK)
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.03125
• Pdf URL: https://arxiv.org/pdf/2603.03125
• Copy Paste: [[2603.03125]] AWDiff: An a trous wavelet diffusion model for lung ultrasound image synthesis(https://arxiv.org/abs/2603.03125)
• Keywords: generative
• Abstract: Lung ultrasound (LUS) is a safe and portable imaging modality, but the scarcity of data limits the development of machine learning methods for image interpretation and disease monitoring. Existing generative augmentation methods, such as Generative Adversarial Networks (GANs) and diffusion models, often lose subtle diagnostic cues due to resolution reduction, particularly B-lines and pleural irregularities. We propose A trous Wavelet Diffusion (AWDiff), a diffusion based augmentation framework that integrates the a trous wavelet transform to preserve fine-scale structures while avoiding destructive downsampling. In addition, semantic conditioning with BioMedCLIP, a vision language foundation model trained on large scale biomedical corpora, enforces alignment with clinically meaningful labels. On a LUS dataset, AWDiff achieved lower distortion and higher perceptual quality compared to existing methods, demonstrating both structural fidelity and clinical diversity.
• 摘要：肺部超声（LUS）是一种安全且便携式的成像方式，但数据的稀缺限制了用于图像解释和疾病监测的机器学习方法的发展。现有的生成增强方法，例如生成对抗网络 (GAN) 和扩散模型，常常由于分辨率降低而丢失微妙的诊断线索，特别是 B 线和胸膜不规则。我们提出了 trous 小波扩散（AWDiff），这是一种基于扩散的增强框架，它集成了 trous 小波变换以保留精细尺度结构，同时避免破坏性下采样。此外，BioMedCLIP（一种在大规模生物医学语料库上训练的视觉语言基础模型）的语义调节可强制与临床有意义的标签保持一致。在 LUS 数据集上，与现有方法相比，AWDiff 实现了更低的失真和更高的感知质量，展示了结构保真度和临床多样性。

Title: Kling-MotionControl Technical Report

• Authors: Kling Team: Jialu Chen, Yikang Ding, Zhixue Fang, Kun Gai, Kang He, Xu He, Jingyun Hua, Mingming Lao, Xiaohan Li, Hui Liu, Jiwen Liu, Xiaoqiang Liu, Fan Shi, Xiaoyu Shi, Peiqin Sun, Songlin Tang, Pengfei Wan, Tiancheng Wen, Zhiyong Wu, Haoxian Zhang, Runze Zhao, Yuanxing Zhang, Yan Zhou
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.03160
• Pdf URL: https://arxiv.org/pdf/2603.03160
• Copy Paste: [[2603.03160]] Kling-MotionControl Technical Report(https://arxiv.org/abs/2603.03160)
• Keywords: generative
• Abstract: Character animation aims to generate lifelike videos by transferring motion dynamics from a driving video to a reference image. Recent strides in generative models have paved the way for high-fidelity character animation. In this work, we present Kling-MotionControl, a unified DiT-based framework engineered specifically for robust, precise, and expressive holistic character animation. Leveraging a divide-and-conquer strategy within a cohesive system, the model orchestrates heterogeneous motion representations tailored to the distinct characteristics of body, face, and hands, effectively reconciling large-scale structural stability with fine-grained articulatory expressiveness. To ensure robust cross-identity generalization, we incorporate adaptive identity-agnostic learning, facilitating natural motion retargeting for diverse characters ranging from realistic humans to stylized cartoons. Simultaneously, we guarantee faithful appearance preservation through meticulous identity injection and fusion designs, further supported by a subject library mechanism that leverages comprehensive reference contexts. To ensure practical utility, we implement an advanced acceleration framework utilizing multi-stage distillation, boosting inference speed by over 10x. Kling-MotionControl distinguishes itself through intelligent semantic motion understanding and precise text responsiveness, allowing for flexible control beyond visual inputs. Human preference evaluations demonstrate that Kling-MotionControl delivers superior performance compared to leading commercial and open-source solutions, achieving exceptional fidelity in holistic motion control, open domain generalization, and visual quality and coherence. These results establish Kling-MotionControl as a robust solution for high-quality, controllable, and lifelike character animation.
• 摘要：角色动画旨在通过将运动动态从驾驶视频传输到参考图像来生成逼真的视频。生成模型的最新进展为高保真角色动画铺平了道路。在这项工作中，我们提出了 Kling-MotionControl，这是一个基于 DiT 的统一框架，专为稳健、精确且富有表现力的整体角色动画而设计。该模型利用内聚系统内的分而治之策略，精心编排针对身体、面部和手的独特特征定制的异质运动表示，有效地协调大规模结构稳定性与细粒度的关节表现力。为了确保强大的跨身份泛化，我们结合了自适应身份不可知学习，促进从现实人类到程式化卡通等不同角色的自然运动重定向。同时，我们通过细致的身份注入和融合设计保证忠实的外观保留，并得到利用综合参考上下文的主题库机制的进一步支持。为了确保实用性，我们利用多级蒸馏实现了先进的加速框架，将推理速度提高了 10 倍以上。 Kling-MotionControl 通过智能语义运动理解和精确的文本响应能力而脱颖而出，允许超越视觉输入的灵活控制。人类偏好评估表明，与领先的商业和开源解决方案相比，Kling-MotionControl 提供了卓越的性能，在整体运动控制、开放域泛化以及视觉质量和一致性方面实现了卓越的保真度。这些结果使 Kling-MotionControl 成为高质量、可控且逼真的角色动画的强大解决方案。

Title: Conditioned Activation Transport for T2I Safety Steering

• Authors: Maciej Chrabąszcz, Aleksander Szymczyk, Jan Dubiński, Tomasz Trzciński, Franziska Boenisch, Adam Dziedzic
• Subjects: cs.CV, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.03163
• Pdf URL: https://arxiv.org/pdf/2603.03163
• Copy Paste: [[2603.03163]] Conditioned Activation Transport for T2I Safety Steering(https://arxiv.org/abs/2603.03163)
• Keywords: generation
• Abstract: Despite their impressive capabilities, current Text-to-Image (T2I) models remain prone to generating unsafe and toxic content. While activation steering offers a promising inference-time intervention, we observe that linear activation steering frequently degrades image quality when applied to benign prompts. To address this trade-off, we first construct SafeSteerDataset, a contrastive dataset containing 2300 safe and unsafe prompt pairs with high cosine similarity. Leveraging this data, we propose Conditioned Activation Transport (CAT), a framework that employs a geometry-based conditioning mechanism and nonlinear transport maps. By conditioning transport maps to activate only within unsafe activation regions, we minimize interference with benign queries. We validate our approach on two state-of-the-art architectures: Z-Image and Infinity. Experiments demonstrate that CAT generalizes effectively across these backbones, significantly reducing Attack Success Rate while maintaining image fidelity compared to unsteered generations. Warning: This paper contains potentially offensive text and images.
• 摘要：尽管其功能令人印象深刻，但当前的文本到图像 (T2I) 模型仍然容易生成不安全和有毒的内容。虽然激活转向提供了一种很有前景的推理时间干预，但我们观察到，当应用于良性提示时，线性激活转向经常会降低图像质量。为了解决这个问题，我们首先构建 SafeSteerDataset，这是一个对比数据集，包含 2300 个具有高余弦相似度的安全和不安全提示对。利用这些数据，我们提出了条件激活传输（CAT），这是一个采用基于几何的条件机制和非线性传输图的框架。通过将传输映射限制为仅在不安全的激活区域内激活，我们可以最大限度地减少对良性查询的干扰。我们在两种最先进的架构上验证了我们的方法：Z-Image 和 Infinity。实验表明，CAT 可以有效地跨这些主干网进行泛化，与未引导的一代相比，显着降低攻击成功率，同时保持图像保真度。警告：本文包含可能令人反感的文本和图像。

Title: Understanding and Mitigating Dataset Corruption in LLM Steering

• Authors: Cullen Anderson, Narmeen Oozeer, Foad Namjoo, Remy Ogasawara, Amirali Abdullah, Jeff M. Phillips
• Subjects: cs.LG, cs.AI, cs.CL
• Abstract URL: https://arxiv.org/abs/2603.03206
• Pdf URL: https://arxiv.org/pdf/2603.03206
• Copy Paste: [[2603.03206]] Understanding and Mitigating Dataset Corruption in LLM Steering(https://arxiv.org/abs/2603.03206)
• Keywords: generative
• Abstract: Contrastive steering has been shown as a simple and effective method to adjust the generative behavior of LLMs at inference time. It uses examples of prompt responses with and without a trait to identify a direction in an intermediate activation layer, and then shifts activations in this 1-dimensional subspace. However, despite its growing use in AI safety applications, the robustness of contrastive steering to noisy or adversarial data corruption is poorly understood. We initiate a study of the robustness of this process with respect to corruption of the dataset of examples used to train the steering direction. Our first observation is that contrastive steering is quite robust to a moderate amount of corruption, but unwanted side effects can be clearly and maliciously manifested when a non-trivial fraction of the training data is altered. Second, we analyze the geometry of various types of corruption, and identify some safeguards. Notably, a key step in learning the steering direction involves high-dimensional mean computation, and we show that replacing this step with a recently developed robust mean estimator often mitigates most of the unwanted effects of malicious corruption.
• 摘要：对比转向已被证明是一种简单而有效的方法来调整 LLM 在推理时的生成行为。它使用带有和不带有特征的提示响应示例来识别中间激活层中的方向，然后在该一维子空间中移动激活。然而，尽管它在人工智能安全应用中的使用越来越多，但对比转向对噪声或对抗性数据损坏的鲁棒性却知之甚少。我们开始研究该过程对于用于训练转向方向的示例数据集的损坏的鲁棒性。我们的第一个观察结果是，对比转向对于中等程度的损坏非常稳健，但是当训练数据的重要部分被更改时，不需要的副作用可能会明显且恶意地表现出来。其次，我们分析了各种类型腐败的几何形状，并确定了一些保障措施。值得注意的是，学习转向方向的关键步骤涉及高维均值计算，并且我们表明，用最近开发的稳健均值估计器替换此步骤通常可以减轻恶意损坏的大部分不良影响。

Title: Inverse Reconstruction of Shock Time Series from Shock Response Spectrum Curves using Machine Learning

• Authors: Adam Watts (1), Andrew Jeon (1), Destry Newton (1), Ryan Bowering (2) ((1) Los Alamos National Laboratory, (2) University of Rochester)
• Subjects: cs.LG, eess.SP
• Abstract URL: https://arxiv.org/abs/2603.03229
• Pdf URL: https://arxiv.org/pdf/2603.03229
• Copy Paste: [[2603.03229]] Inverse Reconstruction of Shock Time Series from Shock Response Spectrum Curves using Machine Learning(https://arxiv.org/abs/2603.03229)
• Keywords: generative
• Abstract: The shock response spectrum (SRS) is widely used to characterize the response of single-degree-of-freedom (SDOF) systems to transient accelerations. Because the mapping from acceleration time history to SRS is nonlinear and many-to-one, reconstructing time-domain signals from a target spectrum is inherently ill-posed. Conventional approaches address this problem through iterative optimization, typically representing signals as sums of exponentially decayed sinusoids, but these methods are computationally expensive and constrained by predefined basis functions. We propose a conditional variational autoencoder (CVAE) that learns a data-driven inverse mapping from SRS to acceleration time series. Once trained, the model generates signals consistent with prescribed target spectra without requiring iterative optimization. Experiments demonstrate improved spectral fidelity relative to classical techniques, strong generalization to unseen spectra, and inference speeds three to six orders of magnitude faster. These results establish deep generative modeling as a scalable and efficient approach for inverse SRS reconstruction.
• 摘要：冲击响应谱 (SRS) 广泛用于表征单自由度 (SDOF) 系统对瞬态加速度的响应。由于从加速度时程到 SRS 的映射是非线性且多对一的，因此从目标频谱重建时域信号本质上是不适定的。传统方法通过迭代优化来解决这个问题，通常将信号表示为指数衰减正弦曲线的总和，但这些方法的计算成本很高，并且受到预定义基函数的限制。我们提出了一种条件变分自动编码器（CVAE），它学习从 SRS 到加速时间序列的数据驱动的逆映射。经过训练后，模型会生成与规定目标光谱一致的信号，无需迭代优化。实验证明，相对于经典技术，光谱保真度有所提高，对未见过的光谱具有很强的泛化能力，推理速度快了三到六个数量级。这些结果将深度生成模型确立为逆 SRS 重建的可扩展且高效的方法。

Title: COP-GEN: Latent Diffusion Transformer for Copernicus Earth Observation Data -- Generation Stochastic by Design

• Authors: Miguel Espinosa, Eva Gmelich Meijling, Valerio Marsocci, Elliot J. Crowley, Mikolaj Czerkawski
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.03239
• Pdf URL: https://arxiv.org/pdf/2603.03239
• Copy Paste: [[2603.03239]] COP-GEN: Latent Diffusion Transformer for Copernicus Earth Observation Data -- Generation Stochastic by Design(https://arxiv.org/abs/2603.03239)
• Keywords: generation, generative
• Abstract: Earth observation applications increasingly rely on data from multiple sensors, including optical, radar, elevation, and land-cover products. Relationships between these modalities are fundamental for data integration but are inherently non-injective: identical conditioning information can correspond to multiple physically plausible observations. Thus, such conditional mappings should be parametrised as data distributions. As a result, deterministic models tend to collapse toward conditional means and fail to represent the uncertainty and variability required for tasks such as data completion and cross-sensor translation. We introduce COP-GEN, a multimodal latent diffusion transformer that models the joint distribution of heterogeneous Earth Observation modalities at their native spatial resolutions. By parameterising cross-modal mappings as conditional distributions, COP-GEN enables flexible any-to-any conditional generation, including zero-shot modality translation, spectral band infilling, and generation under partial or missing inputs, without task-specific retraining. Experiments on a large-scale global multimodal dataset show that COP-GEN generates diverse yet physically consistent realisations while maintaining strong peak fidelity across optical, radar, and elevation modalities. Qualitative and quantitative analyses demonstrate that the model captures meaningful cross-modal structure and systematically adapts its output uncertainty as conditioning information increases. These results highlight the practical importance of stochastic generative modeling for Earth observation and motivate evaluation protocols that move beyond single-reference, pointwise metrics. Website: https:// this http URL
• 摘要：地球观测应用越来越依赖来自多个传感器的数据，包括光学、雷达、高程和土地覆盖产品。这些模式之间的关系是数据集成的基础，但本质上是非内射的：相同的条件信息可以对应于多个物理上合理的观察结果。因此，这种条件映射应该被参数化为数据分布。因此，确定性模型往往会向条件手段崩溃，无法表示数据完成和跨传感器翻译等任务所需的不确定性和可变性。我们引入了 COP-GEN，一种多模态潜在扩散变换器，它可以模拟异构地球观测模态在其原始空间分辨率下的联合分布。通过将跨模态映射参数化为条件分布，COP-GEN 可以实现灵活的任意条件生成，包括零样本模态转换、谱带填充以及部分或缺失输入下的生成，而无需特定于任务的再训练。在大规模全球多模态数据集上进行的实验表明，COP-GEN 生成了多样化但物理上一致的实现，同时在光学、雷达和高程模态上保持了强大的峰值保真度。定性和定量分析表明，该模型捕获了有意义的跨模式结构，并随着调节信息的增加系统地调整其输出不确定性。这些结果凸显了随机生成模型对地球观测的实际重要性，并激发了超越单参考逐点指标的评估协议。网站：https://这个http URL

Title: UniG2U-Bench: Do Unified Models Advance Multimodal Understanding?

• Authors: Zimo Wen, Boxiu Li, Wanbo Zhang, Junxiang Lei, Xiaoyu Chen, Yijia Fan, Qi Zhang, Yujiang Wang, Lili Qiu, Bo Li, Ziwei Liu, Caihua Shan, Yifan Yang, Yifei Shen
• Subjects: cs.CV, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.03241
• Pdf URL: https://arxiv.org/pdf/2603.03241
• Copy Paste: [[2603.03241]] UniG2U-Bench: Do Unified Models Advance Multimodal Understanding?(https://arxiv.org/abs/2603.03241)
• Keywords: generation, generative
• Abstract: Unified multimodal models have recently demonstrated strong generative capabilities, yet whether and when generation improves understanding remains unclear. Existing benchmarks lack a systematic exploration of the specific tasks where generation facilitates understanding. To this end, we introduce UniG2U-Bench, a comprehensive benchmark categorizing generation-to-understanding (G2U) evaluation into 7 regimes and 30 subtasks, requiring varying degrees of implicit or explicit visual transformations. Extensive evaluation of over 30 models reveals three core findings: 1) Unified models generally underperform their base Vision-Language Models (VLMs), and Generate-then-Answer (GtA) inference typically degrades performance relative to direct inference. 2) Consistent enhancements emerge in spatial intelligence, visual illusions, or multi-round reasoning subtasks, where enhanced spatial and shape perception, as well as multi-step intermediate image states, prove beneficial. 3) Tasks with similar reasoning structures and models sharing architectures exhibit correlated behaviors, suggesting that generation-understanding coupling induces class-consistent inductive biases over tasks, pretraining data, and model architectures. These findings highlight the necessity for more diverse training data and novel paradigms to fully unlock the potential of unified multimodal modeling.
• 摘要：统一的多模态模型最近表现出了强大的生成能力，但生成是否以及何时提高理解仍不清楚。现有的基准缺乏对生成有助于理解的特定任务的系统探索。为此，我们引入了 UniG2U-Bench，这是一个综合基准测试，将生成到理解 (G2U) 评估分为 7 个体系和 30 个子任务，需要不同程度的隐式或显式视觉转换。对 30 多个模型的广泛评估揭示了三个核心发现：1）统一模型通常表现不佳其基础视觉语言模型（VLM），并且生成然后回答（GtA）推理相对于直接推理通常会降低性能。 2）在空间智能、视觉错觉或多轮推理子任务中出现一致的增强，其中增强的空间和形状感知以及多步骤中间图像状态被证明是有益的。 3）具有相似推理结构和模型共享架构的任务表现出相关行为，这表明生成理解耦合会在任务、预训练数据和模型架构上引起类一致的归纳偏差。这些发现强调了需要更多样化的训练数据和新颖的范例来充分释放统一多模态建模的潜力。

Title: DuoMo: Dual Motion Diffusion for World-Space Human Reconstruction

• Authors: Yufu Wang, Evonne Ng, Soyong Shin, Rawal Khirodkar, Yuan Dong, Zhaoen Su, Jinhyung Park, Kris Kitani, Alexander Richard, Fabian Prada, Michael Zollhofer
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.03265
• Pdf URL: https://arxiv.org/pdf/2603.03265
• Copy Paste: [[2603.03265]] DuoMo: Dual Motion Diffusion for World-Space Human Reconstruction(https://arxiv.org/abs/2603.03265)
• Keywords: generative
• Abstract: We present DuoMo, a generative method that recovers human motion in world-space coordinates from unconstrained videos with noisy or incomplete observations. Reconstructing such motion requires solving a fundamental trade-off: generalizing from diverse and noisy video inputs while maintaining global motion consistency. Our approach addresses this problem by factorizing motion learning into two diffusion models. The camera-space model first estimates motion from videos in camera coordinates. The world-space model then lifts this initial estimate into world coordinates and refines it to be globally consistent. Together, the two models can reconstruct motion across diverse scenes and trajectories, even from highly noisy or incomplete observations. Moreover, our formulation is general, generating the motion of mesh vertices directly and bypassing parametric models. DuoMo achieves state-of-the-art performance. On EMDB, our method obtains a 16% reduction in world-space reconstruction error while maintaining low foot skating. On RICH, it obtains a 30% reduction in world-space error. Project page: this https URL
• 摘要：我们提出了 DuoMo，一种生成方法，可以从带有噪声或不完整观察的无约束视频中恢复世界空间坐标中的人体运动。重建这种运动需要解决一个基本的权衡：从多样化和嘈杂的视频输入中进行概括，同时保持全局运动一致性。我们的方法通过将运动学习分解为两个扩散模型来解决这个问题。相机空间模型首先估计相机坐标中视频的运动。然后，世界空间模型将这个初始估计提升到世界坐标中，并将其细化为全局一致。这两个模型一起可以重建不同场景和轨迹的运动，即使是在高噪声或不完整的观察中也是如此。此外，我们的公式是通用的，直接生成网格顶点的运动并绕过参数模型。 DuoMo 实现了最先进的性能。在 EMDB 上，我们的方法在保持低脚滑行的同时，世界空间重建误差减少了 16%。在 RICH 上，它的世界空间误差降低了 30%。项目页面：此 https URL

Title: Learning Demographic-Conditioned Mobility Trajectories with Aggregate Supervision

• Authors: Jessie Z. Li, Zhiqing Hong, Toru Shirakawa, Serina Chang
• Subjects: cs.LG
• Abstract URL: https://arxiv.org/abs/2603.03275
• Pdf URL: https://arxiv.org/pdf/2603.03275
• Copy Paste: [[2603.03275]] Learning Demographic-Conditioned Mobility Trajectories with Aggregate Supervision(https://arxiv.org/abs/2603.03275)
• Keywords: generation
• Abstract: Human mobility trajectories are widely studied in public health and social science, where different demographic groups exhibit significantly different mobility patterns. However, existing trajectory generation models rarely capture this heterogeneity because most trajectory datasets lack demographic labels. To address this gap in data, we propose ATLAS, a weakly supervised approach for demographic-conditioned trajectory generation using only (i) individual trajectories without demographic labels, (ii) region-level aggregated mobility features, and (iii) region-level demographic compositions from census data. ATLAS trains a trajectory generator and fine-tunes it so that simulated mobility matches observed regional aggregates while conditioning on demographics. Experiments on real trajectory data with demographic labels show that ATLAS substantially improves demographic realism over baselines (JSD $\downarrow$ 12%--69%) and closes much of the gap to strongly supervised training. We further develop theoretical analyses for when and why ATLAS works, identifying key factors including demographic diversity across regions and the informativeness of the aggregate feature, paired with experiments demonstrating the practical implications of our theory. We release our code at this https URL.
• 摘要：人类流动轨迹在公共卫生和社会科学领域得到了广泛研究，其中不同的人口群体表现出显着不同的流动模式。然而，现有的轨迹生成模型很少捕获这种异质性，因为大多数轨迹数据集缺乏人口统计标签。为了解决这一数据差距，我们提出了 ATLAS，这是一种弱监督方法，用于生成人口条件轨迹，仅使用（i）没有人口标签的个人轨迹，（ii）区域级聚合流动性特征，以及（iii）来自人口普查数据的区域级人口构成。 ATLAS 训练轨迹生成器并对其进行微调，以便模拟的流动性与观察到的区域总量相匹配，同时根据人口统计数据进行调节。对具有人口统计标签的真实轨迹数据进行的实验表明，ATLAS 相对于基线（JSD $\downarrow$ 12%--69%）显着提高了人口统计现实性，并缩小了与强监督训练的大部分差距。我们进一步对 ATLAS 何时以及为何发挥作用进行了理论分析，确定了关键因素，包括跨地区的人口多样性和总体特征的信息量，并与证明我们理论的实际意义的实验相结合。我们在此 https URL 发布我们的代码。

Title: Beyond Language Modeling: An Exploration of Multimodal Pretraining

• Authors: Shengbang Tong, David Fan, John Nguyen, Ellis Brown, Gaoyue Zhou, Shengyi Qian, Boyang Zheng, Théophane Vallaeys, Junlin Han, Rob Fergus, Naila Murray, Marjan Ghazvininejad, Mike Lewis, Nicolas Ballas, Amir Bar, Michael Rabbat, Jakob Verbeek, Luke Zettlemoyer, Koustuv Sinha, Yann LeCun, Saining Xie
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.03276
• Pdf URL: https://arxiv.org/pdf/2603.03276
• Copy Paste: [[2603.03276]] Beyond Language Modeling: An Exploration of Multimodal Pretraining(https://arxiv.org/abs/2603.03276)
• Keywords: generation
• Abstract: The visual world offers a critical axis for advancing foundation models beyond language. Despite growing interest in this direction, the design space for native multimodal models remains opaque. We provide empirical clarity through controlled, from-scratch pretraining experiments, isolating the factors that govern multimodal pretraining without interference from language pretraining. We adopt the Transfusion framework, using next-token prediction for language and diffusion for vision, to train on diverse data including text, video, image-text pairs, and even action-conditioned video. Our experiments yield four key insights: (i) Representation Autoencoder (RAE) provides an optimal unified visual representation by excelling at both visual understanding and generation; (ii) visual and language data are complementary and yield synergy for downstream capabilities; (iii) unified multimodal pretraining leads naturally to world modeling, with capabilities emerging from general training; and (iv) Mixture-of-Experts (MoE) enables efficient and effective multimodal scaling while naturally inducing modality specialization. Through IsoFLOP analysis, we compute scaling laws for both modalities and uncover a scaling asymmetry: vision is significantly more data-hungry than language. We demonstrate that the MoE architecture harmonizes this scaling asymmetry by providing the high model capacity required by language while accommodating the data-intensive nature of vision, paving the way for truly unified multimodal models.
• 摘要：视觉世界为超越语言的基础模型提供了一个关键轴。尽管人们对这个方向越来越感兴趣，但原生多模式模型的设计空间仍然不透明。我们通过受控的、从头开始的预训练实验提供实证清晰度，隔离控制多模态预训练的因素，而不受语言预训练的干扰。我们采用 Transfusion 框架，使用语言的下一个标记预测和视觉的扩散来训练各种数据，包括文本、视频、图像文本对，甚至动作条件视频。我们的实验得出了四个关键见解：（i）表示自动编码器（RAE）通过擅长视觉理解和生成来提供最佳的统一视觉表示； (ii) 视觉和语言数据是互补的，可以为下游能力产生协同作用； (iii) 统一的多模式预训练自然会导致世界建模，并具有从一般训练中产生的能力； (iv) 专家混合 (MoE) 能够实现高效且有效的多模态扩展，同时自然地诱导模态专业化。通过 IsoFLOP 分析，我们计算了两种模态的缩放定律，并发现了缩放不对称性：视觉比语言更需要数据。我们证明，MoE 架构通过提供语言所需的高模型容量，同时适应视觉的数据密集型特性，协调了这种缩放不对称性，为真正统一的多模态模型铺平了道路。

Title: CFG-Ctrl: Control-Based Classifier-Free Diffusion Guidance

• Authors: Hanyang Wang, Yiyang Liu, Jiawei Chi, Fangfu Liu, Ran Xue, Yueqi Duan
• Subjects: cs.CV, cs.LG
• Abstract URL: https://arxiv.org/abs/2603.03281
• Pdf URL: https://arxiv.org/pdf/2603.03281
• Copy Paste: [[2603.03281]] CFG-Ctrl: Control-Based Classifier-Free Diffusion Guidance(https://arxiv.org/abs/2603.03281)
• Keywords: generation, generative
• Abstract: Classifier-Free Guidance (CFG) has emerged as a central approach for enhancing semantic alignment in flow-based diffusion models. In this paper, we explore a unified framework called CFG-Ctrl, which reinterprets CFG as a control applied to the first-order continuous-time generative flow, using the conditional-unconditional discrepancy as an error signal to adjust the velocity field. From this perspective, we summarize vanilla CFG as a proportional controller (P-control) with fixed gain, and typical follow-up variants develop extended control-law designs derived from it. However, existing methods mainly rely on linear control, inherently leading to instability, overshooting, and degraded semantic fidelity especially on large guidance scales. To address this, we introduce Sliding Mode Control CFG (SMC-CFG), which enforces the generative flow toward a rapidly convergent sliding manifold. Specifically, we define an exponential sliding mode surface over the semantic prediction error and introduce a switching control term to establish nonlinear feedback-guided correction. Moreover, we provide a Lyapunov stability analysis to theoretically support finite-time convergence. Experiments across text-to-image generation models including Stable Diffusion 3.5, Flux, and Qwen-Image demonstrate that SMC-CFG outperforms standard CFG in semantic alignment and enhances robustness across a wide range of guidance scales. Project Page: this https URL
• 摘要：无分类器指导（CFG）已成为增强基于流的扩散模型中语义对齐的核心方法。在本文中，我们探索了一个名为CFG-Ctrl的统一框架，它将CFG重新解释为应用于一阶连续时间生成流的控制，使用条件-无条件差异作为误差信号来调整速度场。从这个角度来看，我们将普通 CFG 总结为具有固定增益的比例控制器（P 控制），典型的后续变体开发了从中衍生的扩展控制律设计。然而，现有方法主要依赖于线性控制，本质上会导致不稳定、超调和语义保真度下降，尤其是在大制导尺度上。为了解决这个问题，我们引入了滑模控制 CFG (SMC-CFG)，它强制生成流向快速收敛的滑动流形。具体来说，我们在语义预测误差上定义指数滑模表面，并引入切换控制项来建立非线性反馈引导校正。此外，我们提供了李亚普诺夫稳定性分析，从理论上支持有限时间收敛。包括 Stable Diffusion 3.5、Flux 和 Qwen-Image 在内的文本到图像生成模型的实验表明，SMC-CFG 在语义对齐方面优于标准 CFG，并增强了各种指导尺度的鲁棒性。项目页面：此 https URL

Title: MIBURI: Towards Expressive Interactive Gesture Synthesis

• Authors: M. Hamza Mughal, Rishabh Dabral, Vera Demberg, Christian Theobalt
• Subjects: cs.CV, cs.GR, cs.HC
• Abstract URL: https://arxiv.org/abs/2603.03282
• Pdf URL: https://arxiv.org/pdf/2603.03282
• Copy Paste: [[2603.03282]] MIBURI: Towards Expressive Interactive Gesture Synthesis(https://arxiv.org/abs/2603.03282)
• Keywords: generative
• Abstract: Embodied Conversational Agents (ECAs) aim to emulate human face-to-face interaction through speech, gestures, and facial expressions. Current large language model (LLM)-based conversational agents lack embodiment and the expressive gestures essential for natural interaction. Existing solutions for ECAs often produce rigid, low-diversity motions, that are unsuitable for human-like interaction. Alternatively, generative methods for co-speech gesture synthesis yield natural body gestures but depend on future speech context and require long run-times. To bridge this gap, we present MIBURI, the first online, causal framework for generating expressive full-body gestures and facial expressions synchronized with real-time spoken dialogue. We employ body-part aware gesture codecs that encode hierarchical motion details into multi-level discrete tokens. These tokens are then autoregressively generated by a two-dimensional causal framework conditioned on LLM-based speech-text embeddings, modeling both temporal dynamics and part-level motion hierarchy in real time. Further, we introduce auxiliary objectives to encourage expressive and diverse gestures while preventing convergence to static poses. Comparative evaluations demonstrate that our causal and real-time approach produces natural and contextually aligned gestures against recent baselines. We urge the reader to explore demo videos on this https URL.
• 摘要：具身对话代理 (ECA) 旨在通过语音、手势和面部表情来模拟人类面对面的互动。当前基于大语言模型（LLM）的会话代理缺乏自然交互所必需的体现和表达手势。现有的 ECA 解决方案通常会产生僵化、低多样性的运动，不适合类人交互。或者，共同语音手势合成的生成方法可以产生自然的身体手势，但取决于未来的语音上下文，并且需要较长的运行时间。为了弥补这一差距，我们推出了 MIBURI，这是第一个在线因果框架，用于生成与实时语音对话同步的富有表现力的全身手势和面部表情。我们采用身体部位感知手势编解码器，将分层运动细节编码为多级离散标记。然后，这些标记由以基于 LLM 的语音文本嵌入为条件的二维因果框架自回归生成，实时建模时间动态和部分级运动层次结构。此外，我们引入了辅助目标来鼓励富有表现力和多样化的手势，同时防止收敛到静态姿势。比较评估表明，我们的因果和实时方法可以根据最近的基线产生自然且与上下文一致的手势。我们强烈建议读者浏览此 https URL 上的演示视频。