2026-03-26

Title: Synthetic Mixed Training: Scaling Parametric Knowledge Acquisition Beyond RAG

• Authors: Seungju Han, Konwoo Kim, Chanwoo Park, Benjamin Newman, Suhas Kotha, Jaehun Jung, James Zou, Yejin Choi
• Subjects: cs.LG, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.23562
• Pdf URL: https://arxiv.org/pdf/2603.23562
• Copy Paste: [[2603.23562]] Synthetic Mixed Training: Scaling Parametric Knowledge Acquisition Beyond RAG(https://arxiv.org/abs/2603.23562)
• Keywords: generation
• Abstract: Synthetic data augmentation helps language models learn new knowledge in data-constrained domains. However, naively scaling existing synthetic data methods by training on more synthetic tokens or using stronger generators yields diminishing returns below the performance of RAG. To break the RAG ceiling, we introduce Synthetic Mixed Training, which combines synthetic QAs and synthetic documents. This leverages their complementary training signals, and enables log-linear improvements as both synthetic data volume and generator strength increase. This allows the model to outperform RAG by a 2.6\% relative gain on QuaLITY, a long-document reading comprehension benchmark. In addition, we introduce Focal Rewriting, a simple technique for synthetic document generation that explicitly conditions document generation on specific questions, improving the diversity of synthetic documents and yielding a steeper log-linear scaling curve. On QuaLITY, our final recipe trains a Llama 8B model that outperforms RAG by 4.4\% relatively. Across models and benchmarks (QuaLITY, LongHealth, FinanceBench), our training enables models to beat RAG in five of six settings, outperforms by 2.6\%, and achieves a 9.1\% gain when combined with RAG.
• 摘要：合成数据增强有助于语言模型学习数据受限领域的新知识。然而，通过训练更多的合成令牌或使用更强的生成器来简单地扩展现有的合成数据方法，会产生低于 RAG 性能的收益递减。为了打破 RAG 上限，我们引入了综合混合训练，它结合了综合 QA 和综合文档。这利用了它们的互补训练信号，并随着合成数据量和生成器强度的增加而实现对数线性改进。这使得该模型在长文档阅读理解基准 QuaLITY 上的表现比 RAG 提高了 2.6%。此外，我们还引入了焦点重写（Focal Rewriting），这是一种用于合成文档生成的简单技术，它明确地根据特定问题生成文档，提高了合成文档的多样性并产生更陡峭的对数线性缩放曲线。在 QuaLITY 上，我们的最终配方训练了 Llama 8B 模型，其性能相对优于 RAG 4.4%。在模型和基准（QuaLITY、LongHealth、FinanceBench）中，我们的训练使模型能够在六种设置中的五种中击败 RAG，表现优于 2.6%，与 RAG 结合时实现 9.1% 的增益。

Title: PoiCGAN: A Targeted Poisoning Based on Feature-Label Joint Perturbation in Federated Learning

• Authors: Tao Liu, Jiguang Lv, Dapeng Man, Weiye Xi, Yaole Li, Feiyu Zhao, Kuiming Wang, Yingchao Bian, Chen Xu, Wu Yang
• Subjects: cs.LG, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.23574
• Pdf URL: https://arxiv.org/pdf/2603.23574
• Copy Paste: [[2603.23574]] PoiCGAN: A Targeted Poisoning Based on Feature-Label Joint Perturbation in Federated Learning(https://arxiv.org/abs/2603.23574)
• Keywords: generative
• Abstract: Federated Learning (FL), as a popular distributed learning paradigm, has shown outstanding performance in improving computational efficiency and protecting data privacy, and is widely applied in industrial image classification. However, due to its distributed nature, FL is vulnerable to threats from malicious clients, with poisoning attacks being a common threat. A major limitation of existing poisoning attack methods is their difficulty in bypassing model performance tests and defense mechanisms based on model anomaly detection. This often results in the detection and removal of poisoned models, which undermines their practical utility. To ensure both the performance of industrial image classification and attacks, we propose a targeted poisoning attack, PoiCGAN, based on feature-label collaborative perturbation. Our method modifies the inputs of the discriminator and generator in the Conditional Generative Adversarial Network (CGAN) to influence the training process, generating an ideal poison generator. This generator not only produces specific poisoned samples but also automatically performs label flipping. Experiments across various datasets show that our method achieves an attack success rate 83.97% higher than baseline methods, with a less than 8.87% reduction in the main task's accuracy. Moreover, the poisoned samples and malicious models exhibit high stealthiness.
• 摘要：联邦学习（FL）作为一种流行的分布式学习范式，在提高计算效率和保护数据隐私方面表现出出色的性能，在工业图像分类中得到广泛应用。然而，由于其分布式特性，FL 很容易受到恶意客户端的威胁，其中中毒攻击是常见的威胁。现有投毒攻击方法的一个主要限制是它们难以绕过模型性能测试和基于模型异常检测的防御机制。这通常会导致检测和删除中毒模型，从而损害了它们的实用性。为了保证工业图像分类和攻击的性能，我们提出了一种基于特征标签协同扰动的针对性中毒攻击PoiCGAN。我们的方法修改条件生成对抗网络（CGAN）中鉴别器和生成器的输入以影响训练过程，生成理想的毒物生成器。该生成器不仅可以生成特定的中毒样本，还可以自动执行标签翻转。在各种数据集上的实验表明，我们的方法的攻击成功率比基线方法高出 83.97%，而主要任务的准确率降低了不到 8.87%。此外，中毒样本和恶意模型具有很高的隐蔽性。

Title: APreQEL: Adaptive Mixed Precision Quantization For Edge LLMs

• Authors: Meriem Bouzouad, Yuan-Hao Chang, Jalil Boukhobza
• Subjects: cs.LG, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.23575
• Pdf URL: https://arxiv.org/pdf/2603.23575
• Copy Paste: [[2603.23575]] APreQEL: Adaptive Mixed Precision Quantization For Edge LLMs(https://arxiv.org/abs/2603.23575)
• Keywords: generation
• Abstract: Today, large language models have demonstrated their strengths in various tasks ranging from reasoning, code generation, and complex problem solving. However, this advancement comes with a high computational cost and memory requirements, making it challenging to deploy these models on edge devices to ensure real-time responses and data privacy. Quantization is one common approach to reducing memory use, but most methods apply it uniformly across all layers. This does not account for the fact that different layers may respond differently to reduced precision. Importantly, memory consumption and computational throughput are not necessarily aligned, further complicating deployment decisions. This paper proposes an adaptive mixed precision quantization mechanism that balances memory, latency, and accuracy in edge deployment under user-defined priorities. This is achieved by analyzing the layer-wise contribution and by inferring how different quantization types behave across the target hardware platform in order to assign the most suitable quantization type to each layer. This integration ensures that layer importance and the overall performance trade-offs are jointly respected in this design. Our work unlocks new configuration designs that uniform quantization cannot achieve, expanding the solution space to efficiently deploy the LLMs on resource-constrained devices.
• 摘要：如今，大型语言模型已经在推理、代码生成和复杂问题解决等各种任务中展示了自己的优势。然而，这种进步伴随着较高的计算成本和内存要求，使得在边缘设备上部署这些模型以确保实时响应和数据隐私变得具有挑战性。量化是减少内存使用的一种常见方法，但大多数方法在所有层上统一应用它。这没有考虑到不同层对精度降低的响应可能不同的事实。重要的是，内存消耗和计算吞吐量不一定一致，这使部署决策进一步复杂化。本文提出了一种自适应混合精度量化机制，可以在用户定义的优先级下平衡边缘部署中的内存、延迟和准确性。这是通过分析分层贡献并推断不同量化类型在目标硬件平台上的行为方式来实现的，以便为每一层分配最合适的量化类型。这种集成确保了设计中同时考虑了层的重要性和整体性能的权衡。我们的工作解锁了统一量化无法实现的新配置设计，扩展了解决方案空间，以便在资源受限的设备上高效部署 LLM。

Title: M3T: Discrete Multi-Modal Motion Tokens for Sign Language Production

• Authors: Alexandre Symeonidis-Herzig, Jianhe Low, Ozge Mercanoglu Sincan, Richard Bowden
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.23617
• Pdf URL: https://arxiv.org/pdf/2603.23617
• Copy Paste: [[2603.23617]] M3T: Discrete Multi-Modal Motion Tokens for Sign Language Production(https://arxiv.org/abs/2603.23617)
• Keywords: generation
• Abstract: Sign language production requires more than hand motion generation. Non-manual features, including mouthings, eyebrow raises, gaze, and head movements, are grammatically obligatory and cannot be recovered from manual articulators alone. Existing 3D production systems face two barriers to integrating them: the standard body model provides a facial space too low-dimensional to encode these articulations, and when richer representations are adopted, standard discrete tokenization suffers from codebook collapse, leaving most of the expression space unreachable. We propose SMPL-FX, which couples FLAME's rich expression space with the SMPL-X body, and tokenize the resulting representation with modality-specific Finite Scalar Quantization VAEs for body, hands, and face. M3T is an autoregressive transformer trained on this multi-modal motion vocabulary, with an auxiliary translation objective that encourages semantically grounded embeddings. Across three standard benchmarks (How2Sign, CSL-Daily, Phoenix14T) M3T achieves state-of-the-art sign language production quality, and on NMFs-CSL, where signs are distinguishable only by non-manual features, reaches 58.3% accuracy against 49.0% for the strongest comparable pose baseline.
• 摘要：手语制作需要的不仅仅是手势生成。非手动特征，包括嘴巴、眉毛抬起、凝视和头部运动，在语法上是强制性的，不能仅通过手动咬合器来恢复。现有的 3D 制作系统在集成它们时面临两个障碍：标准身体模型提供的面部空间维度太低，无法对这些关节进行编码，而当采用更丰富的表示时，标准离散标记化会遭受密码本崩溃的影响，导致大部分表达空间无法访问。我们提出了 SMPL-FX，它将 FLAME 丰富的表达空间与 SMPL-X 身体结合起来，并使用针对身体、手和面部的特定模态有限标量量化 VAE 对所得表示进行标记。 M3T 是一种在多模态运动词汇上进行训练的自回归转换器，具有鼓励基于语义的嵌入的辅助翻译目标。在三个标准基准（How2Sign、CSL-Daily、Phoenix14T）中，M3T 实现了最先进的手语制作质量，而在 NMFs-CSL 上（仅通过非手动特征才能区分手势），准确率达到 58.3%，而最强可比姿势基线的准确度为 49.0%。

Title: Steering Code LLMs with Activation Directions for Language and Library Control

• Authors: Md Mahbubur Rahman, Arjun Guha, Harshitha Menon
• Subjects: cs.LG
• Abstract URL: https://arxiv.org/abs/2603.23629
• Pdf URL: https://arxiv.org/pdf/2603.23629
• Copy Paste: [[2603.23629]] Steering Code LLMs with Activation Directions for Language and Library Control(https://arxiv.org/abs/2603.23629)
• Keywords: generation
• Abstract: Code LLMs often default to particular programming languages and libraries under neutral prompts. We investigate whether these preferences are encoded as approximately linear directions in activation space that can be manipulated at inference time. Using a difference-in-means method, we estimate layer-wise steering vectors for five language/library pairs and add them to model hidden states during generation. Across three open-weight code LLMs, these interventions substantially increase generation toward the target ecosystem under neutral prompts and often remain effective even when prompts explicitly request the opposite choice. Steering strength varies by model and target, with common ecosystems easier to induce than rarer alternatives, and overly strong interventions can reduce output quality. Overall, our results suggest that code-style preferences in LLMs are partly represented by compact, steerable structure in activation space.
• 摘要：代码法学硕士通常会在中性提示下默认使用特定的编程语言和库。我们研究这些偏好是否被编码为激活空间中可以在推理时操纵的近似线性方向。使用均值差异方法，我们估计五个语言/库对的分层转向向量，并将它们添加到生成过程中的模型隐藏状态中。在三个开放权重代码法学硕士中，这些干预措施在中性提示下大大增加了目标生态系统的生成，并且即使提示明确要求相反的选择，通常仍然有效。指导力度因模型和目标而异，常见的生态系统比稀有的替代方案更容易诱导，而过度强烈的干预可能会降低产出质量。总的来说，我们的结果表明法学硕士中的代码风格偏好部分由激活空间中紧凑的、可操纵的结构表示。

Title: λSplit: Self-Supervised Content-Aware Spectral Unmixing for Fluorescence Microscopy

• Authors: Federico Carrara, Talley Lambert, Mehdi Seifi, Florian Jug
• Subjects: cs.CV, cs.AI, cs.LG
• Abstract URL: https://arxiv.org/abs/2603.23647
• Pdf URL: https://arxiv.org/pdf/2603.23647
• Copy Paste: [[2603.23647]] λSplit: Self-Supervised Content-Aware Spectral Unmixing for Fluorescence Microscopy(https://arxiv.org/abs/2603.23647)
• Keywords: generative
• Abstract: In fluorescence microscopy, spectral unmixing aims to recover individual fluorophore concentrations from spectral images that capture mixed fluorophore emissions. Since classical methods operate pixel-wise and rely on least-squares fitting, their performance degrades with increasingly overlapping emission spectra and higher levels of noise, suggesting that a data-driven approach that can learn and utilize a structural prior might lead to improved results. Learning-based approaches for spectral imaging do exist, but they are either not optimized for microscopy data or are developed for very specific cases that are not applicable to fluorescence microscopy settings. To address this, we propose {\lambda}Split, a physics-informed deep generative model that learns a conditional distribution over concentration maps using a hierarchical Variational Autoencoder. A fully differentiable Spectral Mixer enforces consistency with the image formation process, while the learned structural priors enable state-of-the-art unmixing and implicit noise removal. We demonstrate {\lambda}Split on 3 real-world datasets that we synthetically cast into a total of 66 challenging spectral unmixing benchmarks. We compare our results against a total of 10 baseline methods, including classical methods and a range of learning-based methods. Our results consistently show competitive performance and improved robustness in high noise regimes, when spectra overlap considerably, or when the spectral dimensionality is lowered, making {\lambda}Split a new state-of-the-art for spectral unmixing of fluorescent microscopy data. Importantly, {\lambda}Split is compatible with spectral data produced by standard confocal microscopes, enabling immediate adoption without specialized hardware modifications.
• 摘要：在荧光显微镜中，光谱分解的目的是从捕获混合荧光团发射的光谱图像中恢复单个荧光团浓度。由于经典方法以像素为单位进行操作并依赖于最小二乘拟合，因此它们的性能随着发射光谱的重叠和噪声水平的增加而降低，这表明可以学习和利用结构先验的数据驱动方法可能会带来改进的结果。基于学习的光谱成像方法确实存在，但它们要么没有针对显微镜数据进行优化，要么是针对不适用于荧光显微镜设置的非常特定的情况而开发的。为了解决这个问题，我们提出了 {\lambda}Split，这是一种基于物理的深度生成模型，它使用分层变分自动编码器来学习浓度图上的条件分布。完全可微的光谱混合器增强了图像形成过程的一致性，而学习的结构先验则实现了最先进的解混合和隐式噪声消除。我们在 3 个真实数据集上演示了 {\lambda}Split，我们将这些数据集综合转化为总共 66 个具有挑战性的光谱分解基准。我们将我们的结果与总共 10 种基线方法进行比较，包括经典方法和一系列基于学习的方法。我们的结果始终显示出在高噪声情况下的竞争性能和改进的鲁棒性，当光谱大量重叠或光谱维数降低时，使得 {\lambda}Split 成为荧光显微镜数据光谱分离的新的最先进技术。重要的是，Split 与标准共焦显微镜产生的光谱数据兼容，无需专门修改硬件即可立即采用。

Title: CDMT-EHR: A Continuous-Time Diffusion Framework for Generating Mixed-Type Time-Series Electronic Health Records

• Authors: Shaonan Liu, Yuichiro Iwashita, Soichiro Nakako, Masakazu Iwamura, Koichi Kise
• Subjects: cs.LG, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.23719
• Pdf URL: https://arxiv.org/pdf/2603.23719
• Copy Paste: [[2603.23719]] CDMT-EHR: A Continuous-Time Diffusion Framework for Generating Mixed-Type Time-Series Electronic Health Records(https://arxiv.org/abs/2603.23719)
• Keywords: generation
• Abstract: Electronic health records (EHRs) are invaluable for clinical research, yet privacy concerns severely restrict data sharing. Synthetic data generation offers a promising solution, but EHRs present unique challenges: they contain both numerical and categorical features that evolve over time. While diffusion models have demonstrated strong performance in EHR synthesis, existing approaches predominantly rely on discrete-time formulations, which suffer from finite-step approximation errors and coupled training-sampling step counts. We propose a continuous-time diffusion framework for generating mixed-type time-series EHRs with three contributions: (1) continuous-time diffusion with a bidirectional gated recurrent unit backbone for capturing temporal dependencies, (2) unified Gaussian diffusion via learnable continuous embeddings for categorical variables, enabling joint cross-feature modeling, and (3) a factorized learnable noise schedule that adapts to per-feature-per-timestep learning difficulties. Experiments on two large-scale intensive care unit datasets demonstrate that our method outperforms existing approaches in downstream task performance, distribution fidelity, and discriminability, while requiring only 50 sampling steps compared to 1,000 for baseline methods. Classifier-free guidance further enables effective conditional generation for class-imbalanced clinical scenarios.
• 摘要：电子健康记录 (EHR) 对于临床研究来说非常宝贵，但隐私问题严​​重限制了数据共享。合成数据生成提供了一个有前途的解决方案，但电子病历提出了独特的挑战：它们包​​含随着时间的推移而演变的数字和分类特征。虽然扩散模型在 EHR 合成中表现出强大的性能，但现有方法主要依赖于离散时间公式，该公式会受到有限步近似误差和耦合训练采样步数的影响。我们提出了一种用于生成混合类型时间序列 EHR 的连续时间扩散框架，具有三个贡献：（1）具有双向门控循环单元主干的连续时间扩散，用于捕获时间依赖性；（2）通过分类变量的可学习连续嵌入进行统一高斯扩散，从而实现联合跨特征建模；（3）适应每个特征每个时间步学习困难的因式分解可学习噪声调度。对两个大型重症监护病房数据集的实验表明，我们的方法在下游任务性能、分布保真度和可辨别性方面优于现有方法，同时仅需要 50 个采样步骤，而基线方法需要 1,000 个采样步骤。无分类器指导进一步实现了类别不平衡临床场景的有效条件生成。

Title: Self Paced Gaussian Contextual Reinforcement Learning

• Authors: Mohsen Sahraei Ardakani, Rui Song
• Subjects: cs.LG, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.23755
• Pdf URL: https://arxiv.org/pdf/2603.23755
• Copy Paste: [[2603.23755]] Self Paced Gaussian Contextual Reinforcement Learning(https://arxiv.org/abs/2603.23755)
• Keywords: generation
• Abstract: Curriculum learning improves reinforcement learning (RL) efficiency by sequencing tasks from simple to complex. However, many self-paced curriculum methods rely on computationally expensive inner-loop optimizations, limiting their scalability in high-dimensional context spaces. In this paper, we propose Self-Paced Gaussian Curriculum Learning (SPGL), a novel approach that avoids costly numerical procedures by leveraging a closed-form update rule for Gaussian context distributions. SPGL maintains the sample efficiency and adaptability of traditional self-paced methods while substantially reducing computational overhead. We provide theoretical guarantees on convergence and validate our method across several contextual RL benchmarks, including the Point Mass, Lunar Lander, and Ball Catching environments. Experimental results show that SPGL matches or outperforms existing curriculum methods, especially in hidden context scenarios, and achieves more stable context distribution convergence. Our method offers a scalable, principled alternative for curriculum generation in challenging continuous and partially observable domains.
• 摘要：课程学习通过将任务从简单到复杂排序来提高强化学习 (RL) 效率。然而，许多自定进度的课程方法依赖于计算成本昂贵的内循环优化，限制了它们在高维上下文空间中的可扩展性。在本文中，我们提出了自定进度高斯课程学习（SPGL），这是一种通过利用高斯上下文分布的封闭式更新规则来避免昂贵的数值过程的新颖方法。 SPGL 保持了传统自定进度方法的样本效率和适应性，同时大幅减少了计算开销。我们提供收敛的理论保证，并在多个上下文 RL 基准测试中验证我们的方法，包括 Point Mass、Lunar Lander 和 Ball Catching 环境。实验结果表明，SPGL 匹配或优于现有的课程方法，尤其是在隐藏上下文场景中，并实现了更稳定的上下文分布收敛。我们的方法为挑战连续和部分可观察领域的课程生成提供了一种可扩展的、有原则的替代方案。

Title: Probabilistic Geometric Alignment via Bayesian Latent Transport for Domain-Adaptive Foundation Models

• Authors: Kuepon Aueawatthanaphisut, Kuepon Aueawatthanaphisut
• Subjects: cs.LG, cs.AI, math.OC, math.PR, stat.ML
• Abstract URL: https://arxiv.org/abs/2603.23783
• Pdf URL: https://arxiv.org/pdf/2603.23783
• Copy Paste: [[2603.23783]] Probabilistic Geometric Alignment via Bayesian Latent Transport for Domain-Adaptive Foundation Models(https://arxiv.org/abs/2603.23783)
• Keywords: generation
• Abstract: Adapting large-scale foundation models to new domains with limited supervision remains a fundamental challenge due to latent distribution mismatch, unstable optimization dynamics, and miscalibrated uncertainty propagation. This paper introduces an uncertainty-aware probabilistic latent transport framework that formulates domain adaptation as a stochastic geometric alignment problem in representation space. A Bayesian transport operator is proposed to redistribute latent probability mass along Wasserstein-type geodesic trajectories, while a PAC-Bayesian regularization mechanism constrains posterior model complexity to mitigate catastrophic overfitting. The proposed formulation yields theoretical guarantees on convergence stability, loss landscape smoothness, and sample efficiency under distributional shift. Empirical analyses demonstrate substantial reduction in latent manifold discrepancy, accelerated transport energy decay, and improved covariance calibration compared with deterministic fine-tuning and adversarial domain adaptation baselines. Furthermore, bounded posterior uncertainty evolution indicates enhanced probabilistic reliability during cross-domain transfer. By establishing a principled connection between stochastic optimal transport geometry and statistical generalization theory, the proposed framework provides new insights into robust adaptation of modern foundation architectures operating in heterogeneous environments. These findings suggest that uncertainty-aware probabilistic alignment constitutes a promising paradigm for reliable transfer learning in next-generation deep representation systems.
• 摘要：由于潜在的分布不匹配、不稳定的优化动力学和错误校准的不确定性传播，在有限监督的情况下使大规模基础模型适应新领域仍然是一个基本挑战。本文介绍了一种不确定性感知概率潜在传输框架，该框架将域适应表述为表示空间中的随机几何对齐问题。提出了贝叶斯传输算子沿 Wasserstein 型测地线轨迹重新分布潜在概率质量，而 PAC-贝叶斯正则化机制限制后验模型复杂性以减轻灾难性的过度拟合。所提出的公式为分布偏移下的收敛稳定性、损失景观平滑度和样本效率提供了理论保证。实证分析表明，与确定性微调和对抗域适应基线相比，潜在流形差异大幅减少，传输能量衰减加速，协方差校准得到改进。此外，有界后验不确定性演化表明跨域转移期间概率可靠性增强。通过在随机最优传输几何和统计泛化理论之间建立原则上的联系，所提出的框架为在异构环境中运行的现代基础架构的稳健适应提供了新的见解。这些发现表明，不确定性感知概率对齐构成了下一代深度表示系统中可靠迁移学习的有前景的范例。

Title: 3D-LLDM: Label-Guided 3D Latent Diffusion Model for Improving High-Resolution Synthetic MR Imaging in Hepatic Structure Segmentation

• Authors: Kyeonghun Kim, Jaehyeok Bae, Youngung Han, Joo Young Bae, Seoyoung Ju, Junsu Lim, Gyeongmin Kim, Nam-Joon Kim, Woo Kyoung Jeong, Ken Ying-Kai Liao, Won Jae Lee, Pa Hong, Hyuk-Jae Lee
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.23845
• Pdf URL: https://arxiv.org/pdf/2603.23845
• Copy Paste: [[2603.23845]] 3D-LLDM: Label-Guided 3D Latent Diffusion Model for Improving High-Resolution Synthetic MR Imaging in Hepatic Structure Segmentation(https://arxiv.org/abs/2603.23845)
• Keywords: generative
• Abstract: Deep learning and generative models are advancing rapidly, with synthetic data increasingly being integrated into training pipelines for downstream analysis tasks. However, in medical imaging, their adoption remains constrained by the scarcity of reliable annotated datasets. To address this limitation, we propose 3D-LLDM, a label-guided 3D latent diffusion model that generates high-quality synthetic magnetic resonance (MR) volumes with corresponding anatomical segmentation masks. Our approach uses hepatobiliary phase MR images enhanced with the Gd-EOB-DTPA contrast agent to derive structural masks for the liver, portal vein, hepatic vein, and hepatocellular carcinoma, which then guide volumetric synthesis through a ControlNet-based architecture. Trained on 720 real clinical hepatobiliary phase MR scans from Samsung Medical Center, 3D-LLDM achieves a Fréchet Inception Distance (FID) of 28.31, improving over GANs by 70.9% and over state-of-the-art diffusion baselines by 26.7%. When used for data augmentation, the synthetic volumes improve hepatocellular carcinoma segmentation by up to 11.153% Dice score across five CNN architectures.
• 摘要：深度学习和生成模型正在迅速发展，合成数据越来越多地集成到下游分析任务的训练管道中。然而，在医学成像中，它们的采用仍然受到可靠注释数据集稀缺的限制。为了解决这一限制，我们提出了 3D-LLDM，这是一种标签引导的 3D 潜在扩散模型，可生成具有相应解剖分割掩模的高质量合成磁共振 (MR) 体积。我们的方法使用用 Gd-EOB-DTPA 造影剂增强的肝胆期 MR 图像来导出肝脏、门静脉、肝静脉和肝细胞癌的结构掩模，然后通过基于 ControlNet 的架构指导体积合成。经过三星医疗中心 720 次真实临床肝胆相 MR 扫描的训练，3D-LLDM 的 Fréchet 起始距离 (FID) 达到 28.31，比 GAN 提高了 70.9%，比最先进的扩散基线提高了 26.7%。当用于数据增强时，合成体积可在五种 CNN 架构中将肝细胞癌分割的 Dice 评分提高高达 11.153%。

Title: HDPO: Hybrid Distillation Policy Optimization via Privileged Self-Distillation

• Authors: Ken Ding
• Subjects: cs.LG, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.23871
• Pdf URL: https://arxiv.org/pdf/2603.23871
• Copy Paste: [[2603.23871]] HDPO: Hybrid Distillation Policy Optimization via Privileged Self-Distillation(https://arxiv.org/abs/2603.23871)
• Keywords: generation
• Abstract: Large language models trained with reinforcement learning (RL) for mathematical reasoning face a fundamental challenge: on problems the model cannot solve at all - "cliff" prompts - the RL gradient vanishes entirely, preventing any learning signal from reaching these failure modes. We introduce Hybrid Distillation Policy Optimization (HDPO), which augments standard RL with privileged self-distillation targeting cliff prompts. On each training step, HDPO identifies prompts where all rollouts fail, generates privileged rollouts by providing the model with ground-truth information, filters for correct solutions, and distills the teacher's token-level distribution into the student. Because teacher and student share the same weights - differing only in their input - the realizability gap is provably bounded, unlike cross-model distillation. We prove that R=1 filtered privileged generation recovers the optimal KL-regularized RL policy in the hard-threshold limit. Experiments on OpenMathInstruct-2 with Qwen2.5-Math-1.5B-Instruct show that HDPO consistently improves coverage metrics (pass@4 by +0.8-1.1%, pass@8 by +0.4-1.7%) while maintaining greedy accuracy, with the distillation weight lambda providing direct control over the exploration-exploitation tradeoff.
• 摘要：使用强化学习 (RL) 进行数学推理训练的大型语言模型面临着根本性的挑战：对于模型根本无法解决的问题（“悬崖”提示），RL 梯度完全消失，从而阻止任何学习信号到达这些故障模式。我们引入了混合蒸馏策略优化（HDPO），它通过针对悬崖提示的特权自蒸馏来增强标准强化学习。在每个训练步骤中，HDPO 都会识别所有推出失败的提示，通过为模型提供真实信息来生成特权推出，过滤正确的解决方案，并将教师的令牌级别分布提炼给学生。由于教师和学生共享相同的权重（仅在输入方面有所不同），因此与跨模型蒸馏不同，可实现性差距可证明是有限的。我们证明，R=1 过滤特权生成在硬阈值限制下恢复了最佳 KL 正则化 RL 策略。使用 Qwen2.5-Math-1.5B-Instruct 在 OpenMathInstruct-2 上进行的实验表明，HDPO 持续改进覆盖率指标（pass@4 提高 +0.8-1.1%，pass@8 提高 +0.4-1.7%），同时保持贪婪精度，蒸馏权重 lambda 提供对探索-利用权衡的直接控制。

Title: MMTIT-Bench: A Multilingual and Multi-Scenario Benchmark with Cognition-Perception-Reasoning Guided Text-Image Machine Translation

• Authors: Gengluo Li, Chengquan Zhang, Yupu Liang, Huawen Shen, Yaping Zhang, Pengyuan Lyu, Weinong Wang, Xingyu Wan, Gangyan Zeng, Han Hu, Can Ma, Yu Zhou
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.23896
• Pdf URL: https://arxiv.org/pdf/2603.23896
• Copy Paste: [[2603.23896]] MMTIT-Bench: A Multilingual and Multi-Scenario Benchmark with Cognition-Perception-Reasoning Guided Text-Image Machine Translation(https://arxiv.org/abs/2603.23896)
• Keywords: generation
• Abstract: End-to-end text-image machine translation (TIMT), which directly translates textual content in images across languages, is crucial for real-world multilingual scene understanding. Despite advances in vision-language large models (VLLMs), robustness across diverse visual scenes and low-resource languages remains underexplored due to limited evaluation resources. We present MMTIT-Bench, a human-verified multilingual and multi-scenario benchmark with 1,400 images spanning fourteen non-English and non-Chinese languages and diverse settings such as documents, scenes, and web images, enabling rigorous assessment of end-to-end TIMT. Beyond benchmarking, we study how reasoning-oriented data design improves translation. Although recent VLLMs have begun to incorporate long Chain-of-Thought (CoT) reasoning, effective thinking paradigms for TIMT are still immature: existing designs either cascade parsing and translation in a sequential manner or focus on language-only reasoning, overlooking the visual cognition central to VLLMs. We propose Cognition-Perception-Reasoning for Translation (CPR-Trans), a data paradigm that integrates scene cognition, text perception, and translation reasoning within a unified reasoning process. Using a VLLM-driven data generation pipeline, CPR-Trans provides structured, interpretable supervision that aligns perception with reasoning. Experiments on 3B and 7B models show consistent gains in accuracy and interpretability. We will release MMTIT-Bench to promote the multilingual and multi-scenario TIMT research upon acceptance.
• 摘要：端到端文本图像机器翻译（TIMT）可以跨语言直接翻译图像中的文本内容，对于现实世界的多语言场景理解至关重要。尽管视觉语言大型模型（VLLM）取得了进步，但由于评估资源有限，跨不同视觉场景和低资源语言的鲁棒性仍未得到充分探索。我们推出了 MMTIT-Bench，这是一个经过人工验证的多语言和多场景基准，包含 1,400 张图像，涵盖 14 种非英语和非汉语语言以及文档、场景和网络图像等多种设置，从而能够对端到端 TIMT 进行严格评估。除了基准测试之外，我们还研究面向推理的数据设计如何改进翻译。尽管最近的 VLLM 已经开始融入长思维链 (CoT) 推理，但 TIMT 的有效思维范式仍然不成熟：现有设计要么按顺序进行级联解析和翻译，要么专注于纯语言推理，忽视了 VLLM 的核心视觉认知。我们提出了翻译认知-感知-推理（CPR-Trans），这是一种将场景认知、文本感知和翻译推理集成到统一推理过程中的数据范式。使用 VLLM 驱动的数据生成管道，CPR-Trans 提供结构化、可解释的监督，使感知与推理保持一致。 3B 和 7B 模型的实验显示了准确性和可解释性的持续提升。验收后我们将发布MMTIT-Bench，推动多语言、多场景的TIMT研究。

Title: Latent Bias Alignment for High-Fidelity Diffusion Inversion in Real-World Image Reconstruction and Manipulation

• Authors: Weiming Chen, Qifan Liu, Siyi Liu, Yushun Tang, Yijia Wang, Zhihan Zhu, Zhihai He
• Subjects: cs.CV, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.23903
• Pdf URL: https://arxiv.org/pdf/2603.23903
• Copy Paste: [[2603.23903]] Latent Bias Alignment for High-Fidelity Diffusion Inversion in Real-World Image Reconstruction and Manipulation(https://arxiv.org/abs/2603.23903)
• Keywords: generation
• Abstract: Recent research has shown that text-to-image diffusion models are capable of generating high-quality images guided by text prompts. But can they be used to generate or approximate real-world images from the seed noise? This is known as the diffusion inversion problem, which serves as a fundamental building block for bridging diffusion models and real-world scenarios. However, existing diffusion inversion methods often suffer from low reconstruction quality or weak robustness. Two major challenges need to be carefully addressed: (1) the misalignment between the inversion and generation trajectories during the diffusion process, and (2) the mismatch between the diffusion inversion process and the VQ autoencoder (VQAE) reconstruction. To address these challenges, we introduce a latent bias vector at each inversion step, which is learned to reduce the misalignment between inversion and generation trajectories. We refer to this strategy as Latent Bias Optimization (LBO). Furthermore, we perform an approximate joint optimization of the diffusion inversion and VQAE reconstruction processes by learning to adjust the image latent representation, which serves as the connecting interface between them. We refer to this technique as Image Latent Boosting (ILB). Extensive experimental results demonstrate that the proposed method significantly improves the image reconstruction quality of the diffusion model, as well as the performance of downstream tasks, including image editing and rare concept generation.
• 摘要：最近的研究表明，文本到图像的扩散模型能够在文本提示的引导下生成高质量的图像。但它们可以用来从种子噪声生成或近似真实世界的图像吗？这称为扩散反演问题，它是连接扩散模型和现实场景的基本构建块。然而，现有的扩散反演方法往往存在重建质量低或鲁棒性弱的问题。需要仔细解决两个主要挑战：（1）扩散过程中反演和生成轨迹之间的不对准，以及（2）扩散反演过程和VQ自动编码器（VQAE）重建之间的不匹配。为了解决这些挑战，我们在每个反演步骤中引入了一个潜在偏差向量，该向量被学习以减少反演和生成轨迹之间的偏差。我们将此策略称为潜在偏差优化 (LBO)。此外，我们通过学习调整图像潜在表示（作为它们之间的连接接口）来对扩散反演和 VQAE 重建过程进行近似联合优化。我们将此技术称为图像潜在增强 (ILB)。大量的实验结果表明，所提出的方法显着提高了扩散模型的图像重建质量，以及下游任务的性能，包括图像编辑和稀有概念生成。

Title: GenMask: Adapting DiT for Segmentation via Direct Mask

• Authors: Yuhuan Yang, Xianwei Zhuang, Yuxuan Cai, Chaofan Ma, Shuai Bai, Jiangchao Yao, Ya Zhang, Junyang Lin, Yanfeng Wang
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.23906
• Pdf URL: https://arxiv.org/pdf/2603.23906
• Copy Paste: [[2603.23906]] GenMask: Adapting DiT for Segmentation via Direct Mask(https://arxiv.org/abs/2603.23906)
• Keywords: generation, generative
• Abstract: Recent approaches for segmentation have leveraged pretrained generative models as feature extractors, treating segmentation as a downstream adaptation task via indirect feature retrieval. This implicit use suffers from a fundamental misalignment in representation. It also depends heavily on indirect feature extraction pipelines, which complicate the workflow and limit adaptation. In this paper, we argue that instead of indirect adaptation, segmentation tasks should be trained directly in a generative manner. We identify a key obstacle to this unified formulation: VAE latents of binary masks are sharply distributed, noise robust, and linearly separable, distinct from natural image latents. To bridge this gap, we introduce timesteps sampling strategy for binary masks that emphasizes extreme noise levels for segmentation and moderate noise for image generation, enabling harmonious joint training. We present GenMask, a DiT trains to generate black-and-white segmentation masks as well as colorful images in RGB space under the original generative objective. GenMask preserves the original DiT architecture while removing the need of feature extraction pipelines tailored for segmentation tasks. Empirically, GenMask attains state-of-the-art performance on referring and reasoning segmentation benchmarks and ablations quantify the contribution of each component.
• 摘要：最近的分割方法利用预训练的生成模型作为特征提取器，通过间接特征检索将分割视为下游适应任务。这种隐式使用在表示上存在根本性的偏差。它还严重依赖于间接特征提取管道，这使工作流程变得复杂并限制了适应性。在本文中，我们认为分割任务应该以生成方式直接训练，而不是间接适应。我们确定了这种统一公式的一个关键障碍：二元掩模的 VAE 潜伏分布尖锐、噪声鲁棒且线性可分离，与自然图像潜伏不同。为了弥补这一差距，我们引入了二进制掩模的时间步采样策略，强调分割的极端噪声水平和图像生成的中等噪声，从而实现和谐的联合训练。我们提出了 GenMask，一种 DiT 训练，可以在原始生成目标下生成黑白分割掩模以及 RGB 空间中的彩色图像。 GenMask 保留了原始的 DiT 架构，同时消除了为分割任务定制的特征提取管道的需要。根据经验，GenMask 在引用和推理分割基准方面获得了最先进的性能，并且消融量化了每个组件的贡献。

Title: DepthArb: Training-Free Depth-Arbitrated Generation for Occlusion-Robust Image Synthesis

• Authors: Hongjin Niu, Jiahao Wang, Xirui Hu, Weizhan Zhang, Lan Ma, Yuan Gao
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.23924
• Pdf URL: https://arxiv.org/pdf/2603.23924
• Copy Paste: [[2603.23924]] DepthArb: Training-Free Depth-Arbitrated Generation for Occlusion-Robust Image Synthesis(https://arxiv.org/abs/2603.23924)
• Keywords: generation, generative
• Abstract: Text-to-image diffusion models frequently exhibit deficiencies in synthesizing accurate occlusion relationships of multiple objects, particularly within dense overlapping regions. Existing training-free layout-guided methods predominantly rely on rigid spatial priors that remain agnostic to depth order, often resulting in concept mixing or illogical occlusion. To address these limitations, we propose DepthArb, a training-free framework that resolves occlusion ambiguities by arbitrating attention competition between interacting objects. Specifically, DepthArb employs two core mechanisms: Attention Arbitration Modulation (AAM), which enforces depth-ordered visibility by suppressing background activations in overlapping regions, and Spatial Compactness Control (SCC), which preserves structural integrity by curbing attention divergence. These mechanisms enable robust occlusion generation without model retraining. To systematically evaluate this capability, we propose OcclBench, a comprehensive benchmark designed to evaluate diverse occlusion scenarios. Extensive evaluations demonstrate that DepthArb consistently outperforms state-of-the-art baselines in both occlusion accuracy and visual fidelity. As a plug-and-play method, DepthArb seamlessly enhances the compositional capabilities of diffusion backbones, offering a novel perspective on spatial layering within generative models.
• 摘要：文本到图像扩散模型在合成多个对象的准确遮挡关系方面经常表现出缺陷，特别是在密集重叠区域内。现有的免训练布局引导方法主要依赖于严格的空间先验，而这些先验对于深度顺序仍然不可知，通常会导致概念混合或不合逻辑的遮挡。为了解决这些限制，我们提出了 DepthArb，这是一种免训练框架，通过仲裁交互对象之间的注意力竞争来解决遮挡模糊性。具体来说，DepthArb 采用两个核心机制：注意力仲裁调制 (AAM)，通过抑制重叠区域的背景激活来增强深度有序可见性；空间紧凑控制 (SCC)，通过抑制注意力发散来保持结构完整性。这些机制无需模型重新训练即可实现稳健的遮挡生成。为了系统地评估这种能力，我们提出了 OcclBench，这是一个旨在评估不同遮挡场景的综合基准。广泛的评估表明，DepthArb 在遮挡精度和视觉保真度方面始终优于最先进的基线。作为一种即插即用的方法，DepthArb 无缝增强了扩散主干的合成能力，为生成模型中的空间分层提供了新颖的视角。

Title: High-Fidelity Face Content Recovery via Tamper-Resilient Versatile Watermarking

• Authors: Peipeng Yu, Jinfeng Xie, Chengfu Ou, Xiaoyu Zhou, Jianwei Fei, Yunshu Dai, Zhihua Xia, Chip Hong Chang
• Subjects: cs.CV, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.23940
• Pdf URL: https://arxiv.org/pdf/2603.23940
• Copy Paste: [[2603.23940]] High-Fidelity Face Content Recovery via Tamper-Resilient Versatile Watermarking(https://arxiv.org/abs/2603.23940)
• Keywords: restoration, generative
• Abstract: The proliferation of AIGC-driven face manipulation and deepfakes poses severe threats to media provenance, integrity, and copyright protection. Prior versatile watermarking systems typically rely on embedding explicit localization payloads, which introduces a fidelity--functionality trade-off: larger localization signals degrade visual quality and often reduce decoding robustness under strong generative edits. Moreover, existing methods rarely support content recovery, limiting their forensic value when original evidence must be reconstructed. To address these challenges, we present VeriFi, a versatile watermarking framework that unifies copyright protection, pixel-level manipulation localization, and high-fidelity face content recovery. VeriFi makes three key contributions: (1) it embeds a compact semantic latent watermark that serves as an content-preserving prior, enabling faithful restoration even after severe manipulations; (2) it achieves fine-grained localization without embedding localization-specific artifacts by correlating image features with decoded provenance signals; and (3) it introduces an AIGC attack simulator that combines latent-space mixing with seamless blending to improve robustness to realistic deepfake pipelines. Extensive experiments on CelebA-HQ and FFHQ show that VeriFi consistently outperforms strong baselines in watermark robustness, localization accuracy, and recovery quality, providing a practical and verifiable defense for deepfake forensics.
• 摘要：AIGC 驱动的人脸操纵和深度伪造的激增对媒体来源、完整性和版权保护构成了严重威胁。先前的多功能水印系统通常依赖于嵌入显式定位有效负载，这引入了保真度与功能的权衡：较大的定位信号会降低视觉质量，并且通常会降低强生成编辑下的解码鲁棒性。此外，现有方法很少支持内容恢复，当必须重建原始证据时限制了它们的取证价值。为了应对这些挑战，我们推出了 VeriFi，这是一种多功能水印框架，它统一了版权保护、像素级操作本地化和高保真面部内容恢复。 VeriFi 做出了三个关键贡献：（1）它嵌入了一个紧凑的语义潜在水印，作为内容保留先验，即使在严重的操作之后也能忠实地恢复； （2）通过将图像特征与解码的来源信号相关联，实现细粒度定位，而无需嵌入特定于定位的伪影； (3)它引入了 AIGC 攻击模拟器，该模拟器将潜在空间混合与无缝混合相结合，以提高真实深度伪造管道的鲁棒性。在 CelebA-HQ 和 FFHQ 上进行的大量实验表明，VeriFi 在水印鲁棒性、定位准确性和恢复质量方面始终优于强大的基线，为深度伪造取证提供了实用且可验证的防御。

Title: VOLMO: Versatile and Open Large Models for Ophthalmology

• Authors: Zhenyue Qin, Younjoon Chung, Elijah Lee, Wanyue Feng, Xuguang Ai, Serina Applebaum, Minjie Zou, Yang Liu, Pan Xiao, Mac Singer, Amisha Dave, Aidan Gilson, Tiarnan D. L. Keenan, Emily Y. Chew, Zhiyong Lu, Yih-Chung Tham, Ron Adelman, Luciano V. Del Priore, Qingyu Chen
• Subjects: cs.CV, cs.ET
• Abstract URL: https://arxiv.org/abs/2603.23953
• Pdf URL: https://arxiv.org/pdf/2603.23953
• Copy Paste: [[2603.23953]] VOLMO: Versatile and Open Large Models for Ophthalmology(https://arxiv.org/abs/2603.23953)
• Keywords: generation
• Abstract: Vision impairment affects millions globally, and early detection is critical to preventing irreversible vision loss. Ophthalmology workflows require clinicians to integrate medical images, structured clinical data, and free-text notes to determine disease severity and management, which is time-consuming and burdensome. Recent multimodal large language models (MLLMs) show promise, but existing general and medical MLLMs perform poorly in ophthalmology, and few ophthalmology-specific MLLMs are openly available. We present VOLMO (Versatile and Open Large Models for Ophthalmology), a model-agnostic, data-open framework for developing ophthalmology-specific MLLMs. VOLMO includes three stages: ophthalmology knowledge pretraining on 86,965 image-text pairs from 26,569 articles across 82 journals; domain task fine-tuning on 26,929 annotated instances spanning 12 eye conditions for disease screening and severity classification; and multi-step clinical reasoning on 913 patient case reports for assessment, planning, and follow-up care. Using this framework, we trained a compact 2B-parameter MLLM and compared it with strong baselines, including InternVL-2B, LLaVA-Med-7B, MedGemma-4B, MedGemma-27B, and RETFound. We evaluated these models on image description generation, disease screening and staging classification, and assessment-and-management generation, with additional manual review by two healthcare professionals and external validation on three independent cohorts for age-related macular degeneration and diabetic retinopathy. Across settings, VOLMO-2B consistently outperformed baselines, achieving stronger image description performance, an average F1 of 87.4% across 12 eye conditions, and higher scores in external validation.
• 摘要：视力障碍影响着全球数百万人，早期发现对于防止不可逆转的视力丧失至关重要。眼科工作流程要求临床医生整合医学图像、结构化临床数据和自由文本注释来确定疾病的严重程度和管理，这既耗时又繁重。最近的多模态大语言模型（MLLM）显示出了希望，但现有的普通和医学 MLLM 在眼科领域表现不佳，并且很少有眼科特定的 MLLM 是公开可用的。我们提出了 VOLMO（眼科多功能开放大型模型），这是一个与模型无关、数据开放的框架，用于开发眼科特定的 MLLM。 VOLMO 包括三个阶段：对来自 82 种期刊的 26,569 篇文章的 86,965 个图像文本对进行眼科知识预训练；对涵盖 12 种眼部疾病的 26,929 个带注释实例进行域任务微调，以进行疾病筛查和严重程度分类；对 913 例患者病例报告进行多步骤临床推理，以进行评估、规划和后续护理。使用该框架，我们训练了一个紧凑的 2B 参数 MLLM，并将其与强大的基线进行了比较，包括 InternVL-2B、LLaVA-Med-7B、MedGemma-4B、MedGemma-27B 和 RETFound。我们在图像描述生成、疾病筛查和分期分类以及评估和管理生成方面评估了这些模型，并由两名医疗保健专业人员进行了额外的手动审查，并对三个独立队列进行了年龄相关性黄斑变性和糖尿病视网膜病变的外部验证。在各个设置中，VOLMO-2B 始终优于基线，实现了更强的图像描述性能，在 12 种眼睛条件下的平均 F1 为 87.4%，并且在外部验证中得分更高。

Title: Leave No Stone Unturned: Uncovering Holistic Audio-Visual Intrinsic Coherence for Deepfake Detection

• Authors: Jielun Peng, Yabin Wang, Yaqi Li, Long Kong, Xiaopeng Hong
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.23960
• Pdf URL: https://arxiv.org/pdf/2603.23960
• Copy Paste: [[2603.23960]] Leave No Stone Unturned: Uncovering Holistic Audio-Visual Intrinsic Coherence for Deepfake Detection(https://arxiv.org/abs/2603.23960)
• Keywords: generative
• Abstract: The rapid progress of generative AI has enabled hyper-realistic audio-visual deepfakes, intensifying threats to personal security and social trust. Most existing deepfake detectors rely either on uni-modal artifacts or audio-visual discrepancies, failing to jointly leverage both sources of information. Moreover, detectors that rely on generator-specific artifacts tend to exhibit degraded generalization when confronted with unseen forgeries. We argue that robust and generalizable detection should be grounded in intrinsic audio-visual coherence within and across modalities. Accordingly, we propose HAVIC, a Holistic Audio-Visual Intrinsic Coherence-based deepfake detector. HAVIC first learns priors of modality-specific structural coherence, inter-modal micro- and macro-coherence by pre-training on authentic videos. Based on the learned priors, HAVIC further performs holistic adaptive aggregation to dynamically fuse audio-visual features for deepfake detection. Additionally, we introduce HiFi-AVDF, a high-fidelity audio-visual deepfake dataset featuring both text-to-video and image-to-video forgeries from state-of-the-art commercial generators. Extensive experiments across several benchmarks demonstrate that HAVIC significantly outperforms existing state-of-the-art methods, achieving improvements of 9.39% AP and 9.37% AUC on the most challenging cross-dataset scenario. Our code and dataset are available at this https URL.
• 摘要：生成式人工智能的快速发展使得超现实的视听深度伪造成为可能，加剧了对个人安全和社会信任的威胁。大多数现有的深度换脸检测器要么依赖于单模态伪影，要么依赖于视听差异，无法联合利用这两种信息源。此外，依赖于生成器特定伪影的检测器在遇到看不见的伪造品时往往会表现出泛化能力下降。我们认为，稳健且可推广的检测应以模式内部和跨模式之间的内在视听一致性为基础。因此，我们提出了 HAVIC，一种基于整体视听内在相干性的深度伪造检测器。 HAVIC 首先通过对真实视频进行预训练来学习特定模态的结构一致性、模态间微观和宏观一致性的先验。基于学习到的先验，HAVIC 进一步执行整体自适应聚合，以动态融合视听特征以进行深度伪造检测。此外，我们还引入了 HiFi-AVDF，这是一种高保真视听深度伪造数据集，具有来自最先进商业生成器的文本到视频和图像到视频伪造数据。跨多个基准的大量实验表明，HAVIC 显着优于现有的最先进方法，在最具挑战性的跨数据集场景中实现了 9.39% AP 和 9.37% AUC 的改进。我们的代码和数据集可在此 https URL 获取。

Title: SLAT-Phys: Fast Material Property Field Prediction from Structured 3D Latents

• Authors: Rocktim Jyoti Das, Dinesh Manocha
• Subjects: cs.CV, cs.GR, cs.RO
• Abstract URL: https://arxiv.org/abs/2603.23973
• Pdf URL: https://arxiv.org/pdf/2603.23973
• Copy Paste: [[2603.23973]] SLAT-Phys: Fast Material Property Field Prediction from Structured 3D Latents(https://arxiv.org/abs/2603.23973)
• Keywords: generation
• Abstract: Estimating the material property field of 3D assets is critical for physics-based simulation, robotics, and digital twin generation. Existing vision-based approaches are either too expensive and slow or rely on 3D information. We present SLAT-Phys, an end-to-end method that predicts spatially varying material property fields of 3D assets directly from a single RGB image without explicit 3D reconstruction. Our approach leverages spatially organised latent features from a pretrained 3D asset generation model that encodes rich geometry and semantic prior, and trains a lightweight neural decoder to estimate Young's modulus, density, and Poisson's ratio. The coarse volumetric layout and semantic cues of the latent representation about object geometry and appearance enable accurate material estimation. Our experiments demonstrate that our method provides competitive accuracy in predicting continuous material parameters when compared against prior approaches, while significantly reducing computation time. In particular, SLAT-Phys requires only 9.9 seconds per object on an NVIDIA RTXA5000 GPU and avoids reconstruction and voxelization preprocessing. This results in 120x speedup compared to prior methods and enables faster material property estimation from a single image.
• 摘要：估计 3D 资产的材料属性场对于基于物理的模拟、机器人技术和数字孪生生成至关重要。现有的基于视觉的方法要么过于昂贵且速度缓慢，要么依赖 3D 信息。我们提出了 SLAT-Phys，这是一种端到端方法，可以直接从单个 RGB 图像预测 3D 资产的空间变化材料属性场，而无需显式 3D 重建。我们的方法利用预训练的 3D 资产生成模型中的空间组织潜在特征，该模型编码丰富的几何形状和语义先验，并训练轻量级神经解码器来估计杨氏模量、密度和泊松比。关于对象几何形状和外观的潜在表示的粗略体积布局和语义线索可以实现准确的材料估计。我们的实验表明，与之前的方法相比，我们的方法在预测连续材料参数方面提供了具有竞争力的准确性，同时显着减少了计算时间。特别是，SLAT-Phys 在 NVIDIA RTXA5000 GPU 上每个对象仅需要 9.9 秒，并且避免了重建和体素化预处理。与之前的方法相比，这使得速度提高了 120 倍，并且可以从单个图像更快地估计材料属性。

Title: Transcending Classical Neural Network Boundaries: A Quantum-Classical Synergistic Paradigm for Seismic Data Processing

• Authors: Zhengyi Yuan, Xintong Dong, Xinyang Wang, Zheng Cong, Shiqi Dong
• Subjects: cs.LG, physics.geo-ph
• Abstract URL: https://arxiv.org/abs/2603.23984
• Pdf URL: https://arxiv.org/pdf/2603.23984
• Copy Paste: [[2603.23984]] Transcending Classical Neural Network Boundaries: A Quantum-Classical Synergistic Paradigm for Seismic Data Processing(https://arxiv.org/abs/2603.23984)
• Keywords: generative
• Abstract: In recent years, a number of neural-network (NN) methods have exhibited good performance in seismic data processing, such as denoising, interpolation, and frequency-band extension. However, these methods rely on stacked perceptrons and standard activation functions, which imposes a bottleneck on the representational capacity of deep-learning models, making it difficult to capture the complex and non-stationary dynamics of seismic wavefields. Different from the classical perceptron-stacked NNs which are fundamentally confined to real-valued Euclidean spaces, the quantum NNs leverage the exponential state space of quantum mechanics to map the features into high-dimensional Hilbert spaces, transcending the representational boundary of classical NNs. Based on this insight, we propose a quantum-classical synergistic generative adversarial network (QC-GAN) for seismic data processing, serving as the first application of quantum NNs in seismic exploration. In QC-GAN, a quantum pathway is used to exploit the high-order feature correlations, while the convolutional pathway specializes in extracting the waveform structures of seismic wavefields. Furthermore, we design a QC feature complementarity loss to enforce the feature orthogonality in the proposed QC-GAN. This novel loss function can ensure that the two pathways encode non-overlapping information to enrich the capacity of feature representation. On the whole, by synergistically integrating the quantum and convolutional pathways, the proposed QC-GAN breaks the representational bottleneck inherent in classical GAN. Experimental results on denoising and interpolation tasks demonstrate that QC-GAN preserves wavefield continuity and amplitude-phase information under complex noise conditions.
• 摘要：近年来，一些神经网络（NN）方法在地震数据处理中表现出了良好的性能，例如去噪、插值和频带扩展等。然而，这些方法依赖于堆叠感知器和标准激活函数，这对深度学习模型的表示能力造成了瓶颈，使得难以捕获地震波场的复杂和非平稳动态。与基本上局限于实值欧几里德空间的经典感知器堆叠神经网络不同，量子神经网络利用量子力学的指数状态空间将特征映射到高维希尔伯特空间，超越了经典神经网络的表示边界。基于这一见解，我们提出了一种用于地震数据处理的量子经典协同生成对抗网络（QC-GAN），这是量子神经网络在地震勘探中的首次应用。在QC-GAN中，量子路径用于利用高阶特征相关性，而卷积路径专门用于提取地震波场的波形结构。此外，我们设计了 QC 特征互补损失来强制所提出的 QC-GAN 中的特征正交性。这种新颖的损失函数可以确保两条路径编码不重叠的信息，以丰富特征表示的能力。总体而言，通过协同集成量子和卷积路径，所提出的 QC-GAN 打破了经典 GAN 固有的表示瓶颈。去噪和插值任务的实验结果表明，QC-GAN 在复杂噪声条件下保留了波场连续性和幅相信息。

Title: Understanding the Challenges in Iterative Generative Optimization with LLMs

• Authors: Allen Nie, Xavier Daull, Zhiyi Kuang, Abhinav Akkiraju, Anish Chaudhuri, Max Piasevoli, Ryan Rong, YuCheng Yuan, Prerit Choudhary, Shannon Xiao, Rasool Fakoor, Adith Swaminathan, Ching-An Cheng
• Subjects: cs.LG, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.23994
• Pdf URL: https://arxiv.org/pdf/2603.23994
• Copy Paste: [[2603.23994]] Understanding the Challenges in Iterative Generative Optimization with LLMs(https://arxiv.org/abs/2603.23994)
• Keywords: generative
• Abstract: Generative optimization uses large language models (LLMs) to iteratively improve artifacts (such as code, workflows or prompts) using execution feedback. It is a promising approach to building self-improving agents, yet in practice remains brittle: despite active research, only 9% of surveyed agents used any automated optimization. We argue that this brittleness arises because, to set up a learning loop, an engineer must make ``hidden'' design choices: What can the optimizer edit and what is the "right" learning evidence to provide at each update? We investigate three factors that affect most applications: the starting artifact, the credit horizon for execution traces, and batching trials and errors into learning evidence. Through case studies in MLAgentBench, Atari, and BigBench Extra Hard, we find that these design decisions can determine whether generative optimization succeeds, yet they are rarely made explicit in prior work. Different starting artifacts determine which solutions are reachable in MLAgentBench, truncated traces can still improve Atari agents, and larger minibatches do not monotonically improve generalization on BBEH. We conclude that the lack of a simple, universal way to set up learning loops across domains is a major hurdle for productionization and adoption. We provide practical guidance for making these choices.
• 摘要：生成优化使用大型语言模型 (LLM) 通过执行反馈迭代改进工件（例如代码、工作流或提示）。这是构建自我改进智能体的一种很有前途的方法，但在实践中仍然很脆弱：尽管进行了积极的研究，但只有 9% 的受访智能体使用了任何自动化优化。我们认为，这种脆弱性的出现是因为，为了建立学习循环，工程师必须做出“隐藏”的设计选择：优化器可以编辑什么以及每次更新时要提供的“正确”学习证据是什么？我们研究了影响大多数应用程序的三个因素：启动工件、执行跟踪的信用期限以及将试验和错误批量化为学习证据。通过 MLAgentBench、Atari 和 BigBench Extra Hard 的案例研究，我们发现这些设计决策可以决定生成优化是否成功，但在之前的工作中很少明确说明。不同的起始工件决定了 MLAgentBench 中可以达到哪些解决方案，截断的跟踪仍然可以改进 Atari 代理，并且较大的小批量不会单调地改进 BBEH 上的泛化。我们的结论是，缺乏一种简单、通用的方法来建立跨领域的学习循环是生产和采用的主要障碍。我们为做出这些选择提供实用指导。

Title: Lagrangian Relaxation Score-based Generation for Mixed Integer linear Programming

• Authors: Ruobing Wang, Xin Li, Yujie Fang, Mingzhong Wang
• Subjects: cs.LG
• Abstract URL: https://arxiv.org/abs/2603.24033
• Pdf URL: https://arxiv.org/pdf/2603.24033
• Copy Paste: [[2603.24033]] Lagrangian Relaxation Score-based Generation for Mixed Integer linear Programming(https://arxiv.org/abs/2603.24033)
• Keywords: generation, generative
• Abstract: Predict-and-search (PaS) methods have shown promise for accelerating mixed-integer linear programming (MILP) solving. However, existing approaches typically assume variable independence and rely on deterministic single-point predictions, which limits solution diversityand often necessitates extensive downstream search for high-quality solutions. In this paper, we propose \textbf{SRG}, a generative framework based on Lagrangian relaxation-guided stochastic differential equations (SDEs), with theoretical guarantees on solution quality. SRG leverages convolutional kernels to capture inter-variable dependencies while integrating Lagrangian relaxation to guide the sampling process toward feasible and near-optimal regions. Rather than producing a single estimate, SRG generates diverse, high-quality solution candidates that collectively define compact and effective trust-region subproblems for standard MILP solvers. Across multiple public benchmarks, SRG consistently outperforms existing machine learning baselines in solution quality. Moreover, SRG demonstrates strong zero-shot transferability: on unseen cross-scale/problem instances, it achieves competitive optimality with state-of-the-art exact solvers while significantly reducing computational overhead through faster search and superior solution quality.
• 摘要：预测与搜索 (PaS) 方法已显示出加速混合整数线性规划 (MILP) 求解的前景。然而，现有方法通常假设变量独立并依赖于确定性单点预测，这限制了解决方案的多样性，并且通常需要广泛的下游搜索来寻找高质量的解决方案。在本文中，我们提出了 \textbf{SRG}，一种基于拉格朗日松弛引导随机微分方程（SDE）的生成框架，并对解的质量提供了理论保证。 SRG 利用卷积核来捕获变量间的依赖关系，同时集成拉格朗日松弛来引导采样过程走向可行和接近最优的区域。 SRG 不是生成单一估计，而是生成多样化的高质量候选解决方案，这些候选解决方案共同为标准 MILP 求解器定义紧凑且有效的信赖域子问题。在多个公共基准中，SRG 在解决方案质量方面始终优于现有的机器学习基准。此外，SRG 表现出强大的零样本可迁移性：在看不见的跨尺度/问题实例上，它通过最先进的精确求解器实现了竞争最优，同时通过更快的搜索和卓越的解决方案质量显着减少了计算开销。

Title: SemLayer: Semantic-aware Generative Segmentation and Layer Construction for Abstract Icons

• Authors: Haiyang Xu, Ronghuan Wu, Li-Yi Wei, Nanxuan Zhao, Chenxi Liu, Cuong Nguyen, Zhuowen Tu, Zhaowen Wang
• Subjects: cs.CV, cs.GR, cs.HC
• Abstract URL: https://arxiv.org/abs/2603.24039
• Pdf URL: https://arxiv.org/pdf/2603.24039
• Copy Paste: [[2603.24039]] SemLayer: Semantic-aware Generative Segmentation and Layer Construction for Abstract Icons(https://arxiv.org/abs/2603.24039)
• Keywords: generation, generative
• Abstract: Graphic icons are a cornerstone of modern design workflows, yet they are often distributed as flattened single-path or compound-path graphics, where the original semantic layering is lost. This absence of semantic decomposition hinders downstream tasks such as editing, restyling, and animation. We formalize this problem as semantic layer construction for flattened vector art and introduce SemLayer, a visual generation empowered pipeline that restores editable layered structures. Given an abstract icon, SemLayer first generates a chromatically differentiated representation in which distinct semantic components become visually separable. To recover the complete geometry of each part, including occluded regions, we then perform a semantic completion step that reconstructs coherent object-level shapes. Finally, the recovered parts are assembled into a layered vector representation with inferred occlusion relationships. Extensive qualitative comparisons and quantitative evaluations demonstrate the effectiveness of SemLayer, enabling editing workflows previously inapplicable to flattened vector graphics and establishing semantic layer reconstruction as a practical and valuable task. Project page: this https URL
• 摘要：图形图标是现代设计工作流程的基石，但它们通常以扁平化的单路径或复合路径图形的形式分布，从而丢失了原始的语义分层。语义分解的缺乏阻碍了编辑、重新设计和动画等下游任务。我们将这个问题形式化为扁平化矢量艺术的语义层构建，并引入 SemLayer，这是一种视觉生成授权的管道，可以恢复可编辑的分层结构。给定一个抽象图标，SemLayer 首先生成一个按颜色区分的表示，其中不同的语义组件在视觉上是可分离的。为了恢复每个部分的完整几何形状，包括遮挡区域，我们然后执行语义完成步骤来重建连贯的对象级形状。最后，将恢复的部分组装成具有推断遮挡关系的分层矢量表示。广泛的定性比较和定量评估证明了 SemLayer 的有效性，使以前不适用于扁平化矢量图形的编辑工作流程成为可能，并将语义层重建建立为一项实用且有价值的任务。项目页面：此 https URL

Title: HAM: A Training-Free Style Transfer Approach via Heterogeneous Attention Modulation for Diffusion Models

• Authors: Yeqi He, Liang Li, Zhiwen Yang, Xichun Sheng, Zhidong Zhao, Chenggang Yan
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.24043
• Pdf URL: https://arxiv.org/pdf/2603.24043
• Copy Paste: [[2603.24043]] HAM: A Training-Free Style Transfer Approach via Heterogeneous Attention Modulation for Diffusion Models(https://arxiv.org/abs/2603.24043)
• Keywords: generation
• Abstract: Diffusion models have demonstrated remarkable performance in image generation, particularly within the domain of style transfer. Prevailing style transfer approaches typically leverage pre-trained diffusion models' robust feature extraction capabilities alongside external modular control pathways to explicitly impose style guidance signals. However, these methods often fail to capture complex style reference or retain the identity of user-provided content images, thus falling into the trap of style-content balance. Thus, we propose a training-free style transfer approach via $\textbf{h}$eterogeneous $\textbf{a}$ttention $\textbf{m}$odulation ($\textbf{HAM}$) to protect identity information during image/text-guided style reference transfer, thereby addressing the style-content trade-off challenge. Specifically, we first introduces style noise initialization to initialize latent noise for diffusion. Then, during the diffusion process, it innovatively employs HAM for different attention mechanisms, including Global Attention Regulation (GAR) and Local Attention Transplantation (LAT), which better preserving the details of the content image while capturing complex style references. Our approach is validated through a series of qualitative and quantitative experiments, achieving state-of-the-art performance on multiple quantitative metrics.
• 摘要：扩散模型在图像生成方面表现出了卓越的性能，特别是在风格迁移领域。流行的风格转移方法通常利用预先训练的扩散模型的强大特征提取功能以及外部模块化控制路径来明确施加风格引导信号。然而，这些方法通常无法捕获复杂的风格参考或保留用户提供的内容图像的身份，从而陷入风格与内容平衡的陷阱。因此，我们提出了一种通过 $\textbf{h}$eterogeneous $\textbf{a}$ttention $\textbf{m}$odulation ($\textbf{HAM}$) 进行免训练的风格迁移方法，以在图像/文本引导的风格参考迁移期间保护身份信息，从而解决风格内容权衡挑战。具体来说，我们首先引入风格噪声初始化来初始化潜在噪声以进行扩散。然后，在扩散过程中，它创新性地将HAM用于不同的注意力机制，包括全局注意力调节（GAR）和局部注意力移植（LAT），可以更好地保留内容图像的细节，同时捕获复杂的风格参考。我们的方法通过一系列定性和定量实验得到验证，在多个定量指标上实现了最先进的性能。

Title: PosterIQ: A Design Perspective Benchmark for Poster Understanding and Generation

• Authors: Yuheng Feng, Wen Zhang, Haodong Duan, Xingxing Zou
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.24078
• Pdf URL: https://arxiv.org/pdf/2603.24078
• Copy Paste: [[2603.24078]] PosterIQ: A Design Perspective Benchmark for Poster Understanding and Generation(https://arxiv.org/abs/2603.24078)
• Keywords: generation, generative, quality assessment
• Abstract: We present PosterIQ, a design-driven benchmark for poster understanding and generation, annotated across composition structure, typographic hierarchy, and semantic intent. It includes 7,765 image-annotation instances and 822 generation prompts spanning real, professional, and synthetic cases. To bridge visual design cognition and generative modeling, we define tasks for layout parsing, text-image correspondence, typography/readability and font perception, design quality assessment, and controllable, composition-aware generation with metaphor. We evaluate state-of-the-art MLLMs and diffusion-based generators, finding persistent gaps in visual hierarchy, typographic semantics, saliency control, and intention communication; commercial models lead on high-level reasoning but act as insensitive automatic raters, while generators render text well yet struggle with composition-aware synthesis. Extensive analyses show PosterIQ is both a quantitative benchmark and a diagnostic tool for design reasoning, offering reproducible, task-specific metrics. We aim to catalyze models' creativity and integrate human-centred design principles into generative vision-language systems.
• 摘要：我们提出了 PosterIQ，一个设计驱动的海报理解和生成基准，在构图结构、排版层次结构和语义意图上进行了注释。它包括 7,765 个图像注释实例和 822 个生成提示，涵盖真实、专业和合成案例。为了连接视觉设计认知和生成建模，我们定义了布局解析、文本图像对应、排版/可读性和字体感知、设计质量评估以及带有隐喻的可控、构图感知生成等任务。我们评估最先进的 MLLM 和基于扩散的生成器，发现视觉层次、排版语义、显着性控制和意图沟通方面持续存在的差距；商业模型引领高级推理，但充当不敏感的自动评分器，而生成器可以很好地渲染文本，但难以进行组合感知合成。广泛的分析表明，PosterIQ 既是一个定量基准，也是设计推理的诊断工具，提供可重复的、特定于任务的指标。我们的目标是激发模型的创造力，并将以人为本的设计原则融入生成视觉语言系统中。

Title: When Understanding Becomes a Risk: Authenticity and Safety Risks in the Emerging Image Generation Paradigm

• Authors: Ye Leng, Junjie Chu, Mingjie Li, Chenhao Lin, Chao Shen, Michael Backes, Yun Shen, Yang Zhang
• Subjects: cs.CV, cs.AI, cs.CR
• Abstract URL: https://arxiv.org/abs/2603.24079
• Pdf URL: https://arxiv.org/pdf/2603.24079
• Copy Paste: [[2603.24079]] When Understanding Becomes a Risk: Authenticity and Safety Risks in the Emerging Image Generation Paradigm(https://arxiv.org/abs/2603.24079)
• Keywords: generation, generative
• Abstract: Recently, multimodal large language models (MLLMs) have emerged as a unified paradigm for language and image generation. Compared with diffusion models, MLLMs possess a much stronger capability for semantic understanding, enabling them to process more complex textual inputs and comprehend richer contextual meanings. However, this enhanced semantic ability may also introduce new and potentially greater safety risks. Taking diffusion models as a reference point, we systematically analyze and compare the safety risks of emerging MLLMs along two dimensions: unsafe content generation and fake image synthesis. Across multiple unsafe generation benchmark datasets, we observe that MLLMs tend to generate more unsafe images than diffusion models. This difference partly arises because diffusion models often fail to interpret abstract prompts, producing corrupted outputs, whereas MLLMs can comprehend these prompts and generate unsafe content. For current advanced fake image detectors, MLLM-generated images are also notably harder to identify. Even when detectors are retrained with MLLMs-specific data, they can still be bypassed by simply providing MLLMs with longer and more descriptive inputs. Our measurements indicate that the emerging safety risks of the cutting-edge generative paradigm, MLLMs, have not been sufficiently recognized, posing new challenges to real-world safety.
• 摘要：最近，多模态大语言模型（MLLM）已成为语言和图像生成的统一范例。与扩散模型相比，MLLM 具有更强的语义理解能力，使其能够处理更复杂的文本输入并理解更丰富的上下文含义。然而，这种增强的语义能力也可能带来新的、潜在的更大的安全风险。以扩散模型为参考点，我们从不安全内容生成和虚假图像合成两个维度系统地分析和比较新兴MLLM的安全风险。在多个不安全生成基准数据集中，我们观察到 MLLM 往往比扩散模型生成更多不安全图像。出现这种差异的部分原因是扩散模型通常无法解释抽象提示，从而产生损坏的输出，而 MLLM 可以理解这些提示并生成不安全的内容。对于当前先进的假图像检测器来说，MLLM 生成的图像也特别难以识别。即使使用 MLLM 特定数据对检测器进行重新训练，仍然可以通过简单地为 MLLM 提供更长、更具描述性的输入来绕过它们。我们的测量表明，尖端生成范式 MLLM 的新兴安全风险尚未得到充分认识，这对现实世界的安全提出了新的挑战。

Title: LGTM: Training-Free Light-Guided Text-to-Image Diffusion Model via Initial Noise Manipulation

• Authors: Ryugo Morita, Stanislav Frolov, Brian Bernhard Moser, Ko Watanabe, Riku Takahashi, Andreas Dengel
• Subjects: cs.CV, cs.GR
• Abstract URL: https://arxiv.org/abs/2603.24086
• Pdf URL: https://arxiv.org/pdf/2603.24086
• Copy Paste: [[2603.24086]] LGTM: Training-Free Light-Guided Text-to-Image Diffusion Model via Initial Noise Manipulation(https://arxiv.org/abs/2603.24086)
• Keywords: generation, generative
• Abstract: Diffusion models have demonstrated high-quality performance in conditional text-to-image generation, particularly with structural cues such as edges, layouts, and depth. However, lighting conditions have received limited attention and remain difficult to control within the generative process. Existing methods handle lighting through a two-stage pipeline that relights images after generation, which is inefficient. Moreover, they rely on fine-tuning with large datasets and heavy computation, limiting their adaptability to new models and tasks. To address this, we propose a novel Training-Free Light-Guided Text-to-Image Diffusion Model via Initial Noise Manipulation (LGTM), which manipulates the initial latent noise of the diffusion process to guide image generation with text prompts and user-specified light directions. Through a channel-wise analysis of the latent space, we find that selectively manipulating latent channels enables fine-grained lighting control without fine-tuning or modifying the pre-trained model. Extensive experiments show that our method surpasses prompt-based baselines in lighting consistency, while preserving image quality and text alignment. This approach introduces new possibilities for dynamic, user-guided light control. Furthermore, it integrates seamlessly with models like ControlNet, demonstrating adaptability across diverse scenarios.
• 摘要：扩散模型在条件文本到图像生成方面表现出了高质量的性能，特别是在边缘、布局和深度等结构线索方面。然而，照明条件受到的关注有限，并且在生成过程中仍然难以控制。现有方法通过两级管道处理照明，在生成后重新照亮图像，效率低下。此外，它们依赖于大型数据集和大量计算的微调，限制了它们对新模型和任务的适应性。为了解决这个问题，我们提出了一种通过初始噪声操纵（LGTM）的新型免训练光引导文本到图像扩散模型，该模型操纵扩散过程的初始潜在噪声，以通过文本提示和用户指定的光方向指导图像生成。通过对潜在空间的通道分析，我们发现选择性地操纵潜在通道可以实现细粒度的照明控制，而无需微调或修改预训练的模型。大量的实验表明，我们的方法在照明一致性方面超越了基于提示的基线，同时保持了图像质量和文本对齐。这种方法为动态、用户引导的灯光控制带来了新的可能性。此外，它与 ControlNet 等模型无缝集成，展示了跨不同场景的适应性。

Title: Reservoir-Based Graph Convolutional Networks

• Authors: Mayssa Soussia, Gita Ayu Salsabila, Mohamed Ali Mahjoub, Islem Rekik
• Subjects: cs.LG, cs.CV
• Abstract URL: https://arxiv.org/abs/2603.24131
• Pdf URL: https://arxiv.org/pdf/2603.24131
• Copy Paste: [[2603.24131]] Reservoir-Based Graph Convolutional Networks(https://arxiv.org/abs/2603.24131)
• Keywords: generation, generative
• Abstract: Message passing is a core mechanism in Graph Neural Networks (GNNs), enabling the iterative update of node embeddings by aggregating information from neighboring nodes. Graph Convolutional Networks (GCNs) exemplify this approach by adapting convolutional operations for graph structures, allowing features from adjacent nodes to be combined effectively. However, GCNs encounter challenges with complex or dynamic data. Capturing long-range dependencies often requires deeper layers, which not only increase computational costs but also lead to over-smoothing, where node embeddings become indistinguishable. To overcome these challenges, reservoir computing has been integrated into GNNs, leveraging iterative message-passing dynamics for stable information propagation without extensive parameter tuning. Despite its promise, existing reservoir-based models lack structured convolutional mechanisms, limiting their ability to accurately aggregate multi-hop neighborhood information. To address these limitations, we propose RGC-Net (Reservoir-based Graph Convolutional Network), which integrates reservoir dynamics with structured graph convolution. Key contributions include: (i) a reimagined convolutional framework with fixed random reservoir weights and a leaky integrator to enhance feature retention; (ii) a robust, adaptable model for graph classification; and (iii) an RGC-Net-powered transformer for graph generation with application to dynamic brain connectivity. Extensive experiments show that RGC-Net achieves state-of-the-art performance in classification and generative tasks, including brain graph evolution, with faster convergence and reduced over-smoothing. Source code is available at this https URL .
• 摘要：消息传递是图神经网络（GNN）的核心机制，通过聚合相邻节点的信息来迭代更新节点嵌入。图卷积网络（GCN）通过调整图结构的卷积运算来例证这种方法，从而有效地组合来自相邻节点的特征。然而，GCN 遇到了复杂或动态数据的挑战。捕获远程依赖关系通常需要更深的层，这不仅会增加计算成本，还会导致过度平滑，导致节点嵌入变得难以区分。为了克服这些挑战，储层计算已集成到 GNN 中，利用迭代消息传递动力学实现稳定的信息传播，而无需进行大量参数调整。尽管前景广阔，但现有的基于水库的模型缺乏结构化卷积机制，限制了它们准确聚合多跳邻域信息的能力。为了解决这些限制，我们提出了 RGC-Net（基于储层的图卷积网络），它将储层动力学与结构化图卷积相结合。主要贡献包括：（i）重新构想的卷积框架，具有固定的随机存储权重和泄漏积分器，以增强特征保留； (ii) 稳健、适应性强的图分类模型； (iii) RGC-Net 驱动的变压器，用于生成图形并应用于动态大脑连接。大量实验表明，RGC-Net 在分类和生成任务（包括脑图进化）中实现了最先进的性能，具有更快的收敛速度和减少的过度平滑。源代码可在此 https URL 获取。

Title: TsetlinWiSARD: On-Chip Training of Weightless Neural Networks using Tsetlin Automata on FPGAs

• Authors: Shengyu Duan, Marcos L. L. Sartori, Rishad Shafik, Alex Yakovlev
• Subjects: cs.LG, cs.AR
• Abstract URL: https://arxiv.org/abs/2603.24186
• Pdf URL: https://arxiv.org/pdf/2603.24186
• Copy Paste: [[2603.24186]] TsetlinWiSARD: On-Chip Training of Weightless Neural Networks using Tsetlin Automata on FPGAs(https://arxiv.org/abs/2603.24186)
• Keywords: generation
• Abstract: Increasing demands for adaptability, privacy, and security at the edge have persistently pushed the frontiers for a new generation of machine learning (ML) algorithms with training and inference capabilities on-chip. Weightless Neural Network (WNN) is such an algorithm that is principled on lookup table based simple neuron structures. As a result, it offers architectural benefits, such as low-latency, low-complexity inference, compared to deep neural networks that depend heavily on multiply-accumulate operations. However, traditional WNNs rely on memorization-based one-shot training, which either leads to overfitting and reduced accuracy or requires tedious post-training adjustments, limiting their effectiveness for efficient on chip training. In this work, we propose TsetlinWiSARD, a training approach for WNNs that leverages Tsetlin Automata (TAs) to enable probabilistic, feedback-driven learning. It overcomes the overfitting of WiSARD's one-shot training with iterative optimization, while maintaining simple, continuous binary feedback for efficient on-chip training. Central to our approach is a field programmable gate array (FPGA)-based training architecture that delivers state-of-the-art accuracy while significantly improving hardware efficiency. Our approach provides over 1000x faster training when compared with the traditional WiSARD implementation of WNNs. Further, we demonstrate 22% reduced resource usage, 93.3% lower latency, and 64.2% lower power consumption compared to FPGA-based training accelerators implementing other ML algorithms.
• 摘要：对边缘适应性、隐私性和安全性的日益增长的需求持续推动了具有片上训练和推理功能的新一代机器学习 (ML) 算法的发展。无重量神经网络（WNN）就是这样一种算法，其原理是基于简单神经元结构的查找表。因此，与严重依赖乘法累加运算的深度神经网络相比，它提供了架构优势，例如低延迟、低复杂度的推理。然而，传统的 WNN 依赖于基于记忆的一次性训练，这要么导致过度拟合并降低准确性，要么需要繁琐的训练后调整，限制了其高效片上训练的有效性。在这项工作中，我们提出了 TsetlinWiSARD，这是一种 WNN 训练方法，利用 Tsetlin 自动机 (TA) 来实现概率、反馈驱动的学习。它通过迭代优化克服了 WiSARD 一次性训练的过度拟合，同时保持简单、连续的二进制反馈以实现高效的片上训练。我们方法的核心是基于现场可编程门阵列 (FPGA) 的训练架构，该架构可提供最先进的准确性，同时显着提高硬件效率。与 WNN 的传统 WiSARD 实现相比，我们的方法提供的训练速度快了 1000 倍以上。此外，与实现其他 ML 算法的基于 FPGA 的训练加速器相比，我们的资源使用量减少了 22%，延迟降低了 93.3%，功耗降低了 64.2%。

Title: RefReward-SR: LR-Conditioned Reward Modeling for Preference-Aligned Super-Resolution

• Authors: Yushuai Song, Weize Quan, Weining Wang, Jiahui Sun, Jing Liu, Meng Li, Pengbin Yu, Zhentao Chen, Wei Shen, Lunxi Yuan, Dong-ming Yan
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.24198
• Pdf URL: https://arxiv.org/pdf/2603.24198
• Copy Paste: [[2603.24198]] RefReward-SR: LR-Conditioned Reward Modeling for Preference-Aligned Super-Resolution(https://arxiv.org/abs/2603.24198)
• Keywords: super-resolution, generation, generative
• Abstract: Recent advances in generative super-resolution (SR) have greatly improved visual realism, yet existing evaluation and optimization frameworks remain misaligned with human perception. Full-Reference and No-Reference metrics often fail to reflect perceptual preference, either penalizing semantically plausible details due to pixel misalignment or favoring visually sharp but inconsistent artifacts. Moreover, most SR methods rely on ground-truth (GT)-dependent distribution matching, which does not necessarily correspond to human judgments. In this work, we propose RefReward-SR, a low-resolution (LR) reference-aware reward model for preference-aligned SR. Instead of relying on GT supervision or NR evaluation, RefReward-SR assesses high-resolution (HR) reconstructions conditioned on their LR inputs, treating the LR image as a semantic anchor. Leveraging the visual-linguistic priors of a Multimodal Large Language Models (MLLM), it evaluates semantic consistency and plausibility in a reasoning-aware manner. To support this paradigm, we construct RefSR-18K, the first large-scale LR-conditioned preference dataset for SR, providing pairwise rankings based on LR-HR consistency and HR naturalness. We fine-tune the MLLM with Group Relative Policy Optimization (GRPO) using LR-conditioned ranking rewards, and further integrate GRPO into SR model training with RefReward-SR as the core reward signal for preference-aligned generation. Extensive experiments show that our framework achieves substantially better alignment with human judgments, producing reconstructions that preserve semantic consistency while enhancing perceptual plausibility and visual naturalness. Code, models, and datasets will be released upon paper acceptance.
• 摘要：生成超分辨率（SR）的最新进展极大地提高了视觉真实感，但现有的评估和优化框架仍然与人类感知不一致。全参考和无参考指标通常无法反映感知偏好，要么由于像素未对齐而惩罚语义上合理的细节，要么有利于视觉上清晰但不一致的伪影。此外，大多数 SR 方法依赖于基于真值 (GT) 的分布匹配，这不一定符合人类的判断。在这项工作中，我们提出了 RefReward-SR，一种用于偏好对齐 SR 的低分辨率 (LR) 参考感知奖励模型。 RefReward-SR 不依赖 GT 监督或 NR 评估，而是根据 LR 输入评估高分辨率 (HR) 重建，将 LR 图像视为语义锚。利用多模态大型语言模型 (MLLM) 的视觉语言先验，它以推理感知的方式评估语义一致性和合理性。为了支持这种范式，我们构建了 RefSR-18K，这是第一个大规模 LR 条件偏好的 SR 数据集，提供基于 LR-HR 一致性和 HR 自然性的成对排名。我们使用 LR 条件排名奖励通过组相对策略优化（GRPO）对 MLLM 进行微调，并进一步将 GRPO 集成到 SR 模型训练中，并以 RefReward-SR 作为偏好对齐生成的核心奖励信号。大量的实验表明，我们的框架与人类的判断实现了更好的一致性，产生了保持语义一致性的重建，同时增强了感知的合理性和视觉的自然度。代码、模型和数据集将在论文被接受后发布。

Title: A Deep Dive into Scaling RL for Code Generation with Synthetic Data and Curricula

• Authors: Cansu Sancaktar, David Zhang, Gabriel Synnaeve, Taco Cohen
• Subjects: cs.LG, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.24202
• Pdf URL: https://arxiv.org/pdf/2603.24202
• Copy Paste: [[2603.24202]] A Deep Dive into Scaling RL for Code Generation with Synthetic Data and Curricula(https://arxiv.org/abs/2603.24202)
• Keywords: generation
• Abstract: Reinforcement learning (RL) has emerged as a powerful paradigm for improving large language models beyond supervised fine-tuning, yet sustaining performance gains at scale remains an open challenge, as data diversity and structure, rather than volume alone, become the limiting factor. We address this by introducing a scalable multi-turn synthetic data generation pipeline in which a teacher model iteratively refines problems based on in-context student performance summaries, producing structured difficulty progressions without any teacher fine-tuning. Compared to single-turn generation, this multi-turn approach substantially improves the yield of valid synthetic problems and naturally produces stepping stones, i.e. easier and harder variants of the same core task, that support curriculum-based training. We systematically study how task difficulty, curriculum scheduling, and environment diversity interact during RL training across the Llama3.1-8B Instruct and Qwen3-8B Base model families, with additional scaling experiments on Qwen2.5-32B. Our results show that synthetic augmentation consistently improves in-domain code and in most cases out-of-domain math performance, and we provide empirical insights into how curriculum design and data diversity jointly shape RL training dynamics.
• 摘要：强化学习 (RL) 已成为改进大型语言模型的强大范例，超越了监督微调，但维持大规模的性能提升仍然是一个开放的挑战，因为数据多样性和结构（而不​​仅仅是数据量）成为限制因素。我们通过引入可扩展的多轮合成数据生成管道来解决这个问题，其中教师模型根据上下文中的学生表现摘要迭代地细化问题，产生结构化的难度进展，而无需任何教师微调。与单轮生成相比，这种多轮方法大大提高了有效综合问题的产量，并自然地产生垫脚石，即同一核心任务的更简单和更难的变体，支持基于课程的培训。我们系统地研究了 Llama3.1-8B Instruct 和 Qwen3-8B Base 模型系列的 RL 训练期间任务难度、课程安排和环境多样性如何相互作用，并在 Qwen2.5-32B 上进行了额外的扩展实验。我们的结果表明，综合增强持续改善了域内代码，并且在大多数情况下改善了域外数学表现，并且我们提供了关于课程设计和数据多样性如何共同塑造 RL 训练动态的实证见解。

Title: Uncovering Memorization in Timeseries Imputation models: LBRM Membership Inference and its link to attribute Leakage

• Authors: Faiz Taleb, Ivan Gazeau, Maryline Laurent
• Subjects: cs.LG, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.24213
• Pdf URL: https://arxiv.org/pdf/2603.24213
• Copy Paste: [[2603.24213]] Uncovering Memorization in Timeseries Imputation models: LBRM Membership Inference and its link to attribute Leakage(https://arxiv.org/abs/2603.24213)
• Keywords: generative
• Abstract: Deep learning models for time series imputation are now essential in fields such as healthcare, the Internet of Things (IoT), and finance. However, their deployment raises critical privacy concerns. Beyond the well-known issue of unintended memorization, which has been extensively studied in generative models, we demonstrate that time series models are vulnerable to inference attacks in a black-box setting. In this work, we introduce a two-stage attack framework comprising: (1) a novel membership inference attack based on a reference model that improves detection accuracy, even for models robust to overfitting-based attacks, and (2) the first attribute inference attack that predicts sensitive characteristics of the training data for timeseries imputation model. We evaluate these attacks on attention-based and autoencoder architectures in two scenarios: models that are trained from scratch, and fine-tuned models where the adversary has access to the initial weights. Our experimental results demonstrate that the proposed membership attack retrieves a significant portion of the training data with a tpr@top25% score significantly higher than a naive attack baseline. We show that our membership attack also provides a good insight of whether attribute inference will work (with a precision of 90% instead of 78% in the genral case).
• 摘要：用于时间序列插补的深度学习模型现在在医疗保健、物联网 (IoT) 和金融等领域至关重要。然而，它们的部署引起了严重的隐私问题。除了在生成模型中得到广泛研究的众所周知的意外记忆问题之外，我们还证明时间序列模型在黑盒设置中容易受到推理攻击。在这项工作中，我们引入了一个两阶段攻击框架，包括：（1）基于参考模型的新型成员推理攻击，即使对于基于过度拟合的攻击具有鲁棒性的模型，也可以提高检测精度；（2）第一个属性推理攻击，用于预测时间序列插补模型训练数据的敏感特征。我们在两种情况下评估对基于注意力和自动编码器架构的攻击：从头开始训练的模型，以及对手可以访问初始权重的微调模型。我们的实验结果表明，所提出的会员攻击检索了很大一部分训练数据，其 tpr@top25% 分数显着高于朴素攻击基线。我们表明，我们的成员资格攻击还可以很好地洞察属性推断是否有效（精度为 90%，而不是一般情况下的 78%）。

Title: InstanceRSR: Real-World Super-Resolution via Instance-Aware Representation Alignment

• Authors: Zixin Guo, Kai Zhao, Luyan Zhang
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.24240
• Pdf URL: https://arxiv.org/pdf/2603.24240
• Copy Paste: [[2603.24240]] InstanceRSR: Real-World Super-Resolution via Instance-Aware Representation Alignment(https://arxiv.org/abs/2603.24240)
• Keywords: restoration, super-resolution, generative
• Abstract: Existing real-world super-resolution (RSR) methods based on generative priors have achieved remarkable progress in producing high-quality and globally consistent reconstructions. However, they often struggle to recover fine-grained details of diverse object instances in complex real-world scenes. This limitation primarily arises because commonly adopted denoising losses (e.g., MSE) inherently favor global consistency while neglecting instance-level perception and restoration. To address this issue, we propose InstanceRSR, a novel RSR framework that jointly models semantic information and introduces instance-level feature alignment. Specifically, we employ low-resolution (LR) images as global consistency guidance while jointly modeling image data and semantic segmentation maps to enforce semantic relevance during sampling. Moreover, we design an instance representation learning module to align the diffusion latent space with the instance latent space, enabling instance-aware feature alignment, and further incorporate a scale alignment mechanism to enhance fine-grained perception and detail recovery. Benefiting from these designs, our approach not only generates photorealistic details but also preserves semantic consistency at the instance level. Extensive experiments on multiple real-world benchmarks demonstrate that InstanceRSR significantly outperforms existing methods in both quantitative metrics and visual quality, achieving new state-of-the-art (SOTA) performance.
• 摘要：现有的基于生成先验的现实世界超分辨率（RSR）方法在产生高质量和全局一致的重建方面取得了显着的进展。然而，他们经常难以恢复复杂现实场景中不同对象实例的细粒度细节。这种限制主要是因为普遍采用的去噪损失（例如 MSE）本质上有利于全局一致性，而忽略了实例级感知和恢复。为了解决这个问题，我们提出了 InstanceRSR，这是一种新颖的 RSR 框架，它联合建模语义信息并引入实例级特征对齐。具体来说，我们采用低分辨率（LR）图像作为全局一致性指导，同时联合建模图像数据和语义分割图以在采样过程中增强语义相关性。此外，我们设计了一个实例表示学习模块，将扩散潜在空间与实例潜在空间对齐，实现实例感知特征对齐，并进一步结合尺度对齐机制来增强细粒度感知和细节恢复。受益于这些设计，我们的方法不仅生成逼真的细节，而且在实例级别保持语义一致性。对多个现实世界基准的大量实验表明，InstanceRSR 在定量指标和视觉质量方面均显着优于现有方法，实现了新的最先进 (SOTA) 性能。

Title: Embracing Heteroscedasticity for Probabilistic Time Series Forecasting

• Authors: Yijun Wang, Qiyuan Zhuang, Xiu-Shen Wei
• Subjects: cs.LG, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.24254
• Pdf URL: https://arxiv.org/pdf/2603.24254
• Copy Paste: [[2603.24254]] Embracing Heteroscedasticity for Probabilistic Time Series Forecasting(https://arxiv.org/abs/2603.24254)
• Keywords: generative
• Abstract: Probabilistic time series forecasting (PTSF) aims to model the full predictive distribution of future observations, enabling both accurate forecasting and principled uncertainty quantification. A central requirement of PTSF is to embrace heteroscedasticity, as real-world time series exhibit time-varying conditional variances induced by nonstationary dynamics, regime changes, and evolving external conditions. However, most existing non-autoregressive generative approaches to PTSF, such as TimeVAE and $K^2$VAE, rely on MSE-based training objectives that implicitly impose a homoscedastic assumption, thereby fundamentally limiting their ability to model temporal heteroscedasticity. To address this limitation, we propose the Location-Scale Gaussian VAE (LSG-VAE), a simple but effective framework that explicitly parameterizes both the predictive mean and time-dependent variance through a location-scale likelihood formulation. This design enables LSG-VAE to faithfully capture heteroscedastic aleatoric uncertainty and introduces an adaptive attenuation mechanism that automatically down-weights highly volatile observations during training, leading to improved robustness in trend prediction. Extensive experiments on nine benchmark datasets demonstrate that LSG-VAE consistently outperforms fifteen strong generative baselines while maintaining high computational efficiency suitable for real-time deployment.
• 摘要：概率时间序列预测 (PTSF) 旨在对未来观测的完整预测分布进行建模，从而实现准确的预测和有原则的不确定性量化。 PTSF 的核心要求是接受异方差性，因为现实世界的时间序列表现出由非平稳动态、状态变化和不断变化的外部条件引起的时变条件方差。然而，大多数现有的 PTSF 非自回归生成方法（例如 TimeVAE 和 $K^2$VAE）依赖于基于 MSE 的训练目标，这些目标隐含地强加了同方差假设，从而从根本上限制了它们对时间异方差性进行建模的能力。为了解决这个限制，我们提出了位置尺度高斯 VAE (LSG-VAE)，这是一个简单但有效的框架，通过位置尺度似然公式显式参数化预测平均值和时间相关方差。这种设计使 LSG-VAE 能够忠实地捕获异方差任意不确定性，并引入自适应衰减机制，在训练期间自动降低高度波动性观测值的权重，从而提高趋势预测的鲁棒性。对九个基准数据集的广泛实验表明，LSG-VAE 始终优于 15 个强大的生成基线，同时保持适合实时部署的高计算效率。

Title: Accelerating Diffusion-based Video Editing via Heterogeneous Caching: Beyond Full Computing at Sampled Denoising Timestep

• Authors: Tianyi Liu, Ye Lu, Linfeng Zhang, Chen Cai, Jianjun Gao, Yi Wang, Kim-Hui Yap, Lap-Pui Chau
• Subjects: cs.CV, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.24260
• Pdf URL: https://arxiv.org/pdf/2603.24260
• Copy Paste: [[2603.24260]] Accelerating Diffusion-based Video Editing via Heterogeneous Caching: Beyond Full Computing at Sampled Denoising Timestep(https://arxiv.org/abs/2603.24260)
• Keywords: generation, generative
• Abstract: Diffusion-based video editing has emerged as an important paradigm for high-quality and flexible content generation. However, despite their generality and strong modeling capacity, Diffusion Transformers (DiT) remain computationally expensive due to the iterative denoising process, posing challenges for practical deployment. Existing video diffusion acceleration methods primarily exploit denoising timestep-level feature reuse, which mitigates the redundancy in denoising process, but overlooks the architectural redundancy within the DiT that many attention operations over spatio-temporal tokens are redundantly executed, offering little to no incremental contribution to the model output. This work introduces HetCache, a training-free diffusion acceleration framework designed to exploit the inherent heterogeneity in diffusion-based masked video-to-video (MV2V) generation and editing. Instead of uniformly reuse or randomly sampling tokens, HetCache assesses the contextual relevance and interaction strength among various types of tokens in designated computing steps. Guided by spatial priors, it divides the spatial-temporal tokens in DiT model into context and generative tokens, and selectively caches the context tokens that exhibit the strongest correlation and most representative semantics with generative ones. This strategy reduces redundant attention operations while maintaining editing consistency and fidelity. Experiments show that HetCache achieves a noticeable acceleration, including a 2.67$\times$ latency speedup and FLOPs reduction over commonly used foundation models, with negligible degradation in editing quality.
• 摘要：基于扩散的视频编辑已成为高质量和灵活内容生成的重要范例。然而，尽管扩散变压器（DiT）具有通用性和强大的建模能力，但由于迭代去噪过程，计算成本仍然很高，这给实际部署带来了挑战。现有的视频扩散加速方法主要利用去噪时间步级特征重用，这减轻了去噪过程​​中的冗余，但忽略了 DiT 中的架构冗余，即许多时空标记上的注意力操作都是冗余执行的，对模型输出几乎没有增量贡献。这项工作引入了 HetCache，这是一种免训练的扩散加速框架，旨在利用基于扩散的蒙版视频到视频 (MV2V) 生成和编辑中固有的异构性。 HetCache不是统一重用或随机采样令牌，而是在指定的计算步骤中评估各种类型令牌之间的上下文相关性和交互强度。在空间先验的指导下，它将DiT模型中的时空标记分为上下文标记和生成标记，并选择性地缓存与生成标记表现出最强相关性和最具代表性语义的上下文标记。该策略减少了冗余的注意力操作，同时保持了编辑的一致性和保真度。实验表明，与常用的基础模型相比，HetCache 实现了显着的加速，包括 2.67$\times$ 的延迟加速和 FLOP 减少，而编辑质量的下降可以忽略不计。

Title: ScrollScape: Unlocking 32K Image Generation With Video Diffusion Priors

• Authors: Haodong Yu, Yabo Zhang, Donglin Di, Ruyi Zhang, Wangmeng Zuo
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.24270
• Pdf URL: https://arxiv.org/pdf/2603.24270
• Copy Paste: [[2603.24270]] ScrollScape: Unlocking 32K Image Generation With Video Diffusion Priors(https://arxiv.org/abs/2603.24270)
• Keywords: super-resolution, generation
• Abstract: While diffusion models excel at generating images with conventional dimensions, pushing them to synthesize ultra-high-resolution imagery at extreme aspect ratios (EAR) often triggers catastrophic structural failures, such as object repetition and spatial this http URL limitation fundamentally stems from a lack of robust spatial priors, as static text-to-image models are primarily trained on image distributions with conventional this http URL overcome this bottleneck, we present ScrollScape, a novel framework that reformulates EAR image synthesis into a continuous video generation process through two core this http URL mapping the spatial expansion of a massive canvas to the temporal evolution of video frames, ScrollScape leverages the inherent temporal consistency of video models as a powerful global constraint to ensure long-range structural this http URL, Scanning Positional Encoding (ScanPE) distributes global coordinates across frames to act as a flexible moving camera, while Scrolling Super-Resolution (ScrollSR) leverages video super-resolution priors to circumvent memory bottlenecks, efficiently scaling outputs to an unprecedented 32K resolution. Fine-tuned on a curated 3K multi-ratio image dataset, ScrollScape effectively aligns pre-trained video priors with the EAR generation task. Extensive evaluations demonstrate that it significantly outperforms existing image-diffusion baselines by eliminating severe localized artifacts. Consequently, our method overcomes inherent structural bottlenecks to ensure exceptional global coherence and visual fidelity across diverse domains at extreme scales.
• 摘要：虽然扩散模型擅长生成传统尺寸的图像，但推动它们以极端纵横比 (EAR) 合成超高分辨率图像通常会引发灾难性的结构故障，例如对象重复和空间性。此 http URL 限制从根本上源于缺乏强大的空间先验，因为静态文本到图像模型主要在图像分布上进行训练，而传统此 http URL 克服了这一瓶颈。我们提出了 ScrollScape，这是一种新颖的框架，它通过两个核心将 EAR 图像合成重新表述为连续视频生成过程该http URL将大规模画布的空间扩展映射到视频帧的时间演变，ScrollScape利用视频模型固有的时间一致性作为强大的全局约束，以确保该http URL的远程结构，扫描位置编码（ScanPE）跨帧分配全局坐标以充当灵活的移动摄像机，而滚动超分辨率（ScrollSR）则利用视频超分辨率先验来规避内存瓶颈，有效地将输出缩放到前所未有的32K分辨率。 ScrollScape 在精选的 3K 多比例图像数据集上进行了微调，有效地将预训练的视频先验与 EAR 生成任务保持一致。广泛的评估表明，它消除了严重的局部伪影，显着优于现有的图像扩散基线。因此，我们的方法克服了固有的结构瓶颈，以确保在极端规模下跨不同领域的卓越的全局一致性和视觉保真度。

Title: TopoMesh: High-Fidelity Mesh Autoencoding via Topological Unification

• Authors: Guan Luo, Xiu Li, Rui Chen, Xuanyu Yi, Jing Lin, Chia-Hao Chen, Jiahang Liu, Song-Hai Zhang, Jianfeng Zhang
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.24278
• Pdf URL: https://arxiv.org/pdf/2603.24278
• Copy Paste: [[2603.24278]] TopoMesh: High-Fidelity Mesh Autoencoding via Topological Unification(https://arxiv.org/abs/2603.24278)
• Keywords: generation
• Abstract: The dominant paradigm for high-fidelity 3D generation relies on a VAE-Diffusion pipeline, where the VAE's reconstruction capability sets a firm upper bound on generation quality. A fundamental challenge limiting existing VAEs is the representation mismatch between ground-truth meshes and network predictions: GT meshes have arbitrary, variable topology, while VAEs typically predict fixed-structure implicit fields (\eg, SDF on regular grids). This inherent misalignment prevents establishing explicit mesh-level correspondences, forcing prior work to rely on indirect supervision signals such as SDF or rendering losses. Consequently, fine geometric details, particularly sharp features, are poorly preserved during reconstruction. To address this, we introduce TopoMesh, a sparse voxel-based VAE that unifies both GT and predicted meshes under a shared Dual Marching Cubes (DMC) topological framework. Specifically, we convert arbitrary input meshes into DMC-compliant representations via a remeshing algorithm that preserves sharp edges using an L$\infty$ distance metric. Our decoder outputs meshes in the same DMC format, ensuring that both predicted and target meshes share identical topological structures. This establishes explicit correspondences at the vertex and face level, allowing us to derive explicit mesh-level supervision signals for topology, vertex positions, and face orientations with clear gradients. Our sparse VAE architecture employs this unified framework and is trained with Teacher Forcing and progressive resolution training for stable and efficient convergence. Extensive experiments demonstrate that TopoMesh significantly outperforms existing VAEs in reconstruction fidelity, achieving superior preservation of sharp features and geometric details.
• 摘要：高保真 3D 生成的主导范例依赖于 VAE-Diffusion 管道，其中 VAE 的重建能力为生成质量设定了严格的上限。限制现有 VAE 的一个基本挑战是真实网格和网络预测之间的表示不匹配：GT 网格具有任意的可变拓扑，而 VAE 通常预测固定结构的隐式场（例如，规则网格上的 SDF）。这种固有的错位阻止了建立明确的网格级对应关系，迫使之前的工作依赖于间接监督信号，例如 SDF 或渲染损失。因此，在重建过程中，精细的几何细节，特别是锐利的特征，很难保留。为了解决这个问题，我们引入了 TopoMesh，这是一种基于稀疏体素的 VAE，它在共享的双行进立方体 (DMC) 拓扑框架下统一了 GT 和预测网格。具体来说，我们通过重新网格划分算法将任意输入网格转换为符合 DMC 的表示，该算法使用 L$\infty$ 距离度量保留锐利边缘。我们的解码器以相同的 DMC 格式输出网格，确保预测网格和目标网格共享相同的拓扑结构。这在顶点和面级别建立了明确的对应关系，使我们能够为拓扑、顶点位置和具有清晰梯度的面方向导出明确的网格级别监督信号。我们的稀疏 VAE 架构采用了这个统一的框架，并通过教师强制和渐进分辨率训练进行训练，以实现稳定和高效的收敛。大量实验表明，TopoMesh 在重建保真度方面显着优于现有的 VAE，实现了清晰特征和几何细节的出色保留。

Title: Large Language Model Guided Incentive Aware Reward Design for Cooperative Multi-Agent Reinforcement Learning

• Authors: Dogan Urgun, Gokhan Gungor
• Subjects: cs.LG, cs.AI, eess.SY
• Abstract URL: https://arxiv.org/abs/2603.24324
• Pdf URL: https://arxiv.org/pdf/2603.24324
• Copy Paste: [[2603.24324]] Large Language Model Guided Incentive Aware Reward Design for Cooperative Multi-Agent Reinforcement Learning(https://arxiv.org/abs/2603.24324)
• Keywords: generation
• Abstract: Designing effective auxiliary rewards for cooperative multi-agent systems remains a precarious task; misaligned incentives risk inducing suboptimal coordination, especially where sparse task feedback fails to provide sufficient grounding. This study introduces an automated reward design framework that leverages large language models to synthesize executable reward programs from environment instrumentation. The procedure constrains candidate programs within a formal validity envelope and evaluates their efficacy by training policies from scratch under a fixed computational budget; selection depends exclusively on the sparse task return. The framework is evaluated across four distinct Overcooked-AI layouts characterized by varied corridor congestion, handoff dependencies, and structural asymmetries. Iterative search generations consistently yield superior task returns and delivery counts, with the most pronounced gains occurring in environments dominated by interaction bottlenecks. Diagnostic analysis of the synthesized shaping components indicates increased interdependence in action selection and improved signal alignment in coordination-intensive tasks. These results demonstrate that the search for objectivegrounded reward programs can mitigate the burden of manual engineering while producing shaping signals compatible with cooperative learning under finite budgets.
• 摘要：为协作多智能体系统设计有效的辅助奖励仍然是一项不稳定的任务；不一致的激励措施可能会导致协调不佳，尤其是在稀疏的任务反馈无法提供足够基础的情况下。这项研究引入了一种自动化奖励设计框架，该框架利用大型语言模型从环境仪器中合成可执行的奖励程序。该程序将候选程序限制在正式的有效性范围内，并通过在固定的计算预算下从头开始训练策略来评估其功效；选择完全取决于稀疏任务的返回。该框架通过四种不同的 Overcooked-AI 布局进行评估，其特点是不同的走廊拥堵、切换依赖性和结构不对称。迭代搜索一代始终会产生出色的任务返回和交付计​​数，其中最明显的收益发生在交互瓶颈占主导地位的环境中。对合成塑造成分的诊断分析表明，动作选择中的相互依赖性增加，协调密集型任务中的信号对齐得到改善。这些结果表明，寻找客观的奖励计划可以减轻手动工程的负担，同时产生与有限预算下的合作学习兼容的塑造信号。

Title: GeoRouter: Dynamic Paradigm Routing for Worldwide Image Geolocalization

• Authors: Pengyue Jia, Derong Xu, Yingyi Zhang, Xiaopeng Li, Wenlin Zhang, Yi Wen, Yuanshao Zhu, Xiangyu Zhao
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.24376
• Pdf URL: https://arxiv.org/pdf/2603.24376
• Copy Paste: [[2603.24376]] GeoRouter: Dynamic Paradigm Routing for Worldwide Image Geolocalization(https://arxiv.org/abs/2603.24376)
• Keywords: generation
• Abstract: Worldwide image geolocalization aims to predict precise GPS coordinates for images captured anywhere on Earth, which is challenging due to the large visual and geographic diversity. Recent methods mainly follow two paradigms: retrieval-based approaches that match queries against a reference database, and generation-based approaches that directly predict coordinates using Large Vision-Language Models (LVLMs). However, we observe distinct error profiles between them: retrieval excels at fine-grained instance matching, while generation offers robust semantic reasoning. This complementary heterogeneity suggests that no single paradigm is universally superior. To harness this potential, we propose GeoRouter, a dynamic routing framework that adaptively assigns each query to the optimal paradigm. GeoRouter leverages an LVLM backbone to analyze visual content and provide routing decisions. To optimize GeoRouter, we introduce a distance-aware preference objective that converts the distance gap between paradigms into a continuous supervision signal, explicitly reflecting relative performance differences. Furthermore, we construct GeoRouting, the first large-scale dataset tailored for training routing policies with independent paradigm predictions. Extensive experiments on IM2GPS3k and YFCC4k demonstrate that GeoRouter significantly outperforms state-of-the-art baselines.
• 摘要：全球图像地理定位旨在预测地球上任何地方捕获的图像的精确 GPS 坐标，由于视觉和地理多样性，这具有挑战性。最近的方法主要遵循两种范例：将查询与参考数据库进行匹配的基于检索的方法，以及使用大型视觉语言模型（LVLM）直接预测坐标的基于生成的方法。然而，我们观察到它们之间存在不同的错误概况：检索擅长细粒度实例匹配，而生成则提供强大的语义推理。这种互补的异质性表明，没有任何单一范式是普遍优越的。为了利用这种潜力，我们提出了 GeoRouter，这是一种动态路由框架，可以自适应地将每个查询分配给最佳范例。 GeoRouter 利用 LVLM 主干来分析视觉内容并提供路由决策。为了优化 GeoRouter，我们引入了距离感知偏好目标，将范式之间的距离差距转换为连续的监督信号，明确反映相对性能差异。此外，我们构建了 GeoRouting，这是第一个为训练具有独立范式预测的路由策略而定制的大规模数据集。 IM2GPS3k 和 YFCC4k 上的大量实验表明，GeoRouter 的性能显着优于最先进的基线。

Title: ViHOI: Human-Object Interaction Synthesis with Visual Priors

• Authors: Songjin Cai, Linjie Zhong, Ling Guo, Changxing Ding
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.24383
• Pdf URL: https://arxiv.org/pdf/2603.24383
• Copy Paste: [[2603.24383]] ViHOI: Human-Object Interaction Synthesis with Visual Priors(https://arxiv.org/abs/2603.24383)
• Keywords: generation, generative
• Abstract: Generating realistic and physically plausible 3D Human-Object Interactions (HOI) remains a key challenge in motion generation. One primary reason is that describing these physical constraints with words alone is difficult. To address this limitation, we propose a new paradigm: extracting rich interaction priors from easily accessible 2D images. Specifically, we introduce ViHOI, a novel framework that enables diffusion-based generative models to leverage rich, task-specific priors from 2D images to enhance generation quality. We utilize a large Vision-Language Model (VLM) as a powerful prior-extraction engine and adopt a layer-decoupled strategy to obtain visual and textual priors. Concurrently, we design a Q-Former-based adapter that compresses the VLM's high-dimensional features into compact prior tokens, which significantly facilitates the conditional training of our diffusion model. Our framework is trained on motion-rendered images from the dataset to ensure strict semantic alignment between visual inputs and motion sequences. During inference, it leverages reference images synthesized by a text-to-image generation model to improve generalization to unseen objects and interaction categories. Experimental results demonstrate that ViHOI achieves state-of-the-art performance, outperforming existing methods across multiple benchmarks and demonstrating superior generalization.
• 摘要：生成逼真且物理上合理的 3D 人机交互 (HOI) 仍然是运动生成中的一个关键挑战。一个主要原因是仅用语言描述这些物理限制是很困难的。为了解决这个限制，我们提出了一种新的范例：从易于访问的 2D 图像中提取丰富的交互先验。具体来说，我们引入了 ViHOI，这是一种新颖的框架，使基于扩散的生成模型能够利用 2D 图像中丰富的、特定于任务的先验来提高生成质量。我们利用大型视觉语言模型（VLM）作为强大的先验提取引擎，并采用层解耦策略来获取视觉和文本先验。同时，我们设计了一个基于 Q-Former 的适配器，将 VLM 的高维特征压缩为紧凑的先验标记，这极大地促进了扩散模型的条件训练。我们的框架根据数据集中的运动渲染图像进行训练，以确保视觉输入和运动序列之间严格的语义对齐。在推理过程中，它利用文本到图像生成模型合成的参考图像来改进对未见过的对象和交互类别的泛化。实验结果表明，ViHOI 实现了最先进的性能，在多个基准测试中优于现有方法，并展示了卓越的泛化能力。

Title: Teacher-Student Diffusion Model for Text-Driven 3D Hand Motion Generation

• Authors: Ching-Lam Cheng, Bin Zhu, Shengfeng He
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.24407
• Pdf URL: https://arxiv.org/pdf/2603.24407
• Copy Paste: [[2603.24407]] Teacher-Student Diffusion Model for Text-Driven 3D Hand Motion Generation(https://arxiv.org/abs/2603.24407)
• Keywords: generation
• Abstract: Generating realistic 3D hand motion from natural language is vital for VR, robotics, and human-computer interaction. Existing methods either focus on full-body motion, overlooking detailed hand gestures, or require explicit 3D object meshes, limiting generality. We propose TSHaMo, a model-agnostic teacher-student diffusion framework for text-driven hand motion generation. The student model learns to synthesize motions from text alone, while the teacher leverages auxiliary signals (e.g., MANO parameters) to provide structured guidance during training. A co-training strategy enables the student to benefit from the teacher's intermediate predictions while remaining text-only at inference. Evaluated using two diffusion backbones on GRAB and H2O, TSHaMo consistently improves motion quality and diversity. Ablations confirm its robustness and flexibility in using diverse auxiliary inputs without requiring 3D objects at test time.
• 摘要：从自然语言生成逼真的 3D 手部动作对于 VR、机器人和人机交互至关重要。现有方法要么专注于全身运动，忽略详细的手势，要么需要显式的 3D 对象网格，从而限制了通用性。我们提出了 TSHaMo，一种与模型无关的师生扩散框架，用于文本驱动的手部动作生成。学生模型学习仅从文本合成运动，而教师则利用辅助信号（例如 MANO 参数）在训练期间提供结构化指导。协同训练策略使学生能够从教师的中间预测中受益，同时在推理时保持纯文本。使用 GRAB 和 H2O 上的两个扩散主干进行评估，TSHaMo 持续提高运动质量和多样性。消融证实了其在使用不同辅助输入方面的稳健性和灵活性，而在测试时不需要 3D 对象。

Title: Marchuk: Efficient Global Weather Forecasting from Mid-Range to Sub-Seasonal Scales via Flow Matching

• Authors: Arsen Kuzhamuratov, Mikhail Zhirnov, Andrey Kuznetsov, Ivan Oseledets, Konstantin Sobolev
• Subjects: cs.LG
• Abstract URL: https://arxiv.org/abs/2603.24428
• Pdf URL: https://arxiv.org/pdf/2603.24428
• Copy Paste: [[2603.24428]] Marchuk: Efficient Global Weather Forecasting from Mid-Range to Sub-Seasonal Scales via Flow Matching(https://arxiv.org/abs/2603.24428)
• Keywords: generative
• Abstract: Accurate subseasonal weather forecasting remains a major challenge due to the inherently chaotic nature of the atmosphere, which limits the predictive skill of conventional models beyond the mid-range horizon (approximately 15 days). In this work, we present \textit{Marchuk}, a generative latent flow-matching model for global weather forecasting spanning mid-range to subseasonal timescales, with prediction horizons of up to 30 days. Marchuk conditions on current-day weather maps and autoregressively predicts subsequent days' weather maps within the learned latent space. We replace rotary positional encodings (RoPE) with trainable positional embeddings and extend the temporal context window, which together enhance the model's ability to represent and propagate long-range temporal dependencies during latent forecasting. Marchuk offers two key advantages: high computational efficiency and strong predictive performance. Despite its compact architecture of only 276 million parameters, the model achieves performance comparable to LaDCast, a substantially larger model with 1.6 billion parameters, while operating at significantly higher inference speeds. We open-source our inference code and model at: this https URL
• 摘要：由于大气固有的混乱性质，准确的次季节天气预报仍然是一个重大挑战，这限制了传统模型在中期范围（大约 15 天）之外的预测能力。在这项工作中，我们提出了 \textit{Marchuk}，这是一种用于全球天气预报的生成潜在流匹配模型，涵盖中范围到次季节时间尺度，预测范围长达 30 天。 Marchuk 在当前天气地图上条件，并在学习的潜在空间内自回归预测随后几天的天气地图。我们用可训练的位置嵌入替换旋转位置编码（RoPE），并扩展时间上下文窗口，这共同增强了模型在潜在预测期间表示和传播远程时间依赖性的能力。 Marchuk 具有两个关键优势：高计算效率和强大的预测性能。尽管其架构紧凑，仅包含 2.76 亿个参数，但该模型的性能可与 LaDCast（具有 16 亿个参数的更大模型）相媲美，同时运行推理速度也显着提高。我们在以下位置开源我们的推理代码和模型：此 https URL

Title: Unleashing Vision-Language Semantics for Deepfake Video Detection

• Authors: Jiawen Zhu, Yunqi Miao, Xueyi Zhang, Jiankang Deng, Guansong Pang
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.24454
• Pdf URL: https://arxiv.org/pdf/2603.24454
• Copy Paste: [[2603.24454]] Unleashing Vision-Language Semantics for Deepfake Video Detection(https://arxiv.org/abs/2603.24454)
• Keywords: generation
• Abstract: Recent Deepfake Video Detection (DFD) studies have demonstrated that pre-trained Vision-Language Models (VLMs) such as CLIP exhibit strong generalization capabilities in detecting artifacts across different identities. However, existing approaches focus on leveraging visual features only, overlooking their most distinctive strength -- the rich vision-language semantics embedded in the latent space. We propose VLAForge, a novel DFD framework that unleashes the potential of such cross-modal semantics to enhance model's discriminability in deepfake detection. This work i) enhances the visual perception of VLM through a ForgePerceiver, which acts as an independent learner to capture diverse, subtle forgery cues both granularly and holistically, while preserving the pretrained Vision-Language Alignment (VLA) knowledge, and ii) provides a complementary discriminative cue -- Identity-Aware VLA score, derived by coupling cross-modal semantics with the forgery cues learned by ForgePerceiver. Notably, the VLA score is augmented by an identity prior-informed text prompting to capture authenticity cues tailored to each identity, thereby enabling more discriminative cross-modal semantics. Comprehensive experiments on video DFD benchmarks, including classical face-swapping forgeries and recent full-face generation forgeries, demonstrate that our VLAForge substantially outperforms state-of-the-art methods at both frame and video levels. Code is available at this https URL.
• 摘要：最近的 Deepfake 视频检测 (DFD) 研究表明，预训练的视觉语言模型 (VLM)（例如 CLIP）在检测不同身份的伪影方面表现出强大的泛化能力。然而，现有的方法仅专注于利用视觉特征，忽视了它们最独特的优势——嵌入潜在空间的丰富的视觉语言语义。我们提出了 VLAForge，一种新颖的 DFD 框架，它释放了这种跨模态语义的潜力，以增强模型在深度伪造检测中的辨别能力。这项工作 i) 通过 ForgePerceiver 增强 VLM 的视觉感知，ForgePerceiver 充当独立学习器，从粒度和整体角度捕获各种微妙的伪造线索，同时保留预先训练的视觉语言对齐 (VLA) 知识，ii) 提供补充的判别线索——身份感知 VLA 分数，通过将跨模态语义与 ForgePerceiver 学习的伪造线索相结合而得出。值得注意的是，VLA 分数通过身份先验文本得到增强，提示捕获针对每个身份定制的真实性线索，从而实现更具辨别力的跨模式语义。对视频 DFD 基准的综合实验，包括经典的换脸伪造和最近的全脸生成伪造，表明我们的 VLAForge 在帧和视频级别上都远远优于最先进的方法。代码可从此 https URL 获取。

Title: OmniWeaving: Towards Unified Video Generation with Free-form Composition and Reasoning

• Authors: Kaihang Pan, Qi Tian, Jianwei Zhang, Weijie Kong, Jiangfeng Xiong, Yanxin Long, Shixue Zhang, Haiyi Qiu, Tan Wang, Zheqi Lv, Yue Wu, Liefeng Bo, Siliang Tang, Zhao Zhong
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.24458
• Pdf URL: https://arxiv.org/pdf/2603.24458
• Copy Paste: [[2603.24458]] OmniWeaving: Towards Unified Video Generation with Free-form Composition and Reasoning(https://arxiv.org/abs/2603.24458)
• Keywords: generation
• Abstract: While proprietary systems such as Seedance-2.0 have achieved remarkable success in omni-capable video generation, open-source alternatives significantly lag behind. Most academic models remain heavily fragmented, and the few existing efforts toward unified video generation still struggle to seamlessly integrate diverse tasks within a single framework. To bridge this gap, we propose OmniWeaving, an omni-level video generation model featuring powerful multimodal composition and reasoning-informed capabilities. By leveraging a massive-scale pretraining dataset that encompasses diverse compositional and reasoning-augmented scenarios, OmniWeaving learns to temporally bind interleaved text, multi-image, and video inputs while acting as an intelligent agent to infer complex user intentions for sophisticated video creation. Furthermore, we introduce IntelligentVBench, the first comprehensive benchmark designed to rigorously assess next-level intelligent unified video generation. Extensive experiments demonstrate that OmniWeaving achieves SoTA performance among open-source unified models. The codes and model will be made publicly available soon. Project Page: this https URL.
• 摘要：虽然 Seedance-2.0 等专有系统在全功能视频生成方面取得了显着的成功，但开源替代方案却明显落后。大多数学术模型仍然严重分散，并且现有的少数统一视频生成的努力仍然难以将不同的任务无缝集成到一个框架内。为了弥补这一差距，我们提出了 OmniWeaving，这是一种全方位视频生成模型，具有强大的多模态合成和推理能力。通过利用包含不同组合和推理增强场景的大规模预训练数据集，OmniWeaving 学会暂时绑定交错文本、多图像和视频输入，同时充当智能代理来推断复杂的用户意图以进行复杂的视频创建。此外，我们还推出了IntelligentVBench，这是第一个旨在严格评估下一代智能统一视频生成的综合基准测试。大量实验表明，OmniWeaving 在开源统一模型中实现了 SoTA 性能。代码和模型将很快公开。项目页面：此 https URL。

Title: Video-Only ToM: Enhancing Theory of Mind in Multimodal Large Language Models

• Authors: Siqi Liu, Xinyang Li, Bochao Zou, Junbao Zhuo, Huimin Ma, Jiansheng Chen
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.24484
• Pdf URL: https://arxiv.org/pdf/2603.24484
• Copy Paste: [[2603.24484]] Video-Only ToM: Enhancing Theory of Mind in Multimodal Large Language Models(https://arxiv.org/abs/2603.24484)
• Keywords: generation
• Abstract: As large language models (LLMs) continue to advance, there is increasing interest in their ability to infer human mental states and demonstrate a human-like Theory of Mind (ToM). Most existing ToM evaluations, however, are centered on text-based inputs, while scenarios relying solely on visual information receive far less attention. This leaves a gap, since real-world human-AI interaction typically requires multimodal understanding. In addition, many current methods regard the model as a black box and rarely probe how its internal attention behaves in multiple-choice question answering (QA). The impact of LLM hallucinations on such tasks is also underexplored from an interpretability perspective. To address these issues, we introduce VisionToM, a vision-oriented intervention framework designed to strengthen task-aware reasoning. The core idea is to compute intervention vectors that align visual representations with the correct semantic targets, thereby steering the model's attention through different layers of visual features. This guidance reduces the model's reliance on spurious linguistic priors, leading to more reliable multimodal language model (MLLM) outputs and better QA performance. Experiments on the EgoToM benchmark-an egocentric, real-world video dataset for ToM with three multiple-choice QA settings-demonstrate that our method substantially improves the ToM abilities of MLLMs. Furthermore, results on an additional open-ended generation task show that VisionToM enables MLLMs to produce free-form explanations that more accurately capture agents' mental states, pushing machine-human collaboration toward greater alignment.
• 摘要：随着大型语言模型 (LLM) 的不断发展，人们对其推断人类心理状态和展示类人心理理论 (ToM) 的能力越来越感兴趣。然而，大多数现有的 ToM 评估都以基于文本的输入为中心，而仅依赖视觉信息的场景受到的关注要少得多。这留下了一个空白，因为现实世界的人机交互通常需要多模式理解。此外，当前的许多方法将模型视为黑匣子，很少探究其内部注意力在多项选择题回答（QA）中的表现。从可解释性的角度来看，法学硕士幻觉对此类任务的影响也尚未得到充分探索。为了解决这些问题，我们引入了 VisionToM，这是一个面向视觉的干预框架，旨在加强任务感知推理。核心思想是计算将视觉表示与正确的语义目标对齐的干预向量，从而通过不同层的视觉特征引导模型的注意力。该指南减少了模型对虚假语言先验的依赖，从而获得更可靠的多模态语言模型 (MLLM) 输出和更好的 QA 性能。 EgoToM 基准测试（一个以自我为中心的现实世界视频数据集，具有三个多项选择 QA 设置）表明我们的方法大大提高了 MLLM 的 ToM 能力。此外，一项额外的开放式生成任务的结果表明，VisionToM 使 MLLM 能够生成自由形式的解释，从而更准确地捕获智能体的心理状态，从而推动机器与人类的协作更加一致。

Title: Project and Generate: Divergence-Free Neural Operators for Incompressible Flows

• Authors: Xigui Li, Hongwei Zhang, Ruoxi Jiang, Deshu Chen, Chensen Lin, Limei Han, Yuan Qi, Xin Guo, Yuan Cheng
• Subjects: cs.LG, physics.flu-dyn
• Abstract URL: https://arxiv.org/abs/2603.24500
• Pdf URL: https://arxiv.org/pdf/2603.24500
• Copy Paste: [[2603.24500]] Project and Generate: Divergence-Free Neural Operators for Incompressible Flows(https://arxiv.org/abs/2603.24500)
• Keywords: generative
• Abstract: Learning-based models for fluid dynamics often operate in unconstrained function spaces, leading to physically inadmissible, unstable simulations. While penalty-based methods offer soft regularization, they provide no structural guarantees, resulting in spurious divergence and long-term collapse. In this work, we introduce a unified framework that enforces the incompressible continuity equation as a hard, intrinsic constraint for both deterministic and generative modeling. First, to project deterministic models onto the divergence-free subspace, we integrate a differentiable spectral Leray projection grounded in the Helmholtz-Hodge decomposition, which restricts the regression hypothesis space to physically admissible velocity fields. Second, to generate physically consistent distributions, we show that simply projecting model outputs is insufficient when the prior is incompatible. To address this, we construct a divergence-free Gaussian reference measure via a curl-based pushforward, ensuring the entire probability flow remains subspace-consistent by construction. Experiments on 2D Navier-Stokes equations demonstrate exact incompressibility up to discretization error and substantially improved stability and physical consistency.
• 摘要：基于学习的流体动力学模型通常在不受约束的函数空间中运行，导致物理上不允许的、不稳定的模拟。虽然基于惩罚的方法提供了软正则化，但它们不提供结构保证，从而导致虚假分歧和长期崩溃。在这项工作中，我们引入了一个统一的框架，该框架强制将不可压缩连续性方程作为确定性和生成建模的硬性内在约束。首先，为了将确定性模型投影到无散子空间上，我们集成了基于亥姆霍兹-霍奇分解的可微谱 Leray 投影，该投影将回归假设空间限制为物理上允许的速度场。其次，为了生成物理上一致的分布，我们表明，当先验不相容时，简单地投影模型输出是不够的。为了解决这个问题，我们通过基于旋度的前推构造了一个无散高斯参考测度，确保整个概率流通过构造保持子空间一致。二维纳维-斯托克斯方程的实验证明了在离散误差范围内的精确不可压缩性，并显着提高了稳定性和物理一致性。

Title: Toward Physically Consistent Driving Video World Models under Challenging Trajectories

• Authors: Jiawei Zhou, Zhenxin Zhu, Lingyi Du, Linye Lyu, Lijun Zhou, Zhanqian Wu, Hongcheng Luo, Zhuotao Tian, Bing Wang, Guang Chen, Hangjun Ye, Haiyang Sun, Yu Li
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.24506
• Pdf URL: https://arxiv.org/pdf/2603.24506
• Copy Paste: [[2603.24506]] Toward Physically Consistent Driving Video World Models under Challenging Trajectories(https://arxiv.org/abs/2603.24506)
• Keywords: generation
• Abstract: Video generation models have shown strong potential as world models for autonomous driving simulation. However, existing approaches are primarily trained on real-world driving datasets, which mostly contain natural and safe driving scenarios. As a result, current models often fail when conditioned on challenging or counterfactual trajectories-such as imperfect trajectories generated by simulators or planning systems-producing videos with severe physical inconsistencies and artifacts. To address this limitation, we propose PhyGenesis, a world model designed to generate driving videos with high visual fidelity and strong physical consistency. Our framework consists of two key components: (1) a physical condition generator that transforms potentially invalid trajectory inputs into physically plausible conditions, and (2) a physics-enhanced video generator that produces high-fidelity multi-view driving videos under these conditions. To effectively train these components, we construct a large-scale, physics-rich heterogeneous dataset. Specifically, in addition to real-world driving videos, we generate diverse challenging driving scenarios using the CARLA simulator, from which we derive supervision signals that guide the model to learn physically grounded dynamics under extreme conditions. This challenging-trajectory learning strategy enables trajectory correction and promotes physically consistent video generation. Extensive experiments demonstrate that PhyGenesis consistently outperforms state-of-the-art methods, especially on challenging trajectories. Our project page is available at: this https URL.
• 摘要：视频生成模型作为自动驾驶模拟的世界模型已显示出强大的潜力。然而，现有的方法主要是在现实世界的驾驶数据集上进行训练，这些数据集大多包含自然和安全的驾驶场景。因此，当前的模型在遇到具有挑战性或反事实的轨迹（例如模拟器或规划系统生成的不完美轨迹）时经常会失败，从而生成具有严重物理不一致和伪影的视频。为了解决这一限制，我们提出了 PhyGenesis，这是一种世界模型，旨在生成具有高视觉保真度和强物理一致性的驾驶视频。我们的框架由两个关键组件组成：(1) 物理条件生成器，将潜在无效的轨迹输入转换为物理上合理的条件；(2) 物理增强视频生成器，在这些条件下生成高保真多视图驾驶视频。为了有效地训练这些组件，我们构建了一个大规模的、物理丰富的异构数据集。具体来说，除了真实世界的驾驶视频外，我们还使用 CARLA 模拟器生成各种具有挑战性的驾驶场景，从中导出监督信号，指导模型学习极端条件下的物理接地动力学。这种具有挑战性的轨迹学习策略可以实现轨迹校正并促进物理一致的视频生成。大量实验表明，PhyGenesis 始终优于最先进的方法，尤其是在具有挑战性的轨迹上。我们的项目页面位于：此 https URL。

Title: AVO: Agentic Variation Operators for Autonomous Evolutionary Search

• Authors: Terry Chen, Zhifan Ye, Bing Xu, Zihao Ye, Timmy Liu, Ali Hassani, Tianqi Chen, Andrew Kerr, Haicheng Wu, Yang Xu, Yu-Jung Chen, Hanfeng Chen, Aditya Kane, Ronny Krashinsky, Ming-Yu Liu, Vinod Grover, Luis Ceze, Roger Bringmann, John Tran, Wei Liu, Fung Xie, Michael Lightstone, Humphrey Shi
• Subjects: cs.LG
• Abstract URL: https://arxiv.org/abs/2603.24517
• Pdf URL: https://arxiv.org/pdf/2603.24517
• Copy Paste: [[2603.24517]] AVO: Agentic Variation Operators for Autonomous Evolutionary Search(https://arxiv.org/abs/2603.24517)
• Keywords: generation
• Abstract: Agentic Variation Operators (AVO) are a new family of evolutionary variation operators that replace the fixed mutation, crossover, and hand-designed heuristics of classical evolutionary search with autonomous coding agents. Rather than confining a language model to candidate generation within a prescribed pipeline, AVO instantiates variation as a self-directed agent loop that can consult the current lineage, a domain-specific knowledge base, and execution feedback to propose, repair, critique, and verify implementation edits. We evaluate AVO on attention, among the most aggressively optimized kernel targets in AI, on NVIDIA Blackwell (B200) GPUs. Over 7 days of continuous autonomous evolution on multi-head attention, AVO discovers kernels that outperform cuDNN by up to 3.5% and FlashAttention-4 by up to 10.5% across the evaluated configurations. The discovered optimizations transfer readily to grouped-query attention, requiring only 30 minutes of additional autonomous adaptation and yielding gains of up to 7.0% over cuDNN and 9.3% over FlashAttention-4. Together, these results show that agentic variation operators move beyond prior LLM-in-the-loop evolutionary pipelines by elevating the agent from candidate generator to variation operator, and can discover performance-critical micro-architectural optimizations that produce kernels surpassing state-of-the-art expert-engineered attention implementations on today's most advanced GPU hardware.
• 摘要：代理变异算子（AVO）是一个新的进化变异算子家族，它用自主编码代理取代了经典进化搜索的固定突变、交叉和手工设计的启发式方法。 AVO 没有将语言模型限制在规定管道内的候选生成，而是将变体实例化为自我导向的代理循环，可以参考当前的谱系、特定领域的知识库和执行反馈来提出、修复、批评和验证实现编辑。我们在 NVIDIA Blackwell (B200) GPU 上评估了 AVO 的注意力，这是人工智能中最积极优化的内核目标之一。经过 7 天的多头注意力持续自主进化，AVO 发现在评估的配置中，内核的性能优于 cuDNN 高达 3.5%，优于 FlashAttention-4 高达 10.5%。所发现的优化很容易转移到分组查询注意力，只需要 30 分钟的额外自主适应，并且比 cuDNN 获得高达 7.0% 的收益，比 FlashAttention-4 获得高达 9.3% 的收益。总之，这些结果表明，代理变异算子通过将代理从候选生成器提升为变异算子，超越了之前的 LLM 在循环进化管道，并且可以发现性能关键的微架构优化，从而产生超越当今最先进的 GPU 硬件上最先进的专家设计的注意力实现的内核。

Title: SEGAR: Selective Enhancement for Generative Augmented Reality

• Authors: Fanjun Bu, Chenyang Yuan, Hiroshi Yasuda
• Subjects: cs.CV, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.24541
• Pdf URL: https://arxiv.org/pdf/2603.24541
• Copy Paste: [[2603.24541]] SEGAR: Selective Enhancement for Generative Augmented Reality(https://arxiv.org/abs/2603.24541)
• Keywords: generative
• Abstract: Generative world models offer a compelling foundation for augmented-reality (AR) applications: by predicting future image sequences that incorporate deliberate visual edits, they enable temporally coherent, augmented future frames that can be computed ahead of time and cached, avoiding per-frame rendering from scratch in real time. In this work, we present SEGAR, a preliminary framework that combines a diffusion-based world model with a selective correction stage to support this vision. The world model generates augmented future frames with region-specific edits while preserving others, and the correction stage subsequently aligns safety-critical regions with real-world observations while preserving intended augmentations elsewhere. We demonstrate this pipeline in driving scenarios as a representative setting where semantic region structure is well defined and real-world feedback is readily available. We view this as an early step toward generative world models as practical AR infrastructure, where future frames can be generated, cached, and selectively corrected on demand.
• 摘要：生成世界模型为增强现实（AR）应用程序提供了令人信服的基础：通过预测包含有意视觉编辑的未来图像序列，它们可以实现时间连贯的增强未来帧，这些帧可以提前计算并缓存，从而避免从头开始实时渲染每帧。在这项工作中，我们提出了 SEGAR，这是一个初步框架，它将基于扩散的世界模型与选择性校正阶段相结合，以支持这一愿景。世界模型通过特定区域的编辑生成增强的未来框架，同时保留其他框架，校正阶段随后将安全关键区域与现实世界的观察结果保持一致，同时保留其他地方的预期增强。我们在驾驶场景中展示了这条管道作为代表性设置，其中语义区域结构被明确定义并且现实世界的反馈很容易获得。我们认为这是迈向生成世界模型作为实用 AR 基础设施的早期一步，未来的帧可以根据需要生成、缓存和有选择地纠正。

Title: Scaling Recurrence-aware Foundation Models for Clinical Records via Next-Visit Prediction

• Authors: Haresh Rengaraj Rajamohan, Xiang Gao, Weicheng Zhu, Shih-Lun Huang, Long Chen, Gabe Schulman, Huizhen Jin, Shengduo Li, Yixuan Wang, Huidi Yang, Kyunghyun Cho, Cem M. Deniz, Narges Razavian
• Subjects: cs.LG
• Abstract URL: https://arxiv.org/abs/2603.24562
• Pdf URL: https://arxiv.org/pdf/2603.24562
• Copy Paste: [[2603.24562]] Scaling Recurrence-aware Foundation Models for Clinical Records via Next-Visit Prediction(https://arxiv.org/abs/2603.24562)
• Keywords: generative
• Abstract: While large-scale pretraining has revolutionized language modeling, its potential remains underexplored in healthcare with structured electronic health records (EHRs). We present RAVEN, a novel generative pretraining strategy for sequential EHR data based on Recurrence-Aware next-Visit EveNt prediction. Leveraging a dataset of over one million unique individuals, our model learns to autoregressively generate tokenized clinical events for the next visit conditioned on patient history. We introduce regularization on predicting repeated events and highlight a key pitfall in EHR-based foundation model evaluations: repeated event tokens can inflate performance metrics when new onsets are not distinguished from subsequent occurrences. Furthermore, we empirically investigate the scaling behaviors in a data-constrained, compute-saturated regime, showing that simply increasing model size is suboptimal without commensurate increases in data volume. We evaluate our model via zero-shot prediction for forecasting the incidence of a diverse set of diseases, where it rivals fully fine-tuned representation-based Transformer models and outperforms widely used simulation-based next-token approaches. Finally, without additional parameter updates, we show that RAVEN can generalize to an external patient cohort under lossy clinical code mappings and feature coverage gaps.
• 摘要：虽然大规模预训练彻底改变了语言模型，但其在结构化电子健康记录 (EHR) 领域的潜力仍未得到充分开发。我们提出了 RAVEN，一种基于重复感知下次访问事件预测的连续 EHR 数据的新型生成预训练策略。利用超过一百万个独特个体的数据集，我们的模型学习根据患者病史为下一次就诊自动生成标记化临床事件。我们引入了预测重复事件的正则化，并强调了基于 EHR 的基础模型评估中的一个关键陷阱：当新事件与后续事件无法区分时，重复事件标记可能会夸大性能指标。此外，我们根据经验研究了数据受限、计算饱和的情况下的扩展行为，结果表明，在不相应增加数据量的情况下，简单地增加模型大小并不是最优的。我们通过零样本预测来评估我们的模型，以预测多种疾病的发病率，它可以与完全微调的基于表示的 Transformer 模型相媲美，并且优于广泛使用的基于模拟的 next-token 方法。最后，在没有额外参数更新的情况下，我们证明 RAVEN 可以在有损临床代码映射和特征覆盖差距下泛化到外部患者队列。

Title: Anti-I2V: Safeguarding your photos from malicious image-to-video generation

• Authors: Duc Vu, Anh Nguyen, Chi Tran, Anh Tran
• Subjects: cs.CV, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.24570
• Pdf URL: https://arxiv.org/pdf/2603.24570
• Copy Paste: [[2603.24570]] Anti-I2V: Safeguarding your photos from malicious image-to-video generation(https://arxiv.org/abs/2603.24570)
• Keywords: generation
• Abstract: Advances in diffusion-based video generation models, while significantly improving human animation, poses threats of misuse through the creation of fake videos from a specific person's photo and text prompts. Recent efforts have focused on adversarial attacks that introduce crafted perturbations to protect images from diffusion-based models. However, most existing approaches target image generation, while relatively few explicitly address image-to-video diffusion models (VDMs), and most primarily focus on UNet-based architectures. Hence, their effectiveness against Diffusion Transformer (DiT) models remains largely under-explored, as these models demonstrate improved feature retention, and stronger temporal consistency due to larger capacity and advanced attention mechanisms. In this work, we introduce Anti-I2V, a novel defense against malicious human image-to-video generation, applicable across diverse diffusion backbones. Instead of restricting noise updates to the RGB space, Anti-I2V operates in both the $L$*$a$*$b$* and frequency domains, improving robustness and concentrating on salient pixels. We then identify the network layers that capture the most distinct semantic features during the denoising process to design appropriate training objectives that maximize degradation of temporal coherence and generation fidelity. Through extensive validation, Anti-I2V demonstrates state-of-the-art defense performance against diverse video diffusion models, offering an effective solution to the problem.
• 摘要：基于扩散的视频生成模型的进步虽然显着改善了人类动画，但通过根据特定人的照片和文本提示创建虚假视频而带来了滥用的威胁。最近的工作重点是对抗性攻击，这些攻击引入精心设计的扰动来保护图像免受基于扩散的模型的影响。然而，大多数现有方法都以图像生成为目标，而明确解决图像到视频扩散模型 (VDM) 的方法相对较少，并且大多数主要关注基于 UNet 的架构。因此，它们对扩散变压器（DiT）模型的有效性仍然在很大程度上尚未得到充分探索，因为这些模型表现出改进的特征保留，以及由于更大的容量和先进的注意力机制而更强的时间一致性。在这项工作中，我们介绍了 Anti-I2V，这是一种针对恶意人类图像到视频生成的新颖防御方法，适用于各种扩散主干网。 Anti-I2V 没有将噪声更新限制在 RGB 空间，而是在 $L$*$a$*$b$* 和频域中运行，从而提高了鲁棒性并专注于显着像素。然后，我们确定在去噪过程中捕获最独特语义特征的网络层，以设计适当的训练目标，最大限度地降低时间一致性和生成保真度。通过广泛的验证，Anti-I2V展示了针对多种视频扩散模型的最先进的防御性能，为该问题提供了有效的解决方案。

Title: Vision-Language Models vs Human: Perceptual Image Quality Assessment

• Authors: Imran Mehmood, Imad Ali Shah, Ming Ronnier Luo, Brian Deegan
• Subjects: cs.CV, eess.IV
• Abstract URL: https://arxiv.org/abs/2603.24578
• Pdf URL: https://arxiv.org/pdf/2603.24578
• Copy Paste: [[2603.24578]] Vision-Language Models vs Human: Perceptual Image Quality Assessment(https://arxiv.org/abs/2603.24578)
• Keywords: quality assessment
• Abstract: Psychophysical experiments remain the most reliable approach for perceptual image quality assessment (IQA), yet their cost and limited scalability encourage automated approaches. We investigate whether Vision Language Models (VLMs) can approximate human perceptual judgments across three image quality scales: contrast, colorfulness and overall preference. Six VLMs four proprietary and two openweight models are benchmarked against psychophysical data. This work presents a systematic benchmark of VLMs for perceptual IQA through comparison with human psychophysical data. The results reveal strong attribute dependent variability models with high human alignment for colorfulness (\rho up to 0.93) underperform on contrast and vice-versa. Attribute weighting analysis further shows that most VLMs assign higher weights to colorfulness compared to contrast when evaluating overall preference similar to the psychophysical data. Intramodel consistency analysis reveals a counterintuitive tradeoff: the most self consistent models are not necessarily the most human aligned suggesting response variability reflects sensitivity to scene dependent perceptual cues. Furthermore, human-VLM agreement is increased with perceptual separability, indicating VLMs are more reliable when stimulus differences are clearly expressed.
• 摘要：心理物理学实验仍然是感知图像质量评估（IQA）最可靠的方法，但其成本和有限的可扩展性鼓励自动化方法。我们研究视觉语言模型（VLM）是否可以在三个图像质量尺度上近似人类的感知判断：对比度、色彩度和整体偏好。六个 VLM、四个专有模型和两个开放重量模型以心理物理学数据为基准。这项工作通过与人类心理物理数据的比较，提出了感知 IQA 的 VLM 的系统基准。结果揭示了强属性依赖变异性模型，具有较高的色彩人类对齐度（\rho 高达 0.93），在对比度方面表现不佳，反之亦然。属性权重分析进一步表明，在评估与心理物理数据类似的整体偏好时，大多数 VLM 为色彩赋予比对比度更高的权重。模型内一致性分析揭示了一种违反直觉的权衡：最自洽的模型不一定是最符合人类的模型，这表明响应变异性反映了对场景相关感知线索的敏感性。此外，人类与 VLM 的一致性随着感知可分离性的增加而增加，这表明当刺激差异清晰表达时，VLM 更加可靠。

Title: DreamerAD: Efficient Reinforcement Learning via Latent World Model for Autonomous Driving

• Authors: Pengxuan Yang, Yupeng Zheng, Deheng Qian, Zebin Xing, Qichao Zhang, Linbo Wang, Yichen Zhang, Shaoyu Guo, Zhongpu Xia, Qiang Chen, Junyu Han, Lingyun Xu, Yifeng Pan, Dongbin Zhao
• Subjects: cs.LG, cs.RO
• Abstract URL: https://arxiv.org/abs/2603.24587
• Pdf URL: https://arxiv.org/pdf/2603.24587
• Copy Paste: [[2603.24587]] DreamerAD: Efficient Reinforcement Learning via Latent World Model for Autonomous Driving(https://arxiv.org/abs/2603.24587)
• Keywords: generation
• Abstract: We introduce DreamerAD, the first latent world model framework that enables efficient reinforcement learning for autonomous driving by compressing diffusion sampling from 100 steps to 1 - achieving 80x speedup while maintaining visual interpretability. Training RL policies on real-world driving data incurs prohibitive costs and safety risks. While existing pixel-level diffusion world models enable safe imagination-based training, they suffer from multi-step diffusion inference latency (2s/frame) that prevents high-frequency RL interaction. Our approach leverages denoised latent features from video generation models through three key mechanisms: (1) shortcut forcing that reduces sampling complexity via recursive multi-resolution step compression, (2) an autoregressive dense reward model operating directly on latent representations for fine-grained credit assignment, and (3) Gaussian vocabulary sampling for GRPO that constrains exploration to physically plausible trajectories. DreamerAD achieves 87.7 EPDMS on NavSim v2, establishing state-of-the-art performance and demonstrating that latent-space RL is effective for autonomous driving.
• 摘要：我们推出了 DreamerAD，这是第一个潜在世界模型框架，它通过将扩散采样从 100 步压缩到 1 步，实现自动驾驶的高效强化学习，在保持视觉可解释性的同时实现 80 倍的加速。根据现实世界的驾驶数据训练强化学习策略会带来高昂的成本和安全风险。虽然现有的像素级扩散世界模型可以实现安全的基于想象力的训练，但它们受到多步扩散推理延迟（2 秒/帧）的影响，从而阻碍了高频 RL 交互。我们的方法通过三个关键机制利用视频生成模型中的去噪潜在特征：(1) 通过递归多分辨率步骤压缩降低采样复杂性的捷径强制，(2) 直接对细粒度信用分配的潜在表示进行操作的自回归密集奖励模型，以及 (3) GRPO 的高斯词汇采样，将探索限制在物理上合理的轨迹。 DreamerAD 在 NavSim v2 上获得了 87.7 EPDMS，确立了最先进的性能，并证明了潜在空间 RL 对于自动驾驶是有效的。

Title: Polynomial Speedup in Diffusion Models with the Multilevel Euler-Maruyama Method

• Authors: Arthur Jacot
• Subjects: cs.LG, math.NA, stat.ML
• Abstract URL: https://arxiv.org/abs/2603.24594
• Pdf URL: https://arxiv.org/pdf/2603.24594
• Copy Paste: [[2603.24594]] Polynomial Speedup in Diffusion Models with the Multilevel Euler-Maruyama Method(https://arxiv.org/abs/2603.24594)
• Keywords: generation
• Abstract: We introduce the Multilevel Euler-Maruyama (ML-EM) method compute solutions of SDEs and ODEs using a range of approximators $f^1,\dots,f^k$ to the drift $f$ with increasing accuracy and computational cost, only requiring a few evaluations of the most accurate $f^k$ and many evaluations of the less costly $f^1,\dots,f^{k-1}$. If the drift lies in the so-called Harder than Monte Carlo (HTMC) regime, i.e. it requires $\epsilon^{-\gamma}$ compute to be $\epsilon$-approximated for some $\gamma>2$, then ML-EM $\epsilon$-approximates the solution of the SDE with $\epsilon^{-\gamma}$ compute, improving over the traditional EM rate of $\epsilon^{-\gamma-1}$. In other terms it allows us to solve the SDE at the same cost as a single evaluation of the drift. In the context of diffusion models, the different levels $f^{1},\dots,f^{k}$ are obtained by training UNets of increasing sizes, and ML-EM allows us to perform sampling with the equivalent of a single evaluation of the largest UNet. Our numerical experiments confirm our theory: we obtain up to fourfold speedups for image generation on the CelebA dataset downscaled to 64x64, where we measure a $\gamma\approx2.5$. Given that this is a polynomial speedup, we expect even stronger speedups in practical applications which involve orders of magnitude larger networks.
• 摘要：我们引入了多级欧拉-丸山 (ML-EM) 方法，使用一系列逼近器 $f^1,\dots,f^k$ 来计算 SDE 和 ODE 的解，随着精度和计算成本的增加，仅需要对最准确的 $f^k$ 进行一些评估，并对成本较低的 $f^1,\dots,f^{k-1}$ 进行多次评估。如果漂移存在于所谓的比蒙特卡罗 (HTMC) 机制更难的情况下，即它要求 $\epsilon^{-\gamma}$ 计算对于某些 $\gamma>2$ 进行 $\epsilon$ 近似，则 ML-EM $\epsilon$- 会使用 $\epsilon^{-\gamma}$ 计算来近似 SDE 的解，从而比传统的 EM 速率提高$\epsilon^{-\gamma-1}$。换句话说，它使我们能够以与单次漂移评估相同的成本来求解 SDE。在扩散模型的背景下，不同的级别 $f^{1},\dots,f^{k}$ 是通过训练大小不断增加的 UNet 获得的，而 ML-EM 允许我们以相当于最大 UNet 的单次评估的方式进行采样。我们的数值实验证实了我们的理论：我们在缩小到 64x64 的 CelebA 数据集上获得了高达四倍的图像生成速度，我们测量了 $\gamma\approx2.5$。鉴于这是多项式加速，我们预计在涉及更大数量级网络的实际应用中会有更强的加速。