2026-03-06

Title: Agent Memory Below the Prompt: Persistent Q4 KV Cache for Multi-Agent LLM Inference on Edge Devices

• Authors: Yakov Pyotr Shkolnikov
• Subjects: cs.LG, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.04428
• Pdf URL: https://arxiv.org/pdf/2603.04428
• Copy Paste: [[2603.04428]] Agent Memory Below the Prompt: Persistent Q4 KV Cache for Multi-Agent LLM Inference on Edge Devices(https://arxiv.org/abs/2603.04428)
• Keywords: restoration
• Abstract: Multi-agent LLM systems on edge devices face a memory management problem: device RAM is too small to hold every agent's KV cache simultaneously. On Apple M4 Pro with 10.2 GB of cache budget, only 3 agents fit at 8K context in FP16. A 10-agent workflow must constantly evict and reload caches. Without persistence, every eviction forces a full re-prefill through the model -- 15.7 seconds per agent at 4K context. We address this by persisting each agent's KV cache to disk in 4-bit quantized format and reloading it directly into the attention layer, eliminating redundant O(n) prefill computation via direct cache restoration. The system comprises three components: a block pool providing per-agent isolated Q4 KV caches in safetensors format, a BatchQuantizedKVCache for concurrent inference over multiple agents' quantized caches, and cross-phase context injection that accumulates attention state across conversation phases without re-computation. Evaluated on three architectures (Gemma 3 12B, dense GQA, 48 layers; DeepSeek-Coder-V2-Lite 16B, MoE MLA, 27 layers; Llama 3.1 8B, dense GQA, 32 layers), cache restoration reduces time-to-first-token by up to 136x (Gemma: 22--136x at 4K--32K; DeepSeek: 11--76x at 4K--32K; Llama: 24--111x at 4K--16K; 3--10x at 1K). Q4 quantization fits 4x more agent contexts into fixed device memory than FP16. Perplexity measured with actual Q4 KV caches shows -0.7% for Gemma, +2.8% for Llama, and +3.0% for DeepSeek. Open-source at this https URL
• 摘要：边缘设备上的多代理 LLM 系统面临内存管理问题：设备 RAM 太小，无法同时容纳每个代理的 KV 缓存。在具有 10.2 GB 缓存预算的 Apple M4 Pro 上，只有 3 个代理适合 FP16 中的 8K 上下文。 10 个代理的工作流程必须不断地逐出并重新加载缓存。如果没有持久性，每次驱逐都会强制通过模型进行完全重新预填充——在 4K 上下文中每个代理需要 15.7 秒。我们通过将每个代理的 KV 缓存以 4 位量化格式保存到磁盘并将其直接重新加载到注意力层来解决这个问题，通过直接缓存恢复消除冗余的 O(n) 预填充计算。该系统由三个组件组成：一个块池，以 safetensors 格式提供每个代理隔离的 Q4 KV 缓存；一个 BatchQuantizedKVCache，用于对多个代理的量化缓存进行并发推理；以及跨阶段上下文注入，无需重新计算即可累积跨会话阶段的注意力状态。在三种架构（Gemma 3 12B，密集 GQA，48 层；DeepSeek-Coder-V2-Lite 16B，MoE MLA，27 层；Llama 3.1 8B，密集 GQA，32 层）上进行评估，缓存恢复将首次令牌时间缩短了 136 倍（Gemma：22--136 倍） 4K--32K；DeepSeek：4K--32K 时 11--76x；Llama：4K--16K 时 24--10x； Q4 量化在固定设备内存中容纳的代理上下文比 FP16 多 4 倍。使用实际 Q4 KV 缓存测量的困惑度显示，Gemma 为 -0.7%，Llama 为 +2.8%，DeepSeek 为 +3.0%。在此 https URL 上开源

Title: Structure-Guided Histopathology Synthesis via Dual-LoRA Diffusion

• Authors: Xuan Xu, Prateek Prasanna
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.04565
• Pdf URL: https://arxiv.org/pdf/2603.04565
• Copy Paste: [[2603.04565]] Structure-Guided Histopathology Synthesis via Dual-LoRA Diffusion(https://arxiv.org/abs/2603.04565)
• Keywords: restoration, generation, generative
• Abstract: Histopathology image synthesis plays an important role in tissue restoration, data augmentation, and modeling of tumor microenvironments. However, existing generative methods typically address restoration and generation as separate tasks, although both share the same objective of structure-consistent tissue synthesis under varying degrees of missingness, and often rely on weak or inconsistent structural priors that limit realistic cellular organization. We propose Dual-LoRA Controllable Diffusion, a unified centroid-guided diffusion framework that jointly supports Local Structure Completion and Global Structure Synthesis within a single model. Multi-class nuclei centroids serve as lightweight and annotation-efficient spatial priors, providing biologically meaningful guidance under both partial and complete image absence. Two task-specific LoRA adapters specialize the shared backbone for local and global objectives without retraining separate diffusion models. Extensive experiments demonstrate consistent improvements over state-of-the-art GAN and diffusion baselines across restoration and synthesis tasks. For local completion, LPIPS computed within the masked region improves from 0.1797 (HARP) to 0.1524, and for global synthesis, FID improves from 225.15 (CoSys) to 76.04, indicating improved structural fidelity and realism. Our approach achieves more faithful structural recovery in masked regions and substantially improved realism and morphology consistency in full synthesis, supporting scalable pan-cancer histopathology modeling.
• 摘要：组织病理学图像合成在组织恢复、数据增强和肿瘤微环境建模中发挥着重要作用。然而，现有的生成方法通常将恢复和生成作为单独的任务来解决，尽管两者在不同程度的缺失下具有结构一致的组织合成的相同目标，并且通常依赖于限制实际细胞组织的弱或不一致的结构先验。我们提出了 Dual-LoRA Controllable Diffusion，这是一种统一的质心引导扩散框架，可在单个模型内共同支持局部结构完成和全局结构合成。多类核质心作为轻量级且注释高效的空间先验，在部分和完整图像缺失的情况下提供具有生物学意义的指导。两个特定于任务的 LoRA 适配器专门用于本地和全局目标的共享骨干网，无需重新训练单独的扩散模型。大量实验表明，在恢复和合成任务中，与最先进的 GAN 和扩散基线相比，得到了一致的改进。对于局部完成，在遮罩区域内计算的 LPIPS 从 0.1797 (HARP) 提高到 0.1524，对于全局合成，FID 从 225.15 (CoSys) 提高到 76.04，表明结构保真度和真实度有所提高。我们的方法在遮蔽区域实现了更忠实的结构恢复，并显着提高了全合成的真实性和形态一致性，支持可扩展的泛癌组织病理学建模。

Title: SGR3 Model: Scene Graph Retrieval-Reasoning Model in 3D

• Authors: Zirui Wang, Ruiping Liu, Yufan Chen, Junwei Zheng, Weijia Fan, Kunyu Peng, Di Wen, Jiale Wei, Jiaming Zhang, Rainer Stiefelhagen
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.04614
• Pdf URL: https://arxiv.org/pdf/2603.04614
• Copy Paste: [[2603.04614]] SGR3 Model: Scene Graph Retrieval-Reasoning Model in 3D(https://arxiv.org/abs/2603.04614)
• Keywords: generation
• Abstract: 3D scene graphs provide a structured representation of object entities and their relationships, enabling high-level interpretation and reasoning for robots while remaining intuitively understandable to humans. Existing approaches for 3D scene graph generation typically combine scene reconstruction with graph neural networks (GNNs). However, such pipelines require multi-modal data that may not always be available, and their reliance on heuristic graph construction can constrain the prediction of relationship triplets. In this work, we introduce a Scene Graph Retrieval-Reasoning Model in 3D (SGR3 Model), a training-free framework that leverages multi-modal large language models (MLLMs) with retrieval-augmented generation (RAG) for semantic scene graph generation. SGR3 Model bypasses the need for explicit 3D reconstruction. Instead, it enhances relational reasoning by incorporating semantically aligned scene graphs retrieved via a ColPali-style cross-modal framework. To improve retrieval robustness, we further introduce a weighted patch-level similarity selection mechanism that mitigates the negative impact of blurry or semantically uninformative regions. Experiments demonstrate that SGR3 Model achieves competitive performance compared to training-free baselines and on par with GNN-based expert models. Moreover, an ablation study on the retrieval module and knowledge base scale reveals that retrieved external information is explicitly integrated into the token generation process, rather than being implicitly internalized through abstraction.
• 摘要：3D 场景图提供了对象实体及其关系的结构化表示，使机器人能够进行高级解释和推理，同时保持人类的直观理解。现有的 3D 场景图生成方法通常将场景重建与图神经网络 (GNN) 结合起来。然而，此类管道需要可能并不总是可用的多模态数据，并且它们对启发式图构造的依赖可能会限制关系三元组的预测。在这项工作中，我们引入了 3D 场景图检索推理模型（SGR3 模型），这是一种免训练框架，利用多模态大语言模型 (MLLM) 和检索增强生成 (RAG) 来生成语义场景图。 SGR3 模型无需显式 3D 重建。相反，它通过合并通过 ColPali 风格的跨模式框架检索的语义对齐的场景图来增强关系推理。为了提高检索的鲁棒性，我们进一步引入了加权补丁级相似性选择机制，可以减轻模糊或语义无信息区域的负面影响。实验表明，与免训练基线相比，SGR3 模型实现了具有竞争力的性能，并且与基于 GNN 的专家模型相当。此外，对检索模块和知识库规模的消融研究表明，检索到的外部信息被明确地集成到令牌生成过程中，而不是通过抽象隐式内化。

Title: Neuro-Symbolic Financial Reasoning via Deterministic Fact Ledgers and Adversarial Low-Latency Hallucination Detector

• Authors: Pedram Agand
• Subjects: cs.LG, cs.AI, cs.CE
• Abstract URL: https://arxiv.org/abs/2603.04663
• Pdf URL: https://arxiv.org/pdf/2603.04663
• Copy Paste: [[2603.04663]] Neuro-Symbolic Financial Reasoning via Deterministic Fact Ledgers and Adversarial Low-Latency Hallucination Detector(https://arxiv.org/abs/2603.04663)
• Keywords: generation, generative
• Abstract: Standard Retrieval-Augmented Generation (RAG) architectures fail in high-stakes financial domains due to two fundamental limitations: the inherent arithmetic incompetence of Large Language Models (LLMs) and the distributional semantic conflation of dense vector retrieval (e.g., mapping ``Net Income'' to ``Net Sales'' due to contextual proximity). In deterministic domains, a 99% accuracy rate yields 0% operational trust. To achieve zero-hallucination financial reasoning, we introduce the Verifiable Numerical Reasoning Agent (VeNRA). VeNRA shifts the RAG paradigm from retrieving probabilistic text to retrieving deterministic variables via a strictly typed Universal Fact Ledger (UFL), mathematically bounded by a novel Double-Lock Grounding algorithm. Recognizing that upstream parsing anomalies inevitably occur, we introduce the VeNRA Sentinel: a 3-billion parameter SLM trained to forensically audit Python execution traces with only one token test budget. To train this model, we avoid traditional generative hallucination datasets in favor of Adversarial Simulation, programmatically sabotaging golden financial records to simulate production-level ``Ecological Errors'' (e.g., Logic Code Lies and Numeric Neighbor Traps). Finally, to optimize the Sentinel under strict latency budgets, we utilize a single-pass classification paradigm with optional post thinking for debug. We identify the phenomenon of Loss Dilution in Reverse-Chain-of-Thought training and present a novel, OOM-safe Micro-Chunking loss algorithm to stabilize gradients under extreme differential penalization.
• 摘要：标准检索增强生成（RAG）架构由于两个基本限制而在高风险金融领域失败：大型语言模型（LLM）固有的算术无能和密集向量检索的分布语义合并（例如，由于上下文接近而将“净收入”映射到“净销售额”）。在确定性领域，99% 的准确率带来 0% 的操作信任。为了实现零幻觉金融推理，我们引入了可验证数值推理代理（VeNRA）。 VeNRA 将 RAG 范式从检索概率文本转变为通过严格类型的通用事实账本 (UFL) 检索确定性变量，在数学上受到新颖的双锁接地算法的限制。认识到上游解析异常不可避免地会发生，我们引入了 VeNRA Sentinel：一种经过训练的 30 亿参数 SLM，只需一个令牌测试预算即可对 Python 执行跟踪进行取证审核。为了训练这个模型，我们避免使用传统的生成幻觉数据集，而是采用对抗性模拟，以编程方式破坏黄金财务记录来模拟生产级的“生态错误”（例如，逻辑代码谎言和数字邻居陷阱）。最后，为了在严格的延迟预算下优化 Sentinel，我们利用单遍分类范例以及可选的调试后思考。我们识别了反向思维链训练中的损失稀释现象，并提出了一种新颖的、OOM 安全的微分块损失算法，以在极端微分惩罚下稳定梯度。

Title: sFRC for assessing hallucinations in medical image restoration

• Authors: Prabhat Kc, Rongping Zeng, Nirmal Soni, Aldo Badano
• Subjects: cs.CV, physics.med-ph, stat.ML
• Abstract URL: https://arxiv.org/abs/2603.04673
• Pdf URL: https://arxiv.org/pdf/2603.04673
• Copy Paste: [[2603.04673]] sFRC for assessing hallucinations in medical image restoration(https://arxiv.org/abs/2603.04673)
• Keywords: restoration, super-resolution
• Abstract: Deep learning (DL) methods are currently being explored to restore images from sparse-view-, limited-data-, and undersampled-based acquisitions in medical applications. Although outputs from DL may appear visually appealing based on likability/subjective criteria (such as less noise, smooth features), they may also suffer from hallucinations. This issue is further exacerbated by a lack of easy-to-use techniques and robust metrics for the identification of hallucinations in DL outputs. In this work, we propose performing Fourier Ring Correlation (FRC) analysis over small patches and concomitantly (s)canning across DL outputs and their reference counterparts to detect hallucinations (termed as sFRC). We describe the rationale behind sFRC and provide its mathematical formulation. The parameters essential to sFRC may be set using predefined hallucinated features annotated by subject matter experts or using imaging theory-based hallucination maps. We use sFRC to detect hallucinations for three undersampled medical imaging problems: CT super-resolution, CT sparse view, and MRI subsampled restoration. In the testing phase, we demonstrate sFRC's effectiveness in detecting hallucinated features for the CT problem and sFRC's agreement with imaging theory-based outputs on hallucinated feature maps for the MR problem. Finally, we quantify the hallucination rates of DL methods on in-distribution versus out-of-distribution data and under increasing subsampling rates to characterize the robustness of DL methods. Beyond DL-based methods, sFRC's effectiveness in detecting hallucinations for a conventional regularization-based restoration method and a state-of-the-art unrolled method is also shown.
• 摘要：目前正在探索深度学习 (DL) 方法，以从医疗应用中的稀疏视图、有限数据和欠采样采集中恢复图像。尽管基于喜爱度/主观标准（例如更少的噪音、平滑的特征），深度学习的输出可能在视觉上看起来很有吸引力，但它们也可能会产生幻觉。由于缺乏易于使用的技术和可靠的指标来识别深度学习输出中的幻觉，这个问题进一步加剧。在这项工作中，我们建议对小补丁执行傅里叶环相关（FRC）分析，并同时扫描 DL 输出及其参考对应项以检测幻觉（称为 sFRC）。我们描述了 sFRC 背后的基本原理并提供了其数学公式。 sFRC 必需的参数可以使用主题专家注释的预定义幻觉特征或使用基于成像理论的幻觉图来设置。我们使用 sFRC 来检测三个欠采样医学成像问题的幻觉：CT 超分辨率、CT 稀疏视图和 MRI 子采样恢复。在测试阶段，我们证明了 sFRC 在检测 CT 问题的幻觉特征方面的有效性，以及 sFRC 与 MR 问题的幻觉特征图上基于成像理论的输出的一致性。最后，我们量化了 DL 方法在分布内与分布外数据上以及在增加子采样率下的幻觉率，以表征 DL 方法的稳健性。除了基于 DL 的方法之外，还显示了 sFRC 在检测幻觉方面的有效性（基于传统正则化的恢复方法和最先进的展开方法）。

Title: Decoding the Pulse of Reasoning VLMs in Multi-Image Understanding Tasks

• Authors: Chenjun Li
• Subjects: cs.CV, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.04676
• Pdf URL: https://arxiv.org/pdf/2603.04676
• Copy Paste: [[2603.04676]] Decoding the Pulse of Reasoning VLMs in Multi-Image Understanding Tasks(https://arxiv.org/abs/2603.04676)
• Keywords: generation
• Abstract: Multi-image reasoning remains a significant challenge for vision-language models (VLMs). We investigate a previously overlooked phenomenon: during chain-of-thought (CoT) generation, the text-to-image (T2I) attention of reasoning VLMs exhibits diffuse "pulses": sporadic and unfocused attention patterns that fail to concentrate on task-relevant images. We further reveal a systematic positional bias in attention allocation across images. Motivated by these observations, we propose PulseFocus, a training-free, inference-time method that structures CoT reasoning into interleaved plan/focus blocks with soft attention gating. By forcing the model to explicitly plan which image to examine and then gating decode-time attention to the referenced image, PulseFocus sharpens attention focus and yields consistent improvements on multi-image benchmarks like BLINK benchmark (+3.7%) and MuirBench (+1.07%).
• 摘要：多图像推理仍然是视觉语言模型（VLM）的重大挑战。我们研究了一个以前被忽视的现象：在思想链（CoT）生成过程中，推理 VLM 的文本到图像（T2I）注意力表现出分散的“脉冲”：零星且不集中的注意力模式，无法集中在与任务相关的图像上。我们进一步揭示了跨图像注意力分配的系统性位置偏差。受这些观察的启发，我们提出了 PulseFocus，这是一种免训练的推理时间方法，它将 CoT 推理构建为具有软注意门控的交错计划/焦点块。通过强制模型明确规划要检查的图像，然后将解码时注意力门控到参考图像，PulseFocus 可以锐化注意力焦点，并在 BLINK 基准测试 (+3.7%) 和 MuirBench (+1.07%) 等多图像基准测试上产生一致的改进。

Title: Count Bridges enable Modeling and Deconvolving Transcriptomic Data

• Authors: Nic Fishman, Gokul Gowri, Tanush Kumar, Jiaqi Lu, Valentin de Bortoli, Jonathan S. Gootenberg, Omar Abudayyeh
• Subjects: cs.LG
• Abstract URL: https://arxiv.org/abs/2603.04730
• Pdf URL: https://arxiv.org/pdf/2603.04730
• Copy Paste: [[2603.04730]] Count Bridges enable Modeling and Deconvolving Transcriptomic Data(https://arxiv.org/abs/2603.04730)
• Keywords: generative
• Abstract: Many modern biological assays, including RNA sequencing, yield integer-valued counts that reflect the number of molecules detected. These measurements are often not at the desired resolution: while the unit of interest is typically a single cell, many measurement technologies produce counts aggregated over sets of cells. Although recent generative frameworks such as diffusion and flow matching have been extended to non-Euclidean and discrete settings, it remains unclear how best to model integer-valued data or how to systematically deconvolve aggregated observations. We introduce Count Bridges, a stochastic bridge process on the integers that provides an exact, tractable analogue of diffusion-style models for count data, with closed-form conditionals for efficient training and sampling. We extend this framework to enable direct training from aggregated measurements via an Expectation-Maximization-style approach that treats unit-level counts as latent variables. We demonstrate state-of-the-art performance on integer distribution matching benchmarks, comparing against flow matching and discrete flow matching baselines across various metrics. We then apply Count Bridges to two large-scale problems in biology: modeling single-cell gene expression data at the nucleotide resolution, with applications to deconvolving bulk RNA-seq, and resolving multicellular spatial transcriptomic spots into single-cell count profiles. Our methods offer a principled foundation for generative modeling and deconvolution of biological count data across scales and modalities.
• 摘要：许多现代生物测定（包括 RNA 测序）都会产生反映检测到的分子数量的整数值计数。这些测量通常达不到所需的分辨率：虽然感兴趣的单位通常是单个细胞，但许多测量技术产生对细胞组进行聚合的计数。尽管最近的生成框架（例如扩散和流匹配）已扩展到非欧几里德和离散设置，但仍不清楚如何最好地对整数值数据进行建模或如何系统地对聚合观测值进行反卷积。我们引入了 Count Bridges，这是一种针对整数的随机桥接过程，它为计数数据的扩散式模型提供了精确、易于处理的模拟，并具有用于高效训练和采样的封闭形式条件。我们扩展了这个框架，以便通过将单元级计数视为潜在变量的期望最大化式方法，从聚合测量中进行直接训练。我们在整数分布匹配基准上展示了最先进的性能，与各种指标的流匹配和离散流匹配基线进行比较。然后，我们将 Count Bridges 应用到生物学中的两个大型问题：以核苷酸分辨率对单细胞基因表达数据进行建模，应用于批量 RNA 序列的去卷积，以及将多细胞空间转录组点解析为单细胞计数概况。我们的方法为跨尺度和模式的生物计数数据的生成建模和反卷积提供了原则基础。

Title: Toward Real-world Infrared Image Super-Resolution: A Unified Autoregressive Framework and Benchmark Dataset

• Authors: Yang Zou, Jun Ma, Zhidong Jiao, Xingyuan Li, Zhiying Jiang, Jinyuan Liu
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.04745
• Pdf URL: https://arxiv.org/pdf/2603.04745
• Copy Paste: [[2603.04745]] Toward Real-world Infrared Image Super-Resolution: A Unified Autoregressive Framework and Benchmark Dataset(https://arxiv.org/abs/2603.04745)
• Keywords: super-resolution
• Abstract: Infrared image super-resolution (IISR) under real-world conditions is a practically significant yet rarely addressed task. Pioneering works are often trained and evaluated on simulated datasets or neglect the intrinsic differences between infrared and visible imaging. In practice, however, real infrared images are affected by coupled optical and sensing degradations that jointly deteriorate both structural sharpness and thermal fidelity. To address these challenges, we propose Real-IISR, a unified autoregressive framework for real-world IISR that progressively reconstructs fine-grained thermal structures and clear backgrounds in a scale-by-scale manner via thermal-structural guided visual autoregression. Specifically, a Thermal-Structural Guidance module encodes thermal priors to mitigate the mismatch between thermal radiation and structural edges. Since non-uniform degradations typically induce quantization bias, Real-IISR adopts a Condition-Adaptive Codebook that dynamically modulates discrete representations based on degradation-aware thermal priors. Also, a Thermal Order Consistency Loss enforces a monotonic relation between temperature and pixel intensity, ensuring relative brightness order rather than absolute values to maintain physical consistency under spatial misalignment and thermal drift. We build FLIR-IISR, a real-world IISR dataset with paired LR-HR infrared images acquired via automated focus variation and motion-induced blur. Extensive experiments demonstrate the promising performance of Real-IISR, providing a unified foundation for real-world IISR and benchmarking. The dataset and code are available at: this https URL.
• 摘要：现实条件下的红外图像超分辨率（IISR）是一项具有实际意义但很少被解决的任务。开创性的工作通常是在模拟数据集上进行训练和评估，或者忽略红外和可见光成像之间的内在差异。然而，在实践中，真实的红外图像受到光学和传感耦合退化的影响，这些退化共同降低了结构清晰度和热保真度。为了应对这些挑战，我们提出了 Real-IISR，这是一个用于现实世界 IISR 的统一自回归框架，通过热结构引导的视觉自回归以逐尺度的方式逐步重建细粒度热结构和清晰的背景。具体来说，热结构引导模块对热先验进行编码，以减轻热辐射和结构边缘之间的不匹配。由于非均匀退化通常会引起量化偏差，因此 Real-IISR 采用条件自适应码本，根据退化感知热先验动态调制离散表示。此外，热顺序一致性损失强制温度和像素强度之间的单调关系，确保相对亮度顺序而不是绝对值，以在空间失准和热漂移下保持物理一致性。我们构建了 FLIR-IISR，这是一个真实世界的 IISR 数据集，其中包含通过自动焦点变化和运动引起的模糊获取的配对 LR-HR 红外图像。大量实验证明了 Real-IISR 的良好性能，为现实世界的 IISR 和基准测试提供了统一的基础。数据集和代码可在以下位置获取：此 https URL。

Title: ConTSG-Bench: A Unified Benchmark for Conditional Time Series Generation

• Authors: Shaocheng Lan, Shuqi Gu, Zhangzhi Xiong, Kan Ren
• Subjects: cs.LG
• Abstract URL: https://arxiv.org/abs/2603.04767
• Pdf URL: https://arxiv.org/pdf/2603.04767
• Copy Paste: [[2603.04767]] ConTSG-Bench: A Unified Benchmark for Conditional Time Series Generation(https://arxiv.org/abs/2603.04767)
• Keywords: generation, generative
• Abstract: Conditional time series generation plays a critical role in addressing data scarcity and enabling causal analysis in real-world applications. Despite its increasing importance, the field lacks a standardized and systematic benchmarking framework for evaluating generative models across diverse conditions. To address this gap, we introduce the Conditional Time Series Generation Benchmark (ConTSG-Bench). ConTSG-Bench comprises a large-scale, well-aligned dataset spanning diverse conditioning modalities and levels of semantic abstraction, first enabling systematic evaluation of representative generation methods across these dimensions with a comprehensive suite of metrics for generation fidelity and condition adherence. Both the quantitative benchmarking and in-depth analyses of conditional generation behaviors have revealed the traits and limitations of the current approaches, highlighting critical challenges and promising research directions, particularly with respect to precise structural controllability and downstream task utility under complex conditions.
• 摘要：条件时间序列生成在解决数据稀缺问题和在现实应用中实现因果分析方面发挥着关键作用。尽管其重要性日益增加，但该领域缺乏标准化和系统的基准框架来评估不同条件下的生成模型。为了解决这一差距，我们引入了条件时间序列生成基准（ConTSG-Bench）。 ConTSG-Bench 包含一个大规模、协调一致的数据集，涵盖不同的条件模式和语义抽象级别，首先能够通过一套全面的生成保真度和条件遵守指标对这些维度的代表性生成方法进行系统评估。对条件生成行为的定量基准测试和深入分析都揭示了当前方法的特征和局限性，突出了关键挑战和有前途的研究方向，特别是在复杂条件下的精确结构可控性和下游任务效用方面。

Title: DSA-SRGS: Super-Resolution Gaussian Splatting for Dynamic Sparse-View DSA Reconstruction

• Authors: Shiyu Zhang, Zhicong Wu, Huangxuan Zhao, Zhentao Liu, Lei Chen, Yong Luo, Lefei Zhang, Zhiming Cui, Ziwen Ke, Bo Du
• Subjects: cs.CV, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.04770
• Pdf URL: https://arxiv.org/pdf/2603.04770
• Copy Paste: [[2603.04770]] DSA-SRGS: Super-Resolution Gaussian Splatting for Dynamic Sparse-View DSA Reconstruction(https://arxiv.org/abs/2603.04770)
• Keywords: super-resolution
• Abstract: Digital subtraction angiography (DSA) is a key imaging technique for the auxiliary diagnosis and treatment of cerebrovascular diseases. Recent advancements in gaussian splatting and dynamic neural representations have enabled robust 3D vessel reconstruction from sparse dynamic inputs. However, these methods are fundamentally constrained by the resolution of input projections, where performing naive upsampling to enhance rendering resolution inevitably results in severe blurring and aliasing artifacts. Such lack of super-resolution capability prevents the reconstructed 4D models from recovering fine-grained vascular details and intricate branching structures, which restricts their application in precision diagnosis and treatment. To solve this problem, this paper proposes DSA-SRGS, the first super-resolution gaussian splatting framework for dynamic sparse-view DSA reconstruction. Specifically, we introduce a Multi-Fidelity Texture Learning Module that integrates high-quality priors from a fine-tuned DSA-specific super-resolution model, into the 4D reconstruction optimization. To mitigate potential hallucination artifacts from pseudo-labels, this module employs a Confidence-Aware Strategy to adaptively weight supervision signals between the original low-resolution projections and the generated high-resolution pseudo-labels. Furthermore, we develop Radiative Sub-Pixel Densification, an adaptive strategy that leverages gradient accumulation from high-resolution sub-pixel sampling to refine the 4D radiative gaussian kernels. Extensive experiments on two clinical DSA datasets demonstrate that DSA-SRGS significantly outperforms state-of-the-art methods in both quantitative metrics and qualitative visual fidelity.
• 摘要：数字减影血管造影（DSA）是辅助诊断和治疗脑血管疾病的关键影像技术。高斯分布和动态神经表示方面的最新进展使得能够根据稀疏动态输入进行稳健的 3D 血管重建。然而，这些方法从根本上受到输入投影分辨率的限制，其中执行简单的上采样以增强渲染分辨率不可避免地会导致严重的模糊和混叠伪像。超分辨率能力的缺乏导致重建的4D模型无法恢复细粒度的血管细节和复杂的分支结构，从而限制了其在精准诊断和治疗中的应用。为了解决这个问题，本文提出了 DSA-SRGS，这是第一个用于动态稀疏视图 DSA 重建的超分辨率高斯泼溅框架。具体来说，我们引入了一个多保真纹理学习模块，它将来自微调的 DSA 特定超分辨率模型的高质量先验集成到 4D 重建优化中。为了减轻伪标签潜在的幻觉伪影，该模块采用置信度感知策略来自适应地加权原始低分辨率投影和生成的高分辨率伪标签之间的监督信号。此外，我们开发了辐射子像素致密化，这是一种自适应策略，利用高分辨率子像素采样的梯度累积来细化 4D 辐射高斯内核。对两个临床 DSA 数据集的大量实验表明，DSA-SRGS 在定量指标和定性视觉保真度方面均显着优于最先进的方法。

Title: MADCrowner: Margin Aware Dental Crown Design with Template Deformation and Refinement

• Authors: Linda Wei, Chang Liu, Wenran Zhang, Yuxuan Hu, Ruiyang Li, Feng Qi, Changyao Tian, Ke Wang, Yuanyuan Wang, Shaoting Zhang, Dimitris Metaxas, Hongsheng Li
• Subjects: cs.CV, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.04771
• Pdf URL: https://arxiv.org/pdf/2603.04771
• Copy Paste: [[2603.04771]] MADCrowner: Margin Aware Dental Crown Design with Template Deformation and Refinement(https://arxiv.org/abs/2603.04771)
• Keywords: restoration, generation
• Abstract: Dental crown restoration is one of the most common treatment modalities for tooth defect, where personalized dental crown design is critical. While computer-aided design (CAD) systems have notably enhanced the efficiency of dental crown design, extensive manual adjustments are still required in the clinic workflow. Recent studies have explored the application of learning-based methods for the automated generation of restorative dental crowns. Nevertheless, these approaches were challenged by inadequate spatial resolution, noisy outputs, and overextension of surface reconstruction. To address these limitations, we propose \totalframework, a margin-aware mesh generation framework comprising CrownDeformR and CrownSegger. Inspired by the clinic manual workflow of dental crown design, we designed CrownDeformR to deform an initial template to the target crown based on anatomical context, which is extracted by a multi-scale intraoral scan encoder. Additionally, we introduced \marginseg, a novel margin segmentation network, to extract the cervical margin of the target tooth. The performance of CrownDeformR improved with the cervical margin as an extra constraint. And it was also utilized as the boundary condition for the tailored postprocessing method, which removed the overextended area of the reconstructed surface. We constructed a large-scale intraoral scan dataset and performed extensive experiments. The proposed method significantly outperformed existing approaches in both geometric accuracy and clinical feasibility.
• 摘要：牙冠修复是牙齿缺损最常见的治疗方式之一，个性化牙冠设计至关重要。虽然计算机辅助设计 (CAD) 系统显着提高了牙冠设计的效率，但临床工作流程中仍然需要大量的手动调整。最近的研究探索了基于学习的方法在自动生成修复牙冠中的应用。然而，这些方法受到空间分辨率不足、输出噪声和表面重建过度扩展的挑战。为了解决这些限制，我们提出了 \totalframework，一个由 CrownDeformR 和 CrownSegger 组成的边缘感知网格生成框架。受牙冠设计的临床手动工作流程的启发，我们设计了 CrownDeformR，根据解剖学背景将初始模板变形为目标牙冠，该解剖学背景由多尺度口内扫描编码器提取。此外，我们引入了 \marginseg，一种新颖的边缘分割网络，用于提取目标牙齿的颈部边缘。当颈缘作为额外约束时，CrownDeformR 的性能得到改善。并且它也被用作定制后处理方法的边界条件，去除了重建表面的过度延伸区域。我们构建了大规模口内扫描数据集并进行了广泛的实验。所提出的方法在几何精度和临床可行性方面都显着优于现有方法。

Title: Diffusion Policy through Conditional Proximal Policy Optimization

• Authors: Ben Liu, Shunpeng Yang, Hua Chen
• Subjects: cs.LG, cs.RO
• Abstract URL: https://arxiv.org/abs/2603.04790
• Pdf URL: https://arxiv.org/pdf/2603.04790
• Copy Paste: [[2603.04790]] Diffusion Policy through Conditional Proximal Policy Optimization(https://arxiv.org/abs/2603.04790)
• Keywords: generation
• Abstract: Reinforcement learning (RL) has been extensively employed in a wide range of decision-making problems, such as games and robotics. Recently, diffusion policies have shown strong potential in modeling multi-modal behaviors, enabling more diverse and flexible action generation compared to the conventional Gaussian policy. Despite various attempts to combine RL with diffusion, a key challenge is the difficulty of computing action log-likelihood under the diffusion model. This greatly hinders the direct application of diffusion policies in on-policy reinforcement learning. Most existing methods calculate or approximate the log-likelihood through the entire denoising process in the diffusion model, which can be memory- and computationally inefficient. To overcome this challenge, we propose a novel and efficient method to train a diffusion policy in an on-policy setting that requires only evaluating a simple Gaussian probability. This is achieved by aligning the policy iteration with the diffusion process, which is a distinct paradigm compared to previous work. Moreover, our formulation can naturally handle entropy regularization, which is often difficult to incorporate into diffusion policies. Experiments demonstrate that the proposed method produces multimodal policy behaviors and achieves superior performance on a variety of benchmark tasks in both IsaacLab and MuJoCo Playground.
• 摘要：强化学习（RL）已广泛应用于各种决策问题，例如游戏和机器人技术。最近，扩散策略在多模态行为建模方面表现出了强大的潜力，与传统的高斯策略相比，可以实现更加多样化和灵活的行动生成。尽管有各种尝试将强化学习与扩散相结合，但一个关键的挑战是在扩散模型下计算动作对数似然的困难。这极大地阻碍了扩散策略在策略强化学习中的直接应用。大多数现有方法通过扩散模型中的整个去噪过程来计算或近似对数似然，这可能是内存和计算效率低下的。为了克服这一挑战，我们提出了一种新颖且有效的方法来在策略设置中训练扩散策略，该方法仅需要评估简单的高斯概率。这是通过使策略迭代与扩散过程保持一致来实现的，与之前的工作相比，这是一个独特的范例。此外，我们的公式自然可以处理熵正则化，这通常很难纳入扩散策略。实验表明，所提出的方法可以产生多模式策略行为，并在 IsaacLab 和 MuJoCo Playground 中的各种基准任务上实现卓越的性能。

Title: LAW & ORDER: Adaptive Spatial Weighting for Medical Diffusion and Segmentation

• Authors: Anugunj Naman, Ayushman Singh, Gaibo Zhang, Yaguang Zhang
• Subjects: cs.CV, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.04795
• Pdf URL: https://arxiv.org/pdf/2603.04795
• Copy Paste: [[2603.04795]] LAW & ORDER: Adaptive Spatial Weighting for Medical Diffusion and Segmentation(https://arxiv.org/abs/2603.04795)
• Keywords: generative
• Abstract: Medical image analysis relies on accurate segmentation, and benefits from controllable synthesis (of new training images). Yet both tasks of the cyclical pipeline face spatial imbalance: lesions occupy small regions against vast backgrounds. In particular, diffusion models have been shown to drift from prescribed lesion layouts, while efficient segmenters struggle on spatially uncertain regions. Adaptive spatial weighting addresses this by learning where to allocate computational resources. This paper introduces a pair of network adapters: 1) Learnable Adaptive Weighter (LAW) which predicts per-pixel loss modulation from features and masks for diffusion training, stabilized via a mix of normalization, clamping, and regularization to prevent degenerate solutions; and 2) Optimal Region Detection with Efficient Resolution (ORDER) which applies selective bidirectional skip attention at late decoder stages for efficient segmentation. Experiments on polyp and kidney tumor datasets demonstrate that LAW achieves 20% FID generative improvement over a uniform baseline (52.28 vs. 65.60), with synthetic data then improving downstream segmentation by 4.9% Dice coefficient (83.2% vs. 78.3%). ORDER reaches 6.0% Dice improvement on MK-UNet (81.3% vs. 75.3%) with 0.56 GFLOPs and just 42K parameters, remaining 730x smaller than the standard nnUNet.
• 摘要：医学图像分析依赖于精确的分割，并受益于（新训练图像）的可控合成。然而，循环管道的两项任务都面临空间不平衡：病变在广阔的背景下占据较小的区域。特别是，扩散模型已被证明会偏离规定的病变布局，而有效的分割器则在空间不确定的区域中挣扎。自适应空间加权通过学习在哪里分配计算资源来解决这个问题。本文介绍了一对网络适配器：1）可学习自适应权重器（LAW），它根据扩散训练的特征和掩模预测每像素损失调制，通过归一化、钳位和正则化的混合来稳定以防止退化解决方案； 2）具有高效分辨率的最佳区域检测（ORDER），它在解码器后期阶段应用选择性双向跳跃注意力以实现高效分割。对息肉和肾肿瘤数据集的实验表明，LAW 在统一基线上实现了 20% 的 FID 生成改进（52.28 vs. 65.60），然后合成数据将下游分割提高了 4.9% Dice 系数（83.2% vs. 78.3%）。 ORDER 在 MK-UNet 上的 Dice 改进达到 6.0%（81.3% vs. 75.3%），0.56 GFLOPs 和仅 42K 参数，比标准 nnUNet 小 730 倍。

Title: Diffusion-Based sRGB Real Noise Generation via Prompt-Driven Noise Representation Learning

• Authors: Jaekyun Ko, Dongjin Kim, Soomin Lee, Guanghui Wang, Tae Hyun Kim
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.04870
• Pdf URL: https://arxiv.org/pdf/2603.04870
• Copy Paste: [[2603.04870]] Diffusion-Based sRGB Real Noise Generation via Prompt-Driven Noise Representation Learning(https://arxiv.org/abs/2603.04870)
• Keywords: generation, generative
• Abstract: Denoising in the sRGB image space is challenging due to noise variability. Although end-to-end methods perform well, their effectiveness in real-world scenarios is limited by the scarcity of real noisy-clean image pairs, which are expensive and difficult to collect. To address this limitation, several generative methods have been developed to synthesize realistic noisy images from limited data. These generative approaches often rely on camera metadata during both training and testing to synthesize real-world noise. However, the lack of metadata or inconsistencies between devices restricts their usability. Therefore, we propose a novel framework called Prompt-Driven Noise Generation (PNG). This model is capable of acquiring high-dimensional prompt features that capture the characteristics of real-world input noise and creating a variety of realistic noisy images consistent with the distribution of the input noise. By eliminating the dependency on explicit camera metadata, our approach significantly enhances the generalizability and applicability of noise synthesis. Comprehensive experiments reveal that our model effectively produces realistic noisy images and show the successful application of these generated images in removing real-world noise across various benchmark datasets.
• 摘要：由于噪声的可变性，sRGB 图像空间中的去噪具有挑战性。尽管端到端方法表现良好，但它们在现实场景中的有效性受到真正的噪声-干净图像对稀缺的限制，这些图像对昂贵且难以收集。为了解决这个限制，已经开发了几种生成方法来从有限的数据合成真实的噪声图像。这些生成方法通常在训练和测试期间依赖相机元数据来合成现实世界的噪声。然而，元数据的缺乏或设备之间的不一致限制了它们的可用性。因此，我们提出了一种称为提示驱动噪声生成（PNG）的新颖框架。该模型能够获取高维提示特征，捕捉真实世界输入噪声的特征，并创建与输入噪声分布一致的各种逼真的噪声图像。通过消除对显式相机元数据的依赖，我们的方法显着增强了噪声合成的通用性和适用性。综合实验表明，我们的模型有效地生成了真实的噪声图像，并展示了这些生成的图像在消除各种基准数据集中的现实世界噪声方面的成功应用。

Title: Structure Observation Driven Image-Text Contrastive Learning for Computed Tomography Report Generation

• Authors: Hong Liu, Dong Wei, Qiong Peng, Yawen Huang, Xian Wu, Yefeng Zheng, Liansheng Wang
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.04878
• Pdf URL: https://arxiv.org/pdf/2603.04878
• Copy Paste: [[2603.04878]] Structure Observation Driven Image-Text Contrastive Learning for Computed Tomography Report Generation(https://arxiv.org/abs/2603.04878)
• Keywords: generation
• Abstract: Computed Tomography Report Generation (CTRG) aims to automate the clinical radiology reporting process, thereby reducing the workload of report writing and facilitating patient care. While deep learning approaches have achieved remarkable advances in X-ray report generation, their effectiveness may be limited in CTRG due to larger data volumes of CT images and more intricate details required to describe them. This work introduces a novel two-stage (structure- and report-learning) framework tailored for CTRG featuring effective structure-wise image-text contrasting. In the first stage, a set of learnable structure-specific visual queries observe corresponding structures in a CT image. The resulting observation tokens are contrasted with structure-specific textual features extracted from the accompanying radiology report with a structure-wise image-text contrastive loss. In addition, text-text similarity-based soft pseudo targets are proposed to mitigate the impact of false negatives, i.e., semantically identical image structures and texts from non-paired images and reports. Thus, the model learns structure-level semantic correspondences between CT images and reports. Further, a dynamic, diversity-enhanced negative queue is proposed to guide the network in learning to discriminate various abnormalities. In the second stage, the visual structure queries are frozen and used to select the critical image patch embeddings depicting each anatomical structure, minimizing distractions from irrelevant areas while reducing memory consumption. Also, a text decoder is added and trained for report this http URL extensive experiments on two public datasets demonstrate that our framework establishes new state-of-the-art performance for CTRG in clinical efficiency, and its components are effective.
• 摘要：计算机断层扫描报告生成（CTRG）旨在实现临床放射学报告流程的自动化，从而减少报告编写的工作量并促进患者护理。虽然深度学习方法在 X 射线报告生成方面取得了显着进步，但由于 CT 图像数据量较大且描述图像所需的细节更加复杂，因此其在 CTRG 中的有效性可能受到限制。这项工作介绍了一种专为 CTRG 定制的新颖的两阶段（结构学习和报告学习）框架，具有有效的结构明智的图像文本对比。在第一阶段，一组可学习的特定结构视觉查询观察 CT 图像中的相应结构。由此产生的观察标记与从附带的放射学报告中提取的特定结构的文本特征进行对比，并具有结构方面的图像文本对比损失。此外，提出了基于文本-文本相似性的软伪目标来减轻假阴性的影响，即来自非配对图像和报告的语义相同的图像结构和文本。因此，该模型学习 CT 图像和报告之间的结构级语义对应关系。此外，提出了一种动态的、多样性增强的负队列来指导网络学习区分各种异常。在第二阶段，视觉结构查询被冻结并用于选择描述每个解剖结构的关键图像块嵌入，最大限度地减少不相关区域的干扰，同时减少内存消耗。此外，还添加了一个文本解码器并对其进行了训练，以报告此 http URL。在两个公共数据集上进行的广泛实验表明，我们的框架为 CTRG 在临床效率方面建立了新的最先进的性能，并且其组件是有效的。

Title: FC-VFI: Faithful and Consistent Video Frame Interpolation for High-FPS Slow Motion Video Generation

• Authors: Ganggui Ding, Hao Chen, Xiaogang Xu
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.04899
• Pdf URL: https://arxiv.org/pdf/2603.04899
• Copy Paste: [[2603.04899]] FC-VFI: Faithful and Consistent Video Frame Interpolation for High-FPS Slow Motion Video Generation(https://arxiv.org/abs/2603.04899)
• Keywords: generation, generative
• Abstract: Large pre-trained video diffusion models excel in video frame interpolation but struggle to generate high fidelity frames due to reliance on intrinsic generative priors, limiting detail preservation from start and end frames. Existing methods often depend on motion control for temporal consistency, yet dense optical flow is error-prone, and sparse points lack structural context. In this paper, we propose FC-VFI for faithful and consistent video frame interpolation, supporting \(4\times\)x and \(8\times\) interpolation, boosting frame rates from 30 FPS to 120 and 240 FPS at \(2560\times 1440\)resolution while preserving visual fidelity and motion consistency. We introduce a temporal modeling strategy on the latent sequences to inherit fidelity cues from start and end frames and leverage semantic matching lines for structure-aware motion guidance, improving motion consistency. Furthermore, we propose a temporal difference loss to mitigate temporal inconsistencies. Extensive experiments show FC-VFI achieves high performance and structural integrity across diverse scenarios.
• 摘要：大型预训练视频扩散模型在视频帧插值方面表现出色，但由于依赖内在的生成先验，限制了起始帧和结束帧的细节保留，因此难以生成高保真度帧。现有的方法通常依赖于运动控制来实现时间一致性，但密集的光流容易出错，而稀疏的点缺乏结构上下文。在本文中，我们提出了 FC-VFI 来实现忠实一致的视频帧插值，支持 \(4\times\)x 和 \(8\times\) 插值，在 \(2560\times 1440\) 分辨率下将帧速率从 30 FPS 提高到 120 和 240 FPS，同时保持视觉保真度和运动一致性。我们在潜在序列上引入了时间建模策略，以继承起始帧和结束帧的保真度线索，并利用语义匹配线进行结构感知运动指导，从而提高运动一致性。此外，我们提出了时间差异损失来减轻时间不一致。大量实验表明 FC-VFI 在不同场景下实现了高性能和结构完整性。

Title: $\nabla$-Reasoner: LLM Reasoning via Test-Time Gradient Descent in Latent Space

• Authors: Peihao Wang, Ruisi Cai, Zhen Wang, Hongyuan Mei, Qiang Liu, Pan Li, Zhangyang Wang
• Subjects: cs.LG
• Abstract URL: https://arxiv.org/abs/2603.04948
• Pdf URL: https://arxiv.org/pdf/2603.04948
• Copy Paste: [[2603.04948]] $\nabla$-Reasoner: LLM Reasoning via Test-Time Gradient Descent in Latent Space(https://arxiv.org/abs/2603.04948)
• Keywords: generation
• Abstract: Scaling inference-time compute for Large Language Models (LLMs) has unlocked unprecedented reasoning capabilities. However, existing inference-time scaling methods typically rely on inefficient and suboptimal discrete search algorithms or trial-and-error prompting to improve the online policy. In this paper, we propose $\nabla$-Reasoner, an iterative generation framework that integrates differentiable optimization over token logits into the decoding loop to refine the policy on the fly. Our core component, Differentiable Textual Optimization (DTO), leverages gradient signals from both the LLM's likelihood and a reward model to refine textual representations. $\nabla$-Reasoner further incorporates rejection sampling and acceleration design to robustify and speed up decoding. Theoretically, we show that performing inference-time gradient descent in the sample space to maximize reward is dual to aligning an LLM policy via KL-regularized reinforcement learning. Empirically, $\nabla$-Reasoner achieves over 20% accuracy improvement on a challenging mathematical reasoning benchmark, while reducing number of model calls by approximately 10-40% compared to strong baselines. Overall, our work introduces a paradigm shift from zeroth-order search to first-order optimization at test time, offering a cost-effective path to amplify LLM reasoning.
• 摘要：扩展大型语言模型 (LLM) 的推理时间计算释放了前所未有的推理能力。然而，现有的推理时间缩放方法通常依赖于低效且次优的离散搜索算法或试错提示来改进在线策略。在本文中，我们提出了$\nabla$-Reasoner，这是一种迭代生成框架，它将令牌逻辑的可微优化集成到解码循环中，以动态细化策略。我们的核心组件可微文本优化 (DTO)，利用来自 LLM 可能性和奖励模型的梯度信号来细化文本表示。 $\nabla$-Reasoner 进一步结合了拒绝采样和加速设计，以增强和加速解码。从理论上讲，我们表明，在样本空间中执行推理时间梯度下降以最大化奖励与通过 KL 正则化强化学习调整 LLM 策略是双重的。根据经验，$\nabla$-Reasoner 在具有挑战性的数学推理基准上实现了超过 20% 的准确率提升，同时与强基准相比，模型调用数量减少了约 10-40%。总的来说，我们的工作引入了测试时从零阶搜索到一阶优化的范式转变，为放大 LLM 推理提供了一条经济有效的途径。

Title: A Simple Baseline for Unifying Understanding, Generation, and Editing via Vanilla Next-token Prediction

• Authors: Jie Zhu, Hanghang Ma, Jia Wang, Yayong Guan, Yanbing Zeng, Lishuai Gao, Junqiang Wu, Jie Hu, Leye Wang
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.04980
• Pdf URL: https://arxiv.org/pdf/2603.04980
• Copy Paste: [[2603.04980]] A Simple Baseline for Unifying Understanding, Generation, and Editing via Vanilla Next-token Prediction(https://arxiv.org/abs/2603.04980)
• Keywords: generation
• Abstract: In this work, we introduce Wallaroo, a simple autoregressive baseline that leverages next-token prediction to unify multi-modal understanding, image generation, and editing at the same time. Moreover, Wallaroo supports multi-resolution image input and output, as well as bilingual support for both Chinese and English. We decouple the visual encoding into separate pathways and apply a four-stage training strategy to reshape the model's capabilities. Experiments are conducted on various benchmarks where Wallaroo produces competitive performance or exceeds other unified models, suggesting the great potential of autoregressive models in unifying multi-modality understanding and generation. Our code is available at this https URL.
• 摘要：在这项工作中，我们介绍了 Wallaroo，一个简单的自回归基线，它利用下一个标记预测来同时统一多模态理解、图像生成和编辑。此外，Wallaroo支持多分辨率图像输入和输出，以及中英文双语支持。我们将视觉编码解耦为单独的路径，并应用四阶段训练策略来重塑模型的功能。在各种基准上进行了实验，Wallaroo 产生了有竞争力的性能或超过其他统一模型，这表明自回归模型在统一多模态理解和生成方面具有巨大潜力。我们的代码可以在这个 https URL 上找到。

Title: How far have we gone in Generative Image Restoration? A study on its capability, limitations and evaluation practices

• Authors: Xiang Yin, Jinfan Hu, Zhiyuan You, Kainan Yan, Yu Tang, Chao Dong, Jinjin Gu
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.05010
• Pdf URL: https://arxiv.org/pdf/2603.05010
• Copy Paste: [[2603.05010]] How far have we gone in Generative Image Restoration? A study on its capability, limitations and evaluation practices(https://arxiv.org/abs/2603.05010)
• Keywords: restoration, generation, generative
• Abstract: Generative Image Restoration (GIR) has achieved impressive perceptual realism, but how far have its practical capabilities truly advanced compared with previous methods? To answer this, we present a large-scale study grounded in a new multi-dimensional evaluation pipeline that assesses models on detail, sharpness, semantic correctness, and overall quality. Our analysis covers diverse architectures, including diffusion-based, GAN-based, PSNR-oriented, and general-purpose generation models, revealing critical performance disparities. Furthermore, our analysis uncovers a key evolution in failure modes that signifies a paradigm shift for the perception-oriented low-level vision field. The central challenge is evolving from the previous problem of detail scarcity (under-generation) to the new frontier of detail quality and semantic control (preventing over-generation). We also leverage our benchmark to train a new IQA model that better aligns with human perceptual judgments. Ultimately, this work provides a systematic study of modern generative image restoration models, offering crucial insights that redefine our understanding of their true state and chart a course for future development.
• 摘要：生成图像恢复（GIR）已经取得了令人印象深刻的感知真实感，但与以前的方法相比，其实用能力真正先进了多少？为了回答这个问题，我们提出了一项基于新的多维评估流程的大规模研究，该流程评估模型的细节、清晰度、语义正确性和整体质量。我们的分析涵盖了不同的架构，包括基于扩散、基于 GAN、面向 PSNR 和通用生成模型，揭示了关键的性能差异。此外，我们的分析揭示了故障模式的关键演变，这意味着以感知为导向的低级视觉领域的范式转变。核心挑战正在从之前的细节稀缺（生成不足）问题演变为细节质量和语义控制（防止生成过度）的新领域。我们还利用我们的基准来训练新的 IQA 模型，以更好地符合人类的感知判断。最终，这项工作提供了对现代生成图像恢复模型的系统研究，提供了重要的见解，重新定义了我们对其真实状态的理解，并为未来的发展制定了路线。

Title: Tell2Adapt: A Unified Framework for Source Free Unsupervised Domain Adaptation via Vision Foundation Model

• Authors: Yulong Shi, Shijie Li, Ziyi Li, Lin Qi
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.05012
• Pdf URL: https://arxiv.org/pdf/2603.05012
• Copy Paste: [[2603.05012]] Tell2Adapt: A Unified Framework for Source Free Unsupervised Domain Adaptation via Vision Foundation Model(https://arxiv.org/abs/2603.05012)
• Keywords: generation
• Abstract: Source Free Unsupervised Domain Adaptation (SFUDA) is critical for deploying deep learning models across diverse clinical settings. However, existing methods are typically designed for low-gap, specific domain shifts and cannot generalize into a unified, multi-modalities, and multi-target framework, which presents a major barrier to real-world application. To overcome this issue, we introduce Tell2Adapt, a novel SFUDA framework that harnesses the vast, generalizable knowledge of the Vision Foundation Model (VFM). Our approach ensures high-fidelity VFM prompts through Context-Aware Prompts Regularization (CAPR), which robustly translates varied text prompts into canonical instructions. This enables the generation of high-quality pseudo-labels for efficiently adapting the lightweight student model to target domain. To guarantee clinical reliability, the framework incorporates Visual Plausibility Refinement (VPR), which leverages the VFM's anatomical knowledge to re-ground the adapted model's predictions in target image's low-level visual features, effectively removing noise and false positives. We conduct one of the most extensive SFUDA evaluations to date, validating our framework across 10 domain adaptation directions and 22 anatomical targets, including brain, cardiac, polyp, and abdominal targets. Our results demonstrate that Tell2Adapt consistently outperforms existing approaches, achieving SOTA for a unified SFUDA framework in medical image segmentation. Code are avaliable at this https URL.
• 摘要：无源无监督域适应 (SFUDA) 对于在不同的临床环境中部署深度学习模型至关重要。然而，现有的方法通常是针对低差距、特定领域的转变而设计的，无法推广到统一的、多模态和多目标的框架，这给实际应用带来了主要障碍。为了解决这个问题，我们引入了 Tell2Adapt，这是一种新颖的 SFUDA 框架，它利用了视觉基础模型 (VFM) 的大量通用知识。我们的方法通过上下文感知提示正则化 (CAPR) 确保高保真 VFM 提示，将各种文本提示稳健地转换为规范指令。这使得能够生成高质量的伪标签，以便有效地将轻量级学生模型适应目标领域。为了保证临床可靠性，该框架采用了视觉合理性细化 (VPR)，它利用 VFM 的解剖知识将适应模型的预测重新基于目标图像的低级视觉特征，从而有效消除噪声和误报。我们进行了迄今为止最广泛的 SFUDA 评估之一，在 10 个领域适应方向和 22 个解剖目标（包括大脑、心脏、息肉和腹部目标）上验证了我们的框架。我们的结果表明，Tell2Adapt 始终优于现有方法，在医学图像分割中实现了统一 SFUDA 框架的 SOTA。代码可在此 https URL 获取。

Title: UniM: A Unified Any-to-Any Interleaved Multimodal Benchmark

• Authors: Yanlin Li, Minghui Guo, Kaiwen Zhang, Shize Zhang, Yiran Zhao, Haodong Li, Congyue Zhou, Weijie Zheng, Yushen Yan, Shengqiong Wu, Wei Ji, Lei Cui, Furu Wei, Hao Fei, Mong-Li Lee, Wynne Hsu
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.05075
• Pdf URL: https://arxiv.org/pdf/2603.05075
• Copy Paste: [[2603.05075]] UniM: A Unified Any-to-Any Interleaved Multimodal Benchmark(https://arxiv.org/abs/2603.05075)
• Keywords: generation
• Abstract: In real-world multimodal applications, systems usually need to comprehend arbitrarily combined and interleaved multimodal inputs from users, while also generating outputs in any interleaved multimedia form. This capability defines the goal of any-to-any interleaved multimodal learning under a unified paradigm of understanding and generation, posing new challenges and opportunities for advancing Multimodal Large Language Models (MLLMs). To foster and benchmark this capability, this paper introduces the UniM benchmark, the first Unified Any-to-Any Interleaved Multimodal dataset. UniM contains 31K high-quality instances across 30 domains and 7 representative modalities: text, image, audio, video, document, code, and 3D, each requiring multiple intertwined reasoning and generation capabilities. We further introduce the UniM Evaluation Suite, which assesses models along three dimensions: Semantic Correctness & Generation Quality, Response Structure Integrity, and Interleaved Coherence. In addition, we propose UniMA, an agentic baseline model equipped with traceable reasoning for structured interleaved generation. Comprehensive experiments demonstrate the difficulty of UniM and highlight key challenges and directions for advancing unified any-to-any multimodal intelligence. The project page is this https URL.
• 摘要：在现实世界的多模态应用中，系统通常需要理解来自用户的任意组合和交错的多模态输入，同时还以任何交错的多媒体形式生成输出。此功能定义了统一理解和生成范式下任意对任意交错多模态学习的目标，为推进多模态大语言模型 (MLLM) 提出了新的挑战和机遇。为了培养这种能力并对其进行基准测试，本文引入了 UniM 基准测试，这是第一个统一的任意到任意交错多模态数据集。 UniM 包含跨 30 个领域和 7 种代表性模式的 31K 个高质量实例：文本、图像、音频、视频、文档、代码和 3D，每种模式都需要多种相互交织的推理和生成功能。我们进一步介绍 UniM 评估套件，它从三个维度评估模型：语义正确性和生成质量、响应结构完整性和交错一致性。此外，我们提出了 UniMA，一种代理基线模型，配备了用于结构化交错生成的可追踪推理。综合实验证明了 UniM 的难度，并强调了推进统一的任意多模态智能的关键挑战和方向。项目页面就是这个 https URL。

Title: Orthogonal Spatial-temporal Distributional Transfer for 4D Generation

• Authors: Wei Liu, Shengqiong Wu, Bobo Li, Haoyu Zhao, Hao Fei, Mong-Li Lee, Wynne Hsu
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.05081
• Pdf URL: https://arxiv.org/pdf/2603.05081
• Copy Paste: [[2603.05081]] Orthogonal Spatial-temporal Distributional Transfer for 4D Generation(https://arxiv.org/abs/2603.05081)
• Keywords: generation
• Abstract: In the AIGC era, generating high-quality 4D content has garnered increasing research attention. Unfortunately, current 4D synthesis research is severely constrained by the lack of large-scale 4D datasets, preventing models from adequately learning the critical spatial-temporal features necessary for high-quality 4D generation, thus hindering progress in this domain. To combat this, we propose a novel framework that transfers rich spatial priors from existing 3D diffusion models and temporal priors from video diffusion models to enhance 4D synthesis. We develop a spatial-temporal-disentangled 4D (STD-4D) Diffusion model, which synthesizes 4D-aware videos through disentangled spatial and temporal latents. To facilitate the best feature transfer, we design a novel Orthogonal Spatial-temporal Distributional Transfer (Orster) mechanism, where the spatiotemporal feature distributions are carefully modeled and injected into the STD-4D Diffusion. Furthermore, during the 4D construction, we devise a spatial-temporal-aware HexPlane (ST-HexPlane) to integrate the transferred spatiotemporal features, thereby improving 4D deformation and 4D Gaussian feature modeling. Experiments demonstrate that our method significantly outperforms existing approaches, achieving superior spatial-temporal consistency and higher-quality 4D synthesis.
• 摘要：在AIGC时代，生成高质量的4D内容已经引起了越来越多的研究关注。不幸的是，当前的 4D 合成研究因缺乏大规模 4D 数据集而受到严重限制，导致模型无法充分学习高质量 4D 生成所需的关键时空特征，从而阻碍了该领域的进展。为了解决这个问题，我们提出了一种新颖的框架，可以从现有的 3D 扩散模型转移丰富的空间先验，从视频扩散模型转移丰富的时间先验，以增强 4D 合成。我们开发了一种时空分离的 4D (STD-4D) 扩散模型，该模型通过分离的空间和时间潜伏来合成 4D 感知视频。为了促进最佳的特征转移，我们设计了一种新颖的正交时空分布转移（Orster）机制，其中时空特征分布被仔细建模并注入到 STD-4D 扩散中。此外，在4D构建过程中，我们设计了一个时空感知的HexPlane（ST-HexPlane）来集成传输的时空特征，从而改进4D变形和4D高斯特征建模。实验表明，我们的方法明显优于现有方法，实现了卓越的时空一致性和更高质量的 4D 合成。

Title: Axiomatic On-Manifold Shapley via Optimal Generative Flows

• Authors: Cenwei Zhang, Lin Zhu, Manxi Lin, Lei You
• Subjects: cs.LG, cs.AI, cs.CV
• Abstract URL: https://arxiv.org/abs/2603.05093
• Pdf URL: https://arxiv.org/pdf/2603.05093
• Copy Paste: [[2603.05093]] Axiomatic On-Manifold Shapley via Optimal Generative Flows(https://arxiv.org/abs/2603.05093)
• Keywords: generative
• Abstract: Shapley-based attribution is critical for post-hoc XAI but suffers from off-manifold artifacts due to heuristic baselines. While generative methods attempt to address this, they often introduce geometric inefficiency and discretization drift. We propose a formal theory of on-manifold Aumann-Shapley attributions driven by optimal generative flows. We prove a representation theorem establishing the gradient line integral as the unique functional satisfying efficiency and geometric axioms, notably reparameterization invariance. To resolve path ambiguity, we select the kinetic-energy-minimizing Wasserstein-2 geodesic transporting a prior to the data distribution. This yields a canonical attribution family that recovers classical Shapley for additive models and admits provable stability bounds against flow approximation errors. By reframing baseline selection as a variational problem, our method experimentally outperforms baselines, achieving strict manifold adherence via vanishing Flow Consistency Error and superior semantic alignment characterized by Structure-Aware Total Variation. Our code is on this https URL.
• 摘要：基于 Shapley 的归因对于事后 XAI 至关重要，但由于启发式基线而受到流形外伪影的影响。虽然生成方法试图解决这个问题，但它们经常引入几何效率低下和离散化漂移。我们提出了一种由最优生成流驱动的流形奥曼-沙普利归因的正式理论。我们证明了一个表示定理，将梯度线积分建立为满足效率和几何公理的唯一函数，特别是重新参数化不变性。为了解决路径模糊性，我们选择动能最小化 Wasserstein-2 测地线，在数据分布之前传输 a。这产生了一个规范归因族，它恢复了加性模型的经典 Shapley 模型，并承认针对流动近似误差的可证明的稳定性界限。通过将基线选择重新定义为变分问题，我们的方法在实验上优于基线，通过消失流一致性误差和以结构感知总变分为特征的卓越语义对齐来实现严格的流形遵守。我们的代码位于此 https URL 上。

Title: Diff-ES: Stage-wise Structural Diffusion Pruning via Evolutionary Search

• Authors: Zongfang Liu, Shengkun Tang, Zongliang Wu, Xin Yuan, Zhiqiang Shen
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.05105
• Pdf URL: https://arxiv.org/pdf/2603.05105
• Copy Paste: [[2603.05105]] Diff-ES: Stage-wise Structural Diffusion Pruning via Evolutionary Search(https://arxiv.org/abs/2603.05105)
• Keywords: generation
• Abstract: Diffusion models have achieved remarkable success in high-fidelity image generation but remain computationally demanding due to their multi-step denoising process and large model sizes. Although prior work improves efficiency either by reducing sampling steps or by compressing model parameters, existing structured pruning approaches still struggle to balance real acceleration and image quality preservation. In particular, prior methods such as MosaicDiff rely on heuristic, manually tuned stage-wise sparsity schedules and stitch multiple independently pruned models during inference, which increases memory overhead. However, the importance of diffusion steps is highly non-uniform and model-dependent. As a result, schedules derived from simple heuristics or empirical observations often fail to generalize and may lead to suboptimal performance. To this end, we introduce \textbf{Diff-ES}, a stage-wise structural \textbf{Diff}usion pruning framework via \textbf{E}volutionary \textbf{S}earch, which optimizes the stage-wise sparsity schedule and executes it through memory-efficient weight routing without model duplication. Diff-ES divides the diffusion trajectory into multiple stages, automatically discovers an optimal stage-wise sparsity schedule via evolutionary search, and activates stage-conditioned weights dynamically without duplicating model parameters. Our framework naturally integrates with existing structured pruning methods for diffusion models including depth and width pruning. Extensive experiments on DiT and SDXL demonstrate that Diff-ES consistently achieves wall-clock speedups while incurring minimal degradation in generation quality, establishing state-of-the-art performance for structured diffusion model pruning.
• 摘要：扩散模型在高保真图像生成方面取得了显着的成功，但由于其多步骤去噪过程和大模型尺寸，计算量仍然很高。尽管先前的工作通过减少采样步骤或压缩模型参数来提高效率，但现有的结构化修剪方法仍然难以平衡真实加速和图像质量保持。特别是，MosaicDiff 等现有方法依赖于启发式、手动调整的逐级稀疏性计划，并在推理过程中缝合多个独立修剪的模型，这增加了内存开销。然而，扩散步骤的重要性高度不均匀且依赖于模型。因此，从简单的启发式或经验观察得出的计划通常无法概括，并可能导致性能不佳。为此，我们引入了 \textbf{Diff-ES}，这是一个通过 \textbf{E}volutionary \textbf{S}earch 的阶段式结构 \textbf{Diff}usion 剪枝框架，它优化了阶段式稀疏性调度，并通过内存有效的权重路由来执行它，而无需模型重复。 Diff-ES将扩散轨迹分为多个阶段，通过进化搜索自动发现最佳的阶段稀疏性调度，并动态激活阶段条件权重，而无需复制模型参数。我们的框架自然地与扩散模型的现有结构化修剪方法集成，包括深度和宽度修剪。 DiT 和 SDXL 上的大量实验表明，Diff-ES 始终如一地实现挂钟加速，同时将生成质量的下降降至最低，为结构化扩散模型修剪建立了最先进的性能。

Title: Wiki-R1: Incentivizing Multimodal Reasoning for Knowledge-based VQA via Data and Sampling Curriculum

• Authors: Shan Ning, Longtian Qiu, Xuming He
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.05256
• Pdf URL: https://arxiv.org/pdf/2603.05256
• Copy Paste: [[2603.05256]] Wiki-R1: Incentivizing Multimodal Reasoning for Knowledge-based VQA via Data and Sampling Curriculum(https://arxiv.org/abs/2603.05256)
• Keywords: generation
• Abstract: Knowledge-Based Visual Question Answering (KB-VQA) requires models to answer questions about an image by integrating external knowledge, posing significant challenges due to noisy retrieval and the structured, encyclopedic nature of the knowledge base. These characteristics create a distributional gap from pretrained multimodal large language models (MLLMs), making effective reasoning and domain adaptation difficult in the post-training stage. In this work, we propose \textit{Wiki-R1}, a data-generation-based curriculum reinforcement learning framework that systematically incentivizes reasoning in MLLMs for KB-VQA. Wiki-R1 constructs a sequence of training distributions aligned with the model's evolving capability, bridging the gap from pretraining to the KB-VQA target distribution. We introduce \textit{controllable curriculum data generation}, which manipulates the retriever to produce samples at desired difficulty levels, and a \textit{curriculum sampling strategy} that selects informative samples likely to yield non-zero advantages during RL updates. Sample difficulty is estimated using observed rewards and propagated to unobserved samples to guide learning. Experiments on two KB-VQA benchmarks, Encyclopedic VQA and InfoSeek, demonstrate that Wiki-R1 achieves new state-of-the-art results, improving accuracy from 35.5\% to 37.1\% on Encyclopedic VQA and from 40.1\% to 44.1\% on InfoSeek. The project page is available at this https URL.
• 摘要：基于知识的视觉问答 (KB-VQA) 需要模型通过集成外部知识来回答有关图像的问题，由于噪声检索和知识库的结构化、百科全书性质，提出了重大挑战。这些特征与预训练的多模态大语言模型 (MLLM) 产生了分布差距，使得训练后阶段的有效推理和领域适应变得困难。在这项工作中，我们提出了 \textit{Wiki-R1}，这是一种基于数据生成的课程强化学习框架，可以系统地激励 MLLM 中的 KB-VQA 推理。 Wiki-R1 构建了一系列与模型的进化能力相一致的训练分布序列，弥补了预训练与 KB-VQA 目标分布之间的差距。我们引入了 \textit{可控课程数据生成}，它操纵检索器生成所需难度级别的样本，以及 \textit{课程采样策略}，它选择可能在 RL 更新期间产生非零优势的信息样本。使用观察到的奖励来估计样本难度，并将其传播到未观察到的样本以指导学习。在 Encyclopedic VQA 和 InfoSeek 这两个 KB-VQA 基准测试上进行的实验表明，Wiki-R1 取得了最先进的结果，Encyclopedic VQA 的准确率从 35.5\% 提高到 37.1\%，InfoSeek 的准确率从 40.1\% 提高到 44.1\%。项目页面可通过此 https URL 获取。

Title: WavSLM: Single-Stream Speech Language Modeling via WavLM Distillation

• Authors: Luca Della Libera, Cem Subakan, Mirco Ravanelli
• Subjects: cs.LG, cs.AI, cs.CL, cs.SD
• Abstract URL: https://arxiv.org/abs/2603.05299
• Pdf URL: https://arxiv.org/pdf/2603.05299
• Copy Paste: [[2603.05299]] WavSLM: Single-Stream Speech Language Modeling via WavLM Distillation(https://arxiv.org/abs/2603.05299)
• Keywords: generation, generative
• Abstract: Large language models show that simple autoregressive training can yield scalable and coherent generation, but extending this paradigm to speech remains challenging due to the entanglement of semantic and acoustic information. Most existing speech language models rely on text supervision, hierarchical token streams, or complex hybrid architectures, departing from the single-stream generative pretraining paradigm that has proven effective in text. In this work, we introduce WavSLM, a speech language model trained by quantizing and distilling self-supervised WavLM representations into a single codebook and optimizing an autoregressive next-chunk prediction objective. WavSLM jointly models semantic and acoustic information within a single token stream without text supervision or text pretraining. Despite its simplicity, it achieves competitive performance on consistency benchmarks and speech generation while using fewer parameters, less training data, and supporting streaming inference. Demo samples are available at this https URL.
• 摘要：大型语言模型表明，简单的自回归训练可以产生可扩展且连贯的生成，但由于语义和声学信息的纠缠，将这种范式扩展到语音仍然具有挑战性。大多数现有的语音语言模型依赖于文本监督、分层令牌流或复杂的混合架构，偏离了已在文本中证明有效的单流生成预训练范式。在这项工作中，我们介绍了 WavSLM，这是一种语音语言模型，通过将自监督 WavLM 表示量化和提炼为单个码本并优化自回归下一个块预测目标来训练。 WavSLM 在单个标记流中联合建模语义和声学信息，无需文本监督或文本预训练。尽管它很简单，但它在一致性基准和语音生成方面实现了具有竞争力的性能，同时使用更少的参数、更少的训练数据并支持流式推理。此 https URL 提供了演示示例。

Title: Frequency-Aware Error-Bounded Caching for Accelerating Diffusion Transformers

• Authors: Guandong Li
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.05315
• Pdf URL: https://arxiv.org/pdf/2603.05315
• Copy Paste: [[2603.05315]] Frequency-Aware Error-Bounded Caching for Accelerating Diffusion Transformers(https://arxiv.org/abs/2603.05315)
• Keywords: generation
• Abstract: Diffusion Transformers (DiTs) have emerged as the dominant architecture for high-quality image and video generation, yet their iterative denoising process incurs substantial computational cost during inference. Existing caching methods accelerate DiTs by reusing intermediate computations across timesteps, but they share a common limitation: treating the denoising process as uniform across time,depth, and feature dimensions. In this work, we identify three orthogonal axes of non-uniformity in DiT denoising: (1) temporal -- sensitivity to caching errors varies dramatically across the denoising trajectory; (2) depth -- consecutive caching decisions lead to cascading approximation errors; and (3) feature -- different components of the hidden state exhibit heterogeneous temporal dynamics. Based on these observations, we propose SpectralCache, a unified caching framework comprising Timestep-Aware Dynamic Scheduling (TADS), Cumulative Error Budgets (CEB), and Frequency-Decomposed Caching (FDC). On FLUX.1-schnell at 512x512 resolution, SpectralCache achieves 2.46x speedup with LPIPS 0.217 and SSIM 0.727, outperforming TeaCache (2.12x, LPIPS 0.215, SSIM 0.734) by 16% in speed while maintaining comparable quality (LPIPS difference < 1%). Our approach is training-free, plug-and-play, and compatible with existing DiT architectures.
• 摘要：扩散变压器 (DiT) 已成为高质量图像和视频生成的主导架构，但其迭代去噪过程在推理过程中会产生大量计算成本。现有的缓存方法通过跨时间步重用中间计算来加速 DiT，但它们有一个共同的限制：将去噪过程视为跨时间、深度和特征维度的统一。在这项工作中，我们确定了 DiT 去噪中非均匀性的三个正交轴：（1）时间——对缓存错误的敏感度在去噪轨迹上变化很大； (2)深度——连续的缓存决策导致级联近似误差； （3）特征——隐藏状态的不同组成部分表现出异构的时间动态。基于这些观察，我们提出了 SpectralCache，一个统一的缓存框架，包括时间步感知动态调度 (TADS)、累积错误预算 (CEB) 和频率分解缓存 (FDC)。在分辨率为 512x512 的 FLUX.1-schnell 上，SpectralCache 通过 LPIPS 0.217 和 SSIM 0.727 实现了 2.46 倍的加速，比 TeaCache（2.12 倍、LPIPS 0.215、SSIM 0.734）的速度提高了 16%，同时保持了相当的质量（LPIPS 差异 < 1%）。我们的方法无需培训、即插即用，并且与现有的 DiT 架构兼容。

Title: FairFinGAN: Fairness-aware Synthetic Financial Data Generation

• Authors: Tai Le Quy, Dung Nguyen Tuan, Trung Nguyen Thanh, Duy Tran Cong, Huyen Giang Thi Thu, Frank Hopfgartner
• Subjects: cs.LG
• Abstract URL: https://arxiv.org/abs/2603.05327
• Pdf URL: https://arxiv.org/pdf/2603.05327
• Copy Paste: [[2603.05327]] FairFinGAN: Fairness-aware Synthetic Financial Data Generation(https://arxiv.org/abs/2603.05327)
• Keywords: generation
• Abstract: Financial datasets often suffer from bias that can lead to unfair decision-making in automated systems. In this work, we propose FairFinGAN, a WGAN-based framework designed to generate synthetic financial data while mitigating bias with respect to the protected attribute. Our approach incorporates fairness constraints directly into the training process through a classifier, ensuring that the synthetic data is both fair and preserves utility for downstream predictive tasks. We evaluate our proposed model on five real-world financial datasets and compare it with existing GAN-based data generation methods. Experimental results show that our approach achieves superior fairness metrics without significant loss in data utility, demonstrating its potential as a tool for bias-aware data generation in financial applications.
• 摘要：金融数据集经常存在偏差，可能导致自动化系统做出不公平的决策。在这项工作中，我们提出了 FairFinGAN，这是一种基于 WGAN 的框架，旨在生成合成金融数据，同时减轻受保护属性的偏差。我们的方法通过分类器将公平约束直接纳入训练过程，确保合成数据既公平又保留下游预测任务的实用性。我们在五个真实世界的金融数据集上评估我们提出的模型，并将其与现有的基于 GAN 的数据生成方法进行比较。实验结果表明，我们的方法实现了卓越的公平性指标，而没有显着损失数据效用，这证明了其作为金融应用程序中偏差感知数据生成工具的潜力。

Title: InfoFlow KV: Information-Flow-Aware KV Recomputation for Long Context

• Authors: Xin Teng, Canyu Zhang, Shaoyi Zheng, Danyang Zhuo, Tianyi Zhou, Shengjie Wang
• Subjects: cs.LG
• Abstract URL: https://arxiv.org/abs/2603.05353
• Pdf URL: https://arxiv.org/pdf/2603.05353
• Copy Paste: [[2603.05353]] InfoFlow KV: Information-Flow-Aware KV Recomputation for Long Context(https://arxiv.org/abs/2603.05353)
• Keywords: generation
• Abstract: Retrieval-augmented generation (RAG) for long-context question answering is bottlenecked by inference-time prefilling over large retrieved contexts. A common strategy is to precompute key-value (KV) caches for individual documents and selectively recompute a small subset of tokens to restore global causal dependencies, but existing methods rely on heuristics or representation discrepancies without modeling whether selected tokens can effectively influence generation. We cast selective KV recomputation as an information flow problem and show that a simple attention-norm signal from the query reliably identifies tokens that are both semantically relevant and structurally positioned to propagate information, when computed under an inference-consistent RoPE geometry. We therefore reconstruct global positional assignments for retrieved chunks and introduce an information-flow-guided chunk reordering strategy. Experiments on LLM and VLM benchmarks demonstrate consistent gains over prior methods under comparable efficiency budgets.
• 摘要：用于长上下文问答的检索增强生成（RAG）因大型检索上下文的推理时间预填充而受到瓶颈。一种常见的策略是预先计算单个文档的键值 (KV) 缓存，并有选择地重新计算一小部分标记以恢复全局因果依赖性，但现有方法依赖于启发式或表示差异，而没有对所选标记是否可以有效影响生成进行建模。我们将选择性 KV 重新计算视为信息流问题，并表明，当在推理一致的 RoPE 几何结构下进行计算时，来自查询的简单注意规范信号可以可靠地识别语义相关且在结构上定位以传播信息的标记。因此，我们重建检索到的块的全局位置分配，并引入信息流引导的块重新排序策略。 LLM 和 VLM 基准的实验表明，在可比较的效率预算下，与之前的方法相比，具有一致的收益。

Title: RelaxFlow: Text-Driven Amodal 3D Generation

• Authors: Jiayin Zhu, Guoji Fu, Xiaolu Liu, Qiyuan He, Yicong Li, Angela Yao
• Subjects: cs.CV, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.05425
• Pdf URL: https://arxiv.org/pdf/2603.05425
• Copy Paste: [[2603.05425]] RelaxFlow: Text-Driven Amodal 3D Generation(https://arxiv.org/abs/2603.05425)
• Keywords: generation, generative
• Abstract: Image-to-3D generation faces inherent semantic ambiguity under occlusion, where partial observation alone is often insufficient to determine object category. In this work, we formalize text-driven amodal 3D generation, where text prompts steer the completion of unseen regions while strictly preserving input observation. Crucially, we identify that these objectives demand distinct control granularities: rigid control for the observation versus relaxed structural control for the prompt. To this end, we propose RelaxFlow, a training-free dual-branch framework that decouples control granularity via a Multi-Prior Consensus Module and a Relaxation Mechanism. Theoretically, we prove that our relaxation is equivalent to applying a low-pass filter on the generative vector field, which suppresses high-frequency instance details to isolate geometric structure that accommodates the observation. To facilitate evaluation, we introduce two diagnostic benchmarks, ExtremeOcc-3D and AmbiSem-3D. Extensive experiments demonstrate that RelaxFlow successfully steers the generation of unseen regions to match the prompt intent without compromising visual fidelity.
• 摘要：图像到 3D 生成在遮挡情况下面临固有的语义模糊性，仅部分观察通常不足以确定对象类别。在这项工作中，我们将文本驱动的非模态 3D 生成形式化，其中文本提示引导完成未见过的区域，同时严格保留输入观察。至关重要的是，我们发现这些目标需要不同的控制粒度：对观察的严格控制与对提示的宽松结构控制。为此，我们提出了RelaxFlow，这是一种免训练的双分支框架，通过多先验共识模块和松弛机制解耦控制粒度。理论上，我们证明我们的松弛相当于在生成向量场上应用低通滤波器，它抑制高频实例细节以隔离适应观察的几何结构。为了便于评估，我们引入了两个诊断基准：ExtremeOcc-3D 和 AmbiSem-3D。大量实验表明，RelaxFlow 成功引导看不见区域的生成，以匹配提示意图，而不会影响视觉保真度。

Title: SAIL: Similarity-Aware Guidance and Inter-Caption Augmentation-based Learning for Weakly-Supervised Dense Video Captioning

• Authors: Ye-Chan Kim, SeungJu Cha, Si-Woo Kim, Minju Jeon, Hyungee Kim, Dong-Jin Kim
• Subjects: cs.CV, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.05437
• Pdf URL: https://arxiv.org/pdf/2603.05437
• Copy Paste: [[2603.05437]] SAIL: Similarity-Aware Guidance and Inter-Caption Augmentation-based Learning for Weakly-Supervised Dense Video Captioning(https://arxiv.org/abs/2603.05437)
• Keywords: generation
• Abstract: Weakly-Supervised Dense Video Captioning aims to localize and describe events in videos trained only on caption annotations, without temporal boundaries. Prior work introduced an implicit supervision paradigm based on Gaussian masking and complementary captioning. However, existing method focuses merely on generating non-overlapping masks without considering their semantic relationship to corresponding events, resulting in simplistic, uniformly distributed masks that fail to capture semantically meaningful regions. Moreover, relying solely on ground-truth captions leads to sub-optimal performance due to the inherent sparsity of existing datasets. In this work, we propose SAIL, which constructs semantically-aware masks through cross-modal alignment. Our similarity aware training objective guides masks to emphasize video regions with high similarity to their corresponding event captions. Furthermore, to guide more accurate mask generation under sparse annotation settings, we introduce an LLM-based augmentation strategy that generates synthetic captions to provide additional alignment signals. These synthetic captions are incorporated through an inter-mask mechanism, providing auxiliary guidance for precise temporal localization without degrading the main objective. Experiments on ActivityNet Captions and YouCook2 demonstrate state-of-the-art performance on both captioning and localization metrics.
• 摘要：弱监督密集视频字幕旨在定位和描述仅根据字幕注释训练的视频中的事件，没有时间边界。之前的工作引入了基于高斯掩蔽和补充字幕的隐式监督范式。然而，现有的方法仅仅关注于生成不重叠的掩码，而不考虑它们与相应事件的语义关系，导致简单化、均匀分布的掩码无法捕获语义上有意义的区域。此外，由于现有数据集固有的稀疏性，仅依赖真实字幕会导致性能次优。在这项工作中，我们提出了 SAIL，它通过跨模态对齐构建语义感知掩模。我们的相似性感知训练目标指导掩模强调与其相应事件标题高度相似的视频区域。此外，为了在稀疏注释设置下指导更准确的掩模生成，我们引入了基于 LLM 的增强策略，该策略生成合成标题以提供额外的对齐信号。这些合成字幕通过掩模间机制合并，为精确的时间定位提供辅助指导，而不会降低主要目标。 ActivityNet Captions 和 YouCook2 上的实验展示了字幕和本地化指标的最先进性能。

Title: RealWonder: Real-Time Physical Action-Conditioned Video Generation

• Authors: Wei Liu, Ziyu Chen, Zizhang Li, Yue Wang, Hong-Xing Yu, Jiajun Wu
• Subjects: cs.CV, cs.AI, cs.GR
• Abstract URL: https://arxiv.org/abs/2603.05449
• Pdf URL: https://arxiv.org/pdf/2603.05449
• Copy Paste: [[2603.05449]] RealWonder: Real-Time Physical Action-Conditioned Video Generation(https://arxiv.org/abs/2603.05449)
• Keywords: generation
• Abstract: Current video generation models cannot simulate physical consequences of 3D actions like forces and robotic manipulations, as they lack structural understanding of how actions affect 3D scenes. We present RealWonder, the first real-time system for action-conditioned video generation from a single image. Our key insight is using physics simulation as an intermediate bridge: instead of directly encoding continuous actions, we translate them through physics simulation into visual representations (optical flow and RGB) that video models can process. RealWonder integrates three components: 3D reconstruction from single images, physics simulation, and a distilled video generator requiring only 4 diffusion steps. Our system achieves 13.2 FPS at 480x832 resolution, enabling interactive exploration of forces, robot actions, and camera controls on rigid objects, deformable bodies, fluids, and granular materials. We envision RealWonder opens new opportunities to apply video models in immersive experiences, AR/VR, and robot learning. Our code and model weights are publicly available in our project website: this https URL
• 摘要：当前的视频生成模型无法模拟 3D 动作（例如力和机器人操作）的物理后果，因为它们缺乏对动作如何影响 3D 场景的结构理解。我们推出 RealWonder，这是第一个从单个图像生成动作条件视频的实时系统。我们的主要见解是使用物理模拟作为中间桥梁：我们不是直接编码连续动作，而是通过物理模拟将它们转换为视频模型可以处理的视觉表示（光流和 RGB）。 RealWonder 集成了三个组件：从单个图像进行 3D 重建、物理模拟以及仅需要 4 个扩散步骤的精炼视频生成器。我们的系统在 480x832 分辨率下达到 13.2 FPS，能够对刚性物体、可变形体、流体和颗粒材料上的力、机器人动作和相机控制进行交互式探索。我们预计 RealWonder 将为视频模型在沉浸式体验、AR/VR 和机器人学习中的应用提供新的机会。我们的代码和模型权重在我们的项目网站上公开：此 https URL

Title: Beyond Scattered Acceptance: Fast and Coherent Inference for DLMs via Longest Stable Prefixes

• Authors: Pengxiang Li, Joey Tsai, Hongwei Xue, Kunyu Shi, Shilin Yan
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.05454
• Pdf URL: https://arxiv.org/pdf/2603.05454
• Copy Paste: [[2603.05454]] Beyond Scattered Acceptance: Fast and Coherent Inference for DLMs via Longest Stable Prefixes(https://arxiv.org/abs/2603.05454)
• Keywords: generation
• Abstract: Diffusion Language Models (DLMs) promise highly parallel text generation, yet their practical inference speed is often bottlenecked by suboptimal decoding schedulers. Standard approaches rely on 'scattered acceptance'-committing high confidence tokens at disjoint positions throughout the sequence. This approach inadvertently fractures the Key-Value (KV) cache, destroys memory locality, and forces the model into costly, repeated repairs across unstable token boundaries. To resolve this, we present the Longest Stable Prefix (LSP) scheduler, a training-free and model-agnostic inference paradigm based on monolithic prefix absorption. In each denoising step, LSP evaluates token stability via a single forward pass, dynamically identifies a contiguous left-aligned block of stable predictions, and snaps its boundary to natural linguistic or structural delimiters before an atomic commitment. This prefix-first topology yields dual benefits: systemically, it converts fragmented KV cache updates into efficient, contiguous appends; algorithmically, it preserves bidirectional lookahead over a geometrically shrinking active suffix, drastically reducing token flip rates and denoiser calls. Extensive evaluations on LLaDA-8B and Dream-7B demonstrate that LSP accelerates inference by up to 3.4x across rigorous benchmarks including mathematical reasoning, code generation, multilingual (CJK) tasks, and creative writing while matching or slightly improving output quality. By fundamentally restructuring the commitment topology, LSP bridges the gap between the theoretical parallelism of DLMs and practical hardware efficiency.
• 摘要：扩散语言模型 (DLM) 承诺高度并行的文本生成，但其实际推理速度常常受到次优解码调度程序的瓶颈。标准方法依赖于“分散接受”——在整个序列中不相交的位置提交高置信度令牌。这种方法无意中破坏了键值 (KV) 缓存，破坏了内存局部性，并迫使模型在不稳定的令牌边界上进行代价高昂的重复修复。为了解决这个问题，我们提出了最长稳定前缀（LSP）调度器，这是一种基于整体前缀吸收的免训练且与模型无关的推理范式。在每个去噪步骤中，LSP 通过单个前向传递评估令牌稳定性，动态识别连续的左对齐稳定预测块，并在原子承诺之前将其边界捕捉到自然语言或结构分隔符。这种前缀优先的拓扑结构具有双重好处：系统地，它将碎片化的 KV 缓存更新转换为高效、连续的追加；在算法上，它在几何收缩的活动后缀上保留双向前瞻，大大降低了令牌翻转率和降噪器调用。对 LLaDA-8B 和 Dream-7B 的广泛评估表明，LSP 在严格的基准测试中将推理速度提高了 3.4 倍，包括数学推理、代码生成、多语言 (CJK) 任务和创意写作，同时匹配或略微提高了输出质量。通过从根本上重构承诺拓扑，LSP 弥合了 DLM 的理论并行性与实际硬件效率之间的差距。

Title: HALP: Detecting Hallucinations in Vision-Language Models without Generating a Single Token

• Authors: Sai Akhil Kogilathota, Sripadha Vallabha E G, Luzhe Sun, Jiawei Zhou
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.05465
• Pdf URL: https://arxiv.org/pdf/2603.05465
• Copy Paste: [[2603.05465]] HALP: Detecting Hallucinations in Vision-Language Models without Generating a Single Token(https://arxiv.org/abs/2603.05465)
• Keywords: generation
• Abstract: Hallucinations remain a persistent challenge for vision-language models (VLMs), which often describe nonexistent objects or fabricate facts. Existing detection methods typically operate after text generation, making intervention both costly and untimely. We investigate whether hallucination risk can instead be predicted before any token is generated by probing a model's internal representations in a single forward pass. Across a diverse set of vision-language tasks and eight modern VLMs, including Llama-3.2-Vision, Gemma-3, Phi-4-VL, and Qwen2.5-VL, we examine three families of internal representations: (i) visual-only features without multimodal fusion, (ii) vision-token representations within the text decoder, and (iii) query-token representations that integrate visual and textual information before generation. Probes trained on these representations achieve strong hallucination-detection performance without decoding, reaching up to 0.93 AUROC on Gemma-3-12B, Phi-4-VL 5.6B, and Molmo 7B. Late query-token states are the most predictive for most models, while visual or mid-layer features dominate in a few architectures (e.g., ~0.79 AUROC for Qwen2.5-VL-7B using visual-only features). These results demonstrate that (1) hallucination risk is detectable pre-generation, (2) the most informative layer and modality vary across architectures, and (3) lightweight probes have the potential to enable early abstention, selective routing, and adaptive decoding to improve both safety and efficiency.
• 摘要：幻觉仍然是视觉语言模型（VLM）面临的一个持续挑战，它经常描述不存在的物体或捏造事实。现有的检测方法通常在文本生成后运行，使得干预既昂贵又不及时。我们通过在单次前向传递中探测模型的内部表示来研究是否可以在生成任何令牌之前预测幻觉风险。在一系列不同的视觉语言任务和八个现代 VLM（包括 Llama-3.2-Vision、Gemma-3、Phi-4-VL 和 Qwen2.5-VL）中，我们检查了三个内部表示家族：（i）没有多模态融合的纯视觉特征，（ii）文本解码器中的视觉令牌表示，以及（iii）在生成之前集成视觉和文本信息的查询令牌表示。在这些表示上训练的探针无需解码即可实现强大的幻觉检测性能，在 Gemma-3-12B、Phi-4-VL 5.6B 和 Molmo 7B 上达到 0.93 AUROC。后期查询令牌状态对于大多数模型来说最具预测性，而视觉或中间层特征在少数架构中占主导地位（例如，使用仅视觉特征的 Qwen2.5-VL-7B 的 AUROC 约为 0.79）。这些结果表明，（1）幻觉风险在生成前是可检测到的，（2）信息最丰富的层和模式因架构而异，（3）轻量级探针有潜力实现早期放弃、选择性路由和自适应解码，以提高安全性和效率。

Title: Accelerating Text-to-Video Generation with Calibrated Sparse Attention

• Authors: Shai Yehezkel, Shahar Yadin, Noam Elata, Yaron Ostrovsky-Berman, Bahjat Kawar
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.05503
• Pdf URL: https://arxiv.org/pdf/2603.05503
• Copy Paste: [[2603.05503]] Accelerating Text-to-Video Generation with Calibrated Sparse Attention(https://arxiv.org/abs/2603.05503)
• Keywords: generation
• Abstract: Recent diffusion models enable high-quality video generation, but suffer from slow runtimes. The large transformer-based backbones used in these models are bottlenecked by spatiotemporal attention. In this paper, we identify that a significant fraction of token-to-token connections consistently yield negligible scores across various inputs, and their patterns often repeat across queries. Thus, the attention computation in these cases can be skipped with little to no effect on the result. This observation continues to hold for connections among local token blocks. Motivated by this, we introduce CalibAtt, a training-free method that accelerates video generation via calibrated sparse attention. CalibAtt performs an offline calibration pass that identifies block-level sparsity and repetition patterns that are stable across inputs, and compiles these patterns into optimized attention operations for each layer, head, and diffusion timestep. At inference time, we compute the selected input-dependent connections densely, and skip the unselected ones in a hardware-efficient manner. Extensive experiments on Wan 2.1 14B, Mochi 1, and few-step distilled models at various resolutions show that CalibAtt achieves up to 1.58x end-to-end speedup, outperforming existing training-free methods while maintaining video generation quality and text-video alignment.
• 摘要：最近的扩散模型可以生成高质量的视频，但运行时间很慢。这些模型中使用的基于变压器的大型骨干网受到时空注意力的瓶颈。在本文中，我们发现很大一部分令牌到令牌连接在各种输入中始终产生可以忽略不计的分数，并且它们的模式经常在查询中重复。因此，在这些情况下，注意力计算可以被跳过，对结果几乎没有影响。对于本地令牌块之间的连接，这一观察结果仍然成立。受此启发，我们引入了 CalibAtt，这是一种无需训练的方法，可通过校准的稀疏注意力加速视频生成。 CalibAtt 执行离线校准过程，识别跨输入稳定的块级稀疏性和重复模式，并将这些模式编译为每个层、头部和扩散时间步长的优化注意操作。在推理时，我们密集地计算选定的依赖于输入的连接，并以硬件高效的方式跳过未选定的连接。在 Wan 2.1 14B、Mochi 1 和各种分辨率下的几步蒸馏模型上进行的大量实验表明，CalibAtt 实现了高达 1.58 倍的端到端加速，优于现有的免训练方法，同时保持视频生成质量和文本视频对齐。

Title: FaceCam: Portrait Video Camera Control via Scale-Aware Conditioning

• Authors: Weijie Lyu, Ming-Hsuan Yang, Zhixin Shu
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2603.05506
• Pdf URL: https://arxiv.org/pdf/2603.05506
• Copy Paste: [[2603.05506]] FaceCam: Portrait Video Camera Control via Scale-Aware Conditioning(https://arxiv.org/abs/2603.05506)
• Keywords: generation
• Abstract: We introduce FaceCam, a system that generates video under customizable camera trajectories for monocular human portrait video input. Recent camera control approaches based on large video-generation models have shown promising progress but often exhibit geometric distortions and visual artifacts on portrait videos due to scale-ambiguous camera representations or 3D reconstruction errors. To overcome these limitations, we propose a face-tailored scale-aware representation for camera transformations that provides deterministic conditioning without relying on 3D priors. We train a video generation model on both multi-view studio captures and in-the-wild monocular videos, and introduce two camera-control data generation strategies: synthetic camera motion and multi-shot stitching, to exploit stationary training cameras while generalizing to dynamic, continuous camera trajectories at inference time. Experiments on Ava-256 dataset and diverse in-the-wild videos demonstrate that FaceCam achieves superior performance in camera controllability, visual quality, identity and motion preservation.
• 摘要：我们介绍 FaceCam，这是一个可以在可定制的相机轨迹下生成视频的系统，用于单眼人像视频输入。最近基于大型视频生成模型的相机控制方法已经显示出有希望的进展，但由于尺度模糊的相机表示或 3D 重建错误，经常在肖像视频上表现出几何失真和视觉伪影。为了克服这些限制，我们提出了一种用于相机变换的面部定制的尺度感知表示，它可以在不依赖 3D 先验的情况下提供确定性条件。我们在多视图工作室捕获和野外单目视频上训练视频生成模型，并引入两种摄像机控制数据生成策略：合成摄像机运动和多镜头拼接，以利用固定训练摄像机，同时在推理时推广到动态、连续的摄像机轨迹。在 Ava-256 数据集和各种野外视频上的实验表明，FaceCam 在相机可控性、视觉质量、身份和运动保持方面实现了卓越的性能。