2025-12-25

Title: MaskOpt: A Large-Scale Mask Optimization Dataset to Advance AI in Integrated Circuit Manufacturing

• Authors: Yuting Hu, Lei Zhuang, Hua Xiang, Jinjun Xiong, Gi-Joon Nam
• Subjects: cs.LG, cs.AI, cs.CV
• Abstract URL: https://arxiv.org/abs/2512.20655
• Pdf URL: https://arxiv.org/pdf/2512.20655
• Copy Paste: [[2512.20655]] MaskOpt: A Large-Scale Mask Optimization Dataset to Advance AI in Integrated Circuit Manufacturing(https://arxiv.org/abs/2512.20655)
• Keywords: generation
• Abstract: As integrated circuit (IC) dimensions shrink below the lithographic wavelength, optical lithography faces growing challenges from diffraction and process variability. Model-based optical proximity correction (OPC) and inverse lithography technique (ILT) remain indispensable but computationally expensive, requiring repeated simulations that limit scalability. Although deep learning has been applied to mask optimization, existing datasets often rely on synthetic layouts, disregard standard-cell hierarchy, and neglect the surrounding contexts around the mask optimization targets, thereby constraining their applicability to practical mask optimization. To advance deep learning for cell- and context-aware mask optimization, we present MaskOpt, a large-scale benchmark dataset constructed from real IC designs at the 45$\mathrm{nm}$ node. MaskOpt includes 104,714 metal-layer tiles and 121,952 via-layer tiles. Each tile is clipped at a standard-cell placement to preserve cell information, exploiting repeated logic gate occurrences. Different context window sizes are supported in MaskOpt to capture the influence of neighboring shapes from optical proximity effects. We evaluate state-of-the-art deep learning models for IC mask optimization to build up benchmarks, and the evaluation results expose distinct trade-offs across baseline models. Further context size analysis and input ablation studies confirm the importance of both surrounding geometries and cell-aware inputs in achieving accurate mask generation.
• 摘要：随着集成电路 (IC) 尺寸缩小到光刻波长以下，光学光刻面临着来自衍射和工艺变化的日益严峻的挑战。基于模型的光学邻近校正 (OPC) 和逆光刻技术 (ILT) 仍然不可或缺，但计算成本高昂，需要重复模拟，从而限制了可扩展性。尽管深度学习已应用于掩模优化，但现有数据集通常依赖于合成布局，忽视标准单元层次结构，并忽略掩模优化目标周围的上下文，从而限制了它们在实际掩模优化中的适用性。为了推进细胞和上下文感知掩模优化的深度学习，我们提出了 MaskOpt，这是一个根据 45$\mathrm{nm}$ 节点的真实 IC 设计构建的大规模基准数据集。 MaskOpt 包括 104,714 个金属层块和 121,952 个通孔层块。每个图块都被剪切在标准单元位置，以保留单元信息，利用重复的逻辑门出现。 MaskOpt 支持不同的上下文窗口大小，以捕获光学邻近效应中相邻形状的影响。我们评估用于 IC 掩模优化的最先进的深度学习模型，以建立基准，评估结果揭示了基准模型之间的独特权衡。进一步的上下文尺寸分析和输入消融研究证实了周围几何形状和细胞感知输入在实现准确掩模生成方面的重要性。

Title: Managing the Stochastic: Foundations of Learning in Neuro-Symbolic Systems for Software Engineering

• Authors: Matthew Thompson
• Subjects: cs.LG, cs.AI, cs.SE
• Abstract URL: https://arxiv.org/abs/2512.20660
• Pdf URL: https://arxiv.org/pdf/2512.20660
• Copy Paste: [[2512.20660]] Managing the Stochastic: Foundations of Learning in Neuro-Symbolic Systems for Software Engineering(https://arxiv.org/abs/2512.20660)
• Keywords: generation
• Abstract: Current approaches to AI coding agents appear to blur the lines between the Large Language Model (LLM) and the agent itself, asking the LLM to make decisions best left to deterministic processes. This leads to systems prone to stochastic failures such as gaming unit tests or hallucinating syntax. Drawing on established software engineering practices that provide deterministic frameworks for managing unpredictable processes, this paper proposes setting the control boundary such that the LLM is treated as a component of the environment environment -- preserving its creative stochasticity -- rather than the decision-making agent. A \textbf{Dual-State Architecture} is formalized, separating workflow state (deterministic control flow) from environment state (stochastic generation). \textbf{Atomic Action Pairs} couple generation with verification as indivisible transactions, where \textbf{Guard Functions} act as sensing actions that project probabilistic outputs onto observable workflow state. The framework is validated on three code generation tasks across 13 LLMs (1.3B--15B parameters). For qualified instruction-following models, task success rates improved by up to 66 percentage points at 1.2--2.1$\times$ baseline computational cost. The results suggest that architectural constraints can substitute for parameter scale in achieving reliable code generation.
• 摘要：当前的 AI 编码代理方法似乎模糊了大型语言模型 (LLM) 和代理本身之间的界限，要求 LLM 做出最好留给确定性过程的决策。这导致系统容易出现随机故障，例如游戏单元测试或幻觉语法。借鉴已建立的软件工程实践，为管理不可预测的过程提供确定性框架，本文建议设置控制边界，使法学硕士被视为环境的一个组成部分——保留其创造性的随机性——而不是决策代理。双状态架构是形式化的，将工作流状态（确定性控制流）与环境状态（随机生成）分开。 \textbf{原子动作对}将生成与验证耦合为不可分割的事务，其中 \textbf{Guard Functions} 充当将概率输出投影到可观察的工作流状态的传感动作。该框架在 13 个法学硕士（1.3B--15B 参数）的三个代码生成任务上进行了验证。对于合格的指令跟踪模型，任务成功率在 1.2--2.1$\times$ 基线计算成本下提高了高达 66 个百分点。结果表明，架构约束可以替代参数规模来实现可靠的代码生成。

Title: Dominating vs. Dominated: Generative Collapse in Diffusion Models

• Authors: Hayeon Jeong, Jong-Seok Lee
• Subjects: cs.LG, cs.AI
• Abstract URL: https://arxiv.org/abs/2512.20666
• Pdf URL: https://arxiv.org/pdf/2512.20666
• Copy Paste: [[2512.20666]] Dominating vs. Dominated: Generative Collapse in Diffusion Models(https://arxiv.org/abs/2512.20666)
• Keywords: generation, generative
• Abstract: Text-to-image diffusion models have drawn significant attention for their ability to generate diverse and high-fidelity images. However, when generating from multi-concept prompts, one concept token often dominates the generation, suppressing the others-a phenomenon we term the Dominant-vs-Dominated (DvD) imbalance. To systematically analyze this imbalance, we introduce DominanceBench and examine its causes from both data and architectural perspectives. Through various experiments, we show that the limited instance diversity in training data exacerbates the inter-concept interference. Analysis of cross-attention dynamics further reveals that dominant tokens rapidly saturate attention, progressively suppressing others across diffusion timesteps. In addition, head ablation studies show that the DvD behavior arises from distributed attention mechanisms across multiple heads. Our findings provide key insights into generative collapse, advancing toward more reliable and controllable text-to-image generation.
• 摘要：文本到图像的扩散模型因其生成多样化和高保真图像的能力而引起了广泛关注。然而，当从多概念提示生成时，一个概念标记通常在生成中占主导地位，抑制其他概念标记，这种现象我们称为主导与被主导（DvD）不平衡。为了系统地分析这种不平衡，我们引入了DominanceBench，并从数据和架构的角度审视其原因。通过各种实验，我们表明训练数据中有限的实例多样性加剧了概念间的干扰。对交叉注意力动态的分析进一步表明，主导令牌迅速饱和注意力，在扩散时间步长中逐渐抑制其他令牌。此外，头部消融研究表明，DvD 行为源于多个头部的分布式注意力机制。我们的研究结果提供了对生成崩溃的重要见解，推动了更可靠、更可控的文本到图像的生成。

Title: Improving Cardiac Risk Prediction Using Data Generation Techniques

• Authors: Alexandre Cabodevila, Pedro Gamallo-Fernandez, Juan C. Vidal, Manuel Lama
• Subjects: cs.LG, cs.AI
• Abstract URL: https://arxiv.org/abs/2512.20669
• Pdf URL: https://arxiv.org/pdf/2512.20669
• Copy Paste: [[2512.20669]] Improving Cardiac Risk Prediction Using Data Generation Techniques(https://arxiv.org/abs/2512.20669)
• Keywords: generation
• Abstract: Cardiac rehabilitation constitutes a structured clinical process involving multiple interdependent phases, individualized medical decisions, and the coordinated participation of diverse healthcare professionals. This sequential and adaptive nature enables the program to be modeled as a business process, thereby facilitating its analysis. Nevertheless, studies in this context face significant limitations inherent to real-world medical databases: data are often scarce due to both economic costs and the time required for collection; many existing records are not suitable for specific analytical purposes; and, finally, there is a high prevalence of missing values, as not all patients undergo the same diagnostic tests. To address these limitations, this work proposes an architecture based on a Conditional Variational Autoencoder (CVAE) for the synthesis of realistic clinical records that are coherent with real-world observations. The primary objective is to increase the size and diversity of the available datasets in order to enhance the performance of cardiac risk prediction models and to reduce the need for potentially hazardous diagnostic procedures, such as exercise stress testing. The results demonstrate that the proposed architecture is capable of generating coherent and realistic synthetic data, whose use improves the accuracy of the various classifiers employed for cardiac risk detection, outperforming state-of-the-art deep learning approaches for synthetic data generation.
• 摘要：心脏康复是一个结构化的临床过程，涉及多个相互依赖的阶段、个性化的医疗决策以及不同医疗保健专业人员的协调参与。这种顺序性和自适应性使得程序能够被建模为业务流程，从而促进其分析。然而，这方面的研究面临着现实世界医学数据库固有的重大局限性：由于经济成本和收集所需的时间，数据往往稀缺；许多现有记录不适合特定分析目的；最后，缺失值的发生率很高，因为并非所有患者都接受相同的诊断测试。为了解决这些限制，这项工作提出了一种基于条件变分自动编码器（CVAE）的架构，用于合成与现实世界观察一致的真实临床记录。主要目标是增加可用数据集的规模和多样性，以增强心脏风险预测模型的性能并减少对潜在危险诊断程序（例如运动压力测试）的需求。结果表明，所提出的架构能够生成连贯且真实的合成数据，其使用提高了用于心脏风险检测的各种分类器的准确性，优于用于合成数据生成的最先进的深度学习方法。

Title: PHOTON: Hierarchical Autoregressive Modeling for Lightspeed and Memory-Efficient Language Generation

• Authors: Yuma Ichikawa, Naoya Takagi, Takumi Nakagawa, Yuzi Kanazawa, Akira Sakai
• Subjects: cs.LG, cs.AI, cs.CL, cs.DC
• Abstract URL: https://arxiv.org/abs/2512.20687
• Pdf URL: https://arxiv.org/pdf/2512.20687
• Copy Paste: [[2512.20687]] PHOTON: Hierarchical Autoregressive Modeling for Lightspeed and Memory-Efficient Language Generation(https://arxiv.org/abs/2512.20687)
• Keywords: generation
• Abstract: Transformers operate as horizontal token-by-token scanners; at each generation step, the model attends to an ever-growing sequence of token-level states. This access pattern increases prefill latency and makes long-context decoding increasingly memory-bound, as KV-cache reads and writes dominate inference throughput rather than arithmetic computation. We propose Parallel Hierarchical Operation for Top-down Networks (PHOTON), a hierarchical autoregressive model that replaces flat scanning with vertical, multi-resolution context access. PHOTON maintains a hierarchy of latent streams: a bottom-up encoder progressively compresses tokens into low-rate contextual states, while lightweight top-down decoders reconstruct fine-grained token representations. Experimental results show that PHOTON is superior to competitive Transformer-based language models regarding the throughput-quality trade-off, offering significant advantages in long-context and multi-query tasks. This reduces decode-time KV-cache traffic, yielding up to $10^{3}\times$ higher throughput per unit memory.
• 摘要：Transformer 作为水平逐个令牌扫描仪运行；在每个生成步骤中，模型都会处理不断增长的令牌级状态序列。这种访问模式增加了预填充延迟，并使长上下文解码越来越受内存限制，因为 KV 缓存读取和写入主导推理吞吐量而不是算术计算。我们提出了自上而下网络的并行分层操作（PHOTON），这是一种分层自回归模型，用垂直、多分辨率上下文访问代替平面扫描。 PHOTON 维护潜在流的层次结构：自下而上的编码器逐步将令牌压缩为低速率上下文状态，而轻量级的自上而下的解码器则重建细粒度的令牌表示。实验结果表明，在吞吐量质量权衡方面，PHOTON 优于基于 Transformer 的竞争语言模型，在长上下文和多查询任务中具有显着优势。这减少了解码时间 KV 缓存流量，每单位内存的吞吐量提高了高达 $10^{3}\times$。

Title: OccuFly: A 3D Vision Benchmark for Semantic Scene Completion from the Aerial Perspective

• Authors: Markus Gross, Sai B. Matha, Aya Fahmy, Rui Song, Daniel Cremers, Henri Meess
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2512.20770
• Pdf URL: https://arxiv.org/pdf/2512.20770
• Copy Paste: [[2512.20770]] OccuFly: A 3D Vision Benchmark for Semantic Scene Completion from the Aerial Perspective(https://arxiv.org/abs/2512.20770)
• Keywords: generation
• Abstract: Semantic Scene Completion (SSC) is crucial for 3D perception in mobile robotics, as it enables holistic scene understanding by jointly estimating dense volumetric occupancy and per-voxel semantics. Although SSC has been widely studied in terrestrial domains such as autonomous driving, aerial scenarios like autonomous flying remain largely unexplored, thereby limiting progress on downstream applications. Furthermore, LiDAR sensors represent the primary modality for SSC data generation, which poses challenges for most uncrewed aerial vehicles (UAVs) due to flight regulations, mass and energy constraints, and the sparsity of LiDAR-based point clouds from elevated viewpoints. To address these limitations, we introduce OccuFly, the first real-world, camera-based aerial SSC benchmark, captured at altitudes of 50m, 40m, and 30m during spring, summer, fall, and winter. OccuFly covers urban, industrial, and rural scenarios, provides 22 semantic classes, and the data format adheres to established conventions to facilitate seamless integration with existing research. Crucially, we propose a LiDAR-free data generation framework based on camera modality, which is ubiquitous on modern UAVs. By utilizing traditional 3D reconstruction, our framework automates label transfer by lifting a subset of annotated 2D masks into the reconstructed point cloud, thereby substantially minimizing manual 3D annotation effort. Finally, we benchmark the state-of-the-art on OccuFly and highlight challenges specific to elevated viewpoints, yielding a comprehensive vision benchmark for holistic aerial 3D scene understanding.
• 摘要：语义场景完成 (SSC) 对于移动机器人中的 3D 感知至关重要，因为它通过联合估计密集体积占用率和每体素语义来实现整体场景理解。尽管SSC已在自动驾驶等地面领域得到广泛研究，但自动飞行等空中场景在很大程度上仍未被探索，从而限制了下游应用的进展。此外，LiDAR 传感器代表了 SSC 数据生成的主要方式，由于飞行法规、质量和能量限制以及从高视角看基于 LiDAR 的点云的稀疏性，这对大多数无人驾驶飞行器 (UAV) 提出了挑战。为了解决这些限制，我们推出了 OccuFly，这是第一个现实世界中基于相机的航空 SSC 基准测试，在春季、夏季、秋季和冬季在 50m、40m 和 30m 的高度捕获。 OccuFly覆盖城市、工业和农村场景，提供22个语义类别，数据格式遵循既定惯例，便于与现有研究无缝集成。至关重要的是，我们提出了一种基于相机模态的无激光雷达数据生成框架，该框架在现代无人机上无处不在。通过利用传统的 3D 重建，我们的框架通过将带注释的 2D 掩模的子集提升到重建的点云中来自动化标签传输，从而大大减少手动 3D 注释工作。最后，我们对 OccuFly 的最新技术进行了基准测试，并强调了特定于高视角的挑战，从而为整体航空 3D 场景理解提供了全面的视觉基准。

Title: Improving Matrix Exponential for Generative AI Flows: A Taylor-Based Approach Beyond Paterson--Stockmeyer

• Authors: Jorge Sastre, Daniel Faronbi, José Miguel Alonso, Peter Traver, Javier Ibáñez, Nuria Lloret
• Subjects: cs.LG, math.NA
• Abstract URL: https://arxiv.org/abs/2512.20777
• Pdf URL: https://arxiv.org/pdf/2512.20777
• Copy Paste: [[2512.20777]] Improving Matrix Exponential for Generative AI Flows: A Taylor-Based Approach Beyond Paterson--Stockmeyer(https://arxiv.org/abs/2512.20777)
• Keywords: generative
• Abstract: The matrix exponential is a fundamental operator in scientific computing and system simulation, with applications ranging from control theory and quantum mechanics to modern generative machine learning. While Padé approximants combined with scaling and squaring have long served as the standard, recent Taylor-based methods, which utilize polynomial evaluation schemes that surpass the classical Paterson--Stockmeyer technique, offer superior accuracy and reduced computational complexity. This paper presents an optimized Taylor-based algorithm for the matrix exponential, specifically designed for the high-throughput requirements of generative AI flows. We provide a rigorous error analysis and develop a dynamic selection strategy for the Taylor order and scaling factor to minimize computational effort under a prescribed error tolerance. Extensive numerical experiments demonstrate that our approach provides significant acceleration and maintains high numerical stability compared to existing state-of-the-art implementations. These results establish the proposed method as a highly efficient tool for large-scale generative modeling.
• 摘要：矩阵指数是科学计算和系统模拟中的基本运算符，其应用范围从控制理论和量子力学到现代生成机器学习。虽然 Padé 近似与缩放和平方相结合长期以来一直作为标准，但最近基于泰勒的方法利用超越经典 Paterson-Stockmeyer 技术的多项式评估方案，提供卓越的精度并降低计算复杂性。本文提出了一种基于泰勒的优化矩阵指数算法，专门针对生成式 AI 流的高吞吐量要求而设计。我们提供严格的误差分析，并为泰勒阶数和缩放因子开发动态选择策略，以在规定的误差容限下最大限度地减少计算量。大量的数值实验表明，与现有的最先进的实现相比，我们的方法提供了显着的加速并保持了较高的数值稳定性。这些结果表明所提出的方法是大规模生成建模的高效工具。

Title: CHAMMI-75: pre-training multi-channel models with heterogeneous microscopy images

• Authors: Vidit Agrawal (1,2), John Peters (1,2), Tyler N. Thompson (1,2), Mohammad Vali Sanian (3,4), Chau Pham (5), Nikita Moshkov (6), Arshad Kazi (1,2), Aditya Pillai (1,2), Jack Freeman (1), Byunguk Kang (7,8), Samouil L. Farhi (8), Ernest Fraenkel (7), Ron Stewart (1), Lassi Paavolainen (3,4), Bryan A. Plummer (5), Juan C. Caicedo (1,2) ((1) Morgridge Institute for Research, Madison, WI, USA, (2) University of Wisconsin-Madison, Madison, WI, USA, (3) Institute for Molecular Medicine Finland (FIMM), Helsinki, Finland, (4) University of Helsinki, Helsinki, Finland, (5) Boston University, Boston, MA, USA, (6) Institute of Computational Biology, Helmholtz Munich, Neuherberg, Germany, (7) Massachusetts Institute of Technology, Cambridge, MA, USA, (8) Broad Institute of MIT and Harvard, Cambridge, MA, USA)
• Subjects: cs.CV, cs.LG
• Abstract URL: https://arxiv.org/abs/2512.20833
• Pdf URL: https://arxiv.org/pdf/2512.20833
• Copy Paste: [[2512.20833]] CHAMMI-75: pre-training multi-channel models with heterogeneous microscopy images(https://arxiv.org/abs/2512.20833)
• Keywords: generation
• Abstract: Quantifying cell morphology using images and machine learning has proven to be a powerful tool to study the response of cells to treatments. However, models used to quantify cellular morphology are typically trained with a single microscopy imaging type. This results in specialized models that cannot be reused across biological studies because the technical specifications do not match (e.g., different number of channels), or because the target experimental conditions are out of distribution. Here, we present CHAMMI-75, an open access dataset of heterogeneous, multi-channel microscopy images from 75 diverse biological studies. We curated this resource from publicly available sources to investigate cellular morphology models that are channel-adaptive and can process any microscopy image type. Our experiments show that training with CHAMMI-75 can improve performance in multi-channel bioimaging tasks primarily because of its high diversity in microscopy modalities. This work paves the way to create the next generation of cellular morphology models for biological studies.
• 摘要：使用图像和机器学习量化细胞形态已被证明是研究细胞对治疗反应的强大工具。然而，用于量化细胞形态的模型通常使用单一显微镜成像类型进行训练。这导致专业模型无法在生物学研究中重复使用，因为技术规格不匹配（例如，通道数量不同），或者因为目标实验条件不分布。在这里，我们展示了 CHAMMI-75，这是一个开放获取数据集，包含来自 75 项不同生物学研究的异构、多通道显微镜图像。我们从公开来源中策划了该资源，以研究通道自适应且可以处理任何显微镜图像类型的细胞形态模型。我们的实验表明，使用 CHAMMI-75 进行训练可以提高多通道生物成像任务的性能，主要是因为它的显微镜模式具有高度多样性。这项工作为创建用于生物学研究的下一代细胞形态模型铺平了道路。

Title: Input-Adaptive Visual Preprocessing for Efficient Fast Vision-Language Model Inference

• Authors: Putu Indah Githa Cahyani, Komang David Dananjaya Suartana, Novanto Yudistira
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2512.20839
• Pdf URL: https://arxiv.org/pdf/2512.20839
• Copy Paste: [[2512.20839]] Input-Adaptive Visual Preprocessing for Efficient Fast Vision-Language Model Inference(https://arxiv.org/abs/2512.20839)
• Keywords: generation
• Abstract: Vision-Language Models (VLMs) have demonstrated strong performance on multimodal reasoning tasks, but their deployment remains challenging due to high inference latency and computational cost, particularly when processing high-resolution visual inputs. While recent architectures such as FastVLM improve efficiency through optimized vision encoders, existing pipelines still rely on static visual preprocessing, leading to redundant computation for visually simple inputs. In this work, we propose an adaptive visual preprocessing method that dynamically adjusts input resolution and spatial coverage based on image content characteristics. The proposed approach combines content-aware image analysis, adaptive resolution selection, and content-aware cropping to reduce visual redundancy prior to vision encoding. Importantly, the method is integrated with FastVLM without modifying its architecture or requiring retraining. We evaluate the proposed method on a subset of the DocVQA dataset in an inference-only setting, focusing on efficiency-oriented metrics. Experimental results show that adaptive preprocessing reduces per-image inference time by over 50\%, lowers mean full generation time, and achieves a consistent reduction of more than 55\% in visual token count compared to the baseline pipeline. These findings demonstrate that input-aware preprocessing is an effective and lightweight strategy for improving deployment-oriented efficiency of vision-language models. To facilitate reproducibility, our implementation is provided as a fork of the FastVLM repository, incorporating the files for the proposed method, and is available at this https URL.
• 摘要：视觉语言模型 (VLM) 在多模态推理任务中表现出强大的性能，但由于推理延迟和计算成本较高，特别是在处理高分辨率视觉输入时，其部署仍然具有挑战性。虽然 FastVLM 等最新架构通过优化视觉编码器提高了效率，但现有管道仍然依赖于静态视觉预处理，导致视觉上简单输入的冗余计算。在这项工作中，我们提出了一种自适应视觉预处理方法，可根据图像内容特征动态调整输入分辨率和空间覆盖范围。所提出的方法结合了内容感知图像分析、自适应分辨率选择和内容感知裁剪，以减少视觉编码之前的视觉冗余。重要的是，该方法与 FastVLM 集成，无需修改其架构或需要重新训练。我们在仅推理设置中在 DocVQA 数据集的子集上评估所提出的方法，重点关注面向效率的指标。实验结果表明，与基线管道相比，自适应预处理将每张图像的推理时间减少了 50% 以上，降低了平均完整生成时间，并实现了视觉标记计数持续减少了 55% 以上。这些发现表明，输入感知预处理是一种有效且轻量级的策略，可提高视觉语言模型的面向部署的效率。为了促进可重复性，我们的实现作为 FastVLM 存储库的一个分支提供，合并了所提议方法的文件，并且可以通过此 https URL 获取。

Title: ALIVE: An Avatar-Lecture Interactive Video Engine with Content-Aware Retrieval for Real-Time Interaction

• Authors: Md Zabirul Islam, Md Motaleb Hossen Manik, Ge Wang
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2512.20858
• Pdf URL: https://arxiv.org/pdf/2512.20858
• Copy Paste: [[2512.20858]] ALIVE: An Avatar-Lecture Interactive Video Engine with Content-Aware Retrieval for Real-Time Interaction(https://arxiv.org/abs/2512.20858)
• Keywords: generation
• Abstract: Traditional lecture videos offer flexibility but lack mechanisms for real-time clarification, forcing learners to search externally when confusion arises. Recent advances in large language models and neural avatars provide new opportunities for interactive learning, yet existing systems typically lack lecture awareness, rely on cloud-based services, or fail to integrate retrieval and avatar-delivered explanations in a unified, privacy-preserving pipeline. We present ALIVE, an Avatar-Lecture Interactive Video Engine that transforms passive lecture viewing into a dynamic, real-time learning experience. ALIVE operates fully on local hardware and integrates (1) Avatar-delivered lecture generated through ASR transcription, LLM refinement, and neural talking-head synthesis; (2) A content-aware retrieval mechanism that combines semantic similarity with timestamp alignment to surface contextually relevant lecture segments; and (3) Real-time multimodal interaction, enabling students to pause the lecture, ask questions through text or voice, and receive grounded explanations either as text or as avatar-delivered responses. To maintain responsiveness, ALIVE employs lightweight embedding models, FAISS-based retrieval, and segmented avatar synthesis with progressive preloading. We demonstrate the system on a complete medical imaging course, evaluate its retrieval accuracy, latency characteristics, and user experience, and show that ALIVE provides accurate, content-aware, and engaging real-time support. ALIVE illustrates how multimodal AI-when combined with content-aware retrieval and local deployment-can significantly enhance the pedagogical value of recorded lectures, offering an extensible pathway toward next-generation interactive learning environments.
• 摘要：传统的讲座视频提供了灵活性，但缺乏实时澄清的机制，迫使学习者在出现困惑时向外搜索。大型语言模型和神经化身的最新进展为交互式学习提供了新的机会，但现有系统通常缺乏讲座意识，依赖基于云的服务，或者无法将检索和化身提供的解释集成到统一的隐私保护管道中。我们推出了 ALIVE，一种 Avatar-Lecture 交互式视频引擎，可将被动的讲座观看转变为动态的实时学习体验。 ALIVE 完全在本地硬件上运行，并集成了 (1) 通过 ASR 转录、LLM 细化和神经头部说话合成生成的 Avatar 讲授的讲座； (2) 内容感知检索机制，将语义相似性与时间戳对齐相结合，以显示上下文相关的讲座片段； (3) 实时多模式交互，使学生能够暂停讲座，通过文本或语音提问，并以文本或化身提供的响应形式接收有根据的解释。为了保持响应能力，ALIVE 采用轻量级嵌入模型、基于 FAISS 的检索以及具有渐进式预加载的分段化身合成。我们在完整的医学成像课程上演示了该系统，评估其检索准确性、延迟特性和用户体验，并表明 ALIVE 提供准确、内容感知和引人入胜的实时支持。 ALIVE 展示了多模式人工智能与内容感知检索和本地部署相结合如何显着提高录制讲座的教学价值，为下一代交互式学习环境提供可扩展的途径。

Title: DiEC: Diffusion Embedded Clustering

• Authors: Haidong Hu
• Subjects: cs.LG, cs.AI
• Abstract URL: https://arxiv.org/abs/2512.20905
• Pdf URL: https://arxiv.org/pdf/2512.20905
• Copy Paste: [[2512.20905]] DiEC: Diffusion Embedded Clustering(https://arxiv.org/abs/2512.20905)
• Keywords: generative
• Abstract: Deep clustering hinges on learning representations that are inherently clusterable. However, using a single encoder to produce a fixed embedding ignores the representation trajectory formed by a pretrained diffusion model across network hierarchies and noise timesteps, where clusterability varies substantially. We propose DiEC (Diffusion Embedded Clustering), which performs unsupervised clustering by directly reading internal activations from a pretrained diffusion U-Net. DiEC formulates representation selection as a two-dimensional search over layer x timestep, and exploits a weak-coupling property to decompose it into two stages. Specifically, we first fix the U-Net bottleneck layer as the Clustering-friendly Middle Layer (CML), and then use Optimal Timestep Search (OTS) to identify the clustering-optimal timestep (t*). During training, we extract bottleneck features at the fixed t* and obtain clustering representations via a lightweight residual mapping. We optimize a DEC-style KL self-training objective, augmented with adaptive graph regularization and entropy regularization to strengthen cluster structures. In parallel, we introduce a denoising-consistency branch at random timesteps to stabilize the representations and preserve generative consistency. Experiments show that DiEC achieves competitive clustering performance on multiple standard benchmarks.
• 摘要：深度聚类取决于学习本质上可聚类的表示。然而，使用单个编码器生成固定嵌入会忽略由跨网络层次结构和噪声时间步长的预训练扩散模型形成的表示轨迹，其中聚类性变化很大。我们提出 DiEC（扩散嵌入式聚类），它通过直接从预训练的扩散 U-Net 读取内部激活来执行无监督聚类。 DiEC 将表示选择制定为 x 层时间步长上的二维搜索，并利用弱耦合属性将其分解为两个阶段。具体来说，我们首先将 U-Net 瓶颈层修复为聚类友好中间层（CML），然后使用最佳时间步长搜索（OTS）来识别聚类最佳时间步长（t*）。在训练过程中，我们在固定的 t* 处提取瓶颈特征，并通过轻量级残差映射获得聚类表示。我们优化了 DEC 式的 KL 自训练目标，并通过自适应图正则化和熵正则化进行增强，以增强集群结构。同时，我们在随机时间步引入一个去噪一致性分支来稳定表示并保持生成一致性。实验表明，DiEC 在多个标准基准上实现了有竞争力的集群性能。

Title: Reasoning-Driven Amodal Completion: Collaborative Agents and Perceptual Evaluation

• Authors: Hongxing Fan, Shuyu Zhao, Jiayang Ao, Lu Sheng
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2512.20936
• Pdf URL: https://arxiv.org/pdf/2512.20936
• Copy Paste: [[2512.20936]] Reasoning-Driven Amodal Completion: Collaborative Agents and Perceptual Evaluation(https://arxiv.org/abs/2512.20936)
• Keywords: generation
• Abstract: Amodal completion, the task of inferring invisible object parts, faces significant challenges in maintaining semantic consistency and structural integrity. Prior progressive approaches are inherently limited by inference instability and error accumulation. To tackle these limitations, we present a Collaborative Multi-Agent Reasoning Framework that explicitly decouples Semantic Planning from Visual Synthesis. By employing specialized agents for upfront reasoning, our method generates a structured, explicit plan before pixel generation, enabling visually and semantically coherent single-pass synthesis. We integrate this framework with two critical mechanisms: (1) a self-correcting Verification Agent that employs Chain-of-Thought reasoning to rectify visible region segmentation and identify residual occluders strictly within the Semantic Planning phase, and (2) a Diverse Hypothesis Generator that addresses the ambiguity of invisible regions by offering diverse, plausible semantic interpretations, surpassing the limited pixel-level variations of standard random seed sampling. Furthermore, addressing the limitations of traditional metrics in assessing inferred invisible content, we introduce the MAC-Score (MLLM Amodal Completion Score), a novel human-aligned evaluation metric. Validated against human judgment and ground truth, these metrics establish a robust standard for assessing structural completeness and semantic consistency with visible context. Extensive experiments demonstrate that our framework significantly outperforms state-of-the-art methods across multiple datasets. Our project is available at: this https URL.
• 摘要：非模态完成是推断不可见对象部分的任务，在保持语义一致性和结构完整性方面面临着重大挑战。先前的渐进方法本质上受到推理不稳定和错误积累的限制。为了解决这些限制，我们提出了一个协作多智能体推理框架，该框架明确地将语义规划与视觉合成分离。通过采用专门的代理进行预先推理，我们的方法在像素生成之前生成结构化的、明确的计划，从而实现视觉和语义上连贯的单通道合成。我们将该框架与两个关键机制相结合：（1）一个自我纠正的验证代理，它采用思想链推理来纠正可见区域分割并严格在语义规划阶段识别残留遮挡物，以及（2）一个多样化的假设生成器，它通过提供多样化的、合理的语义解释来解决不可见区域的模糊性，超越了标准随机种子采样的有限像素级变化。此外，为了解决传统指标在评估推断的不可见内容方面的局限性，我们引入了 MAC-Score（MLLM Amodal Completion Score），这是一种新颖的人性化评估指标。这些指标经过人类判断和基本事实的验证，建立了一个强大的标准，用于评估结构完整性和语义与可见上下文的一致性。大量的实验表明，我们的框架在多个数据集上显着优于最先进的方法。我们的项目位于：此 https URL。

Title: Beyond Artifacts: Real-Centric Envelope Modeling for Reliable AI-Generated Image Detection

• Authors: Ruiqi Liu, Yi Han, Zhengbo Zhang, Liwei Yao, Zhiyuan Yan, Jialiang Shen, ZhiJin Chen, Boyi Sun, Lubin Weng, Jing Dong, Yan Wang, Shu Wu
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2512.20937
• Pdf URL: https://arxiv.org/pdf/2512.20937
• Copy Paste: [[2512.20937]] Beyond Artifacts: Real-Centric Envelope Modeling for Reliable AI-Generated Image Detection(https://arxiv.org/abs/2512.20937)
• Keywords: generative
• Abstract: The rapid progress of generative models has intensified the need for reliable and robust detection under real-world conditions. However, existing detectors often overfit to generator-specific artifacts and remain highly sensitive to real-world degradations. As generative architectures evolve and images undergo multi-round cross-platform sharing and post-processing (chain degradations), these artifact cues become obsolete and harder to detect. To address this, we propose Real-centric Envelope Modeling (REM), a new paradigm that shifts detection from learning generator artifacts to modeling the robust distribution of real images. REM introduces feature-level perturbations in self-reconstruction to generate near-real samples, and employs an envelope estimator with cross-domain consistency to learn a boundary enclosing the real image manifold. We further build RealChain, a comprehensive benchmark covering both open-source and commercial generators with simulated real-world degradation. Across eight benchmark evaluations, REM achieves an average improvement of 7.5% over state-of-the-art methods, and notably maintains exceptional generalization on the severely degraded RealChain benchmark, establishing a solid foundation for synthetic image detection under real-world conditions. The code and the RealChain benchmark will be made publicly available upon acceptance of the paper.
• 摘要：生成模型的快速进步加剧了对现实条件下可靠和鲁棒检测的需求。然而，现有的检测器经常过度适应特定于生成器的伪影，并且对现实世界的退化仍然高度敏感。随着生成架构的发展以及图像经历多轮跨平台共享和后处理（链退化），这些伪影线索变得过时且更难以检测。为了解决这个问题，我们提出了以真实为中心的包络建模（REM），这是一种新的范式，它将检测从学习生成器伪影转变为对真实图像的鲁棒分布进行建模。 REM 在自重建中引入特征级扰动以生成接近真实的样本，并采用具有跨域一致性的包络估计器来学习包围真实图像流形的边界。我们进一步构建了 RealChain，这是一个涵盖开源和商业生成器的综合基准，并模拟了现实世界的退化。在八项基准评估中，REM 比最先进的方法平均提高了 7.5%，尤其是在严重退化的 RealChain 基准上保持了出色的泛化能力，为现实条件下的合成图像检测奠定了坚实的基础。代码和 RealChain 基准将在论文被接受后公开发布。

Title: A Multi-fidelity Double-Delta Wing Dataset and Empirical Scaling Laws for GNN-based Aerodynamic Field Surrogate

• Authors: Yiren Shen, Juan J. Alonso
• Subjects: cs.LG, cs.AI, physics.flu-dyn
• Abstract URL: https://arxiv.org/abs/2512.20941
• Pdf URL: https://arxiv.org/pdf/2512.20941
• Copy Paste: [[2512.20941]] A Multi-fidelity Double-Delta Wing Dataset and Empirical Scaling Laws for GNN-based Aerodynamic Field Surrogate(https://arxiv.org/abs/2512.20941)
• Keywords: generation
• Abstract: Data-driven surrogate models are increasingly adopted to accelerate vehicle design. However, open-source multi-fidelity datasets and empirical guidelines linking dataset size to model performance remain limited. This study investigates the relationship between training data size and prediction accuracy for a graph neural network (GNN) based surrogate model for aerodynamic field prediction. We release an open-source, multi-fidelity aerodynamic dataset for double-delta wings, comprising 2448 flow snapshots across 272 geometries evaluated at angles of attack from 11 (degree) to 19 (degree) at Ma=0.3 using both Vortex Lattice Method (VLM) and Reynolds-Averaged Navier-Stokes (RANS) solvers. The geometries are generated using a nested Saltelli sampling scheme to support future dataset expansion and variance-based sensitivity analysis. Using this dataset, we conduct a preliminary empirical scaling study of the MF-VortexNet surrogate by constructing six training datasets with sizes ranging from 40 to 1280 snapshots and training models with 0.1 to 2.4 million parameters under a fixed training budget. We find that the test error decreases with data size with a power-law exponent of -0.6122, indicating efficient data utilization. Based on this scaling law, we estimate that the optimal sampling density is approximately eight samples per dimension in a d-dimensional design space. The results also suggest improved data utilization efficiency for larger surrogate models, implying a potential trade-off between dataset generation cost and model training budget.
• 摘要：越来越多地采用数据驱动的替代模型来加速车辆设计。然而，开源多保真数据集和将数据集大小与模型性能联系起来的经验指南仍然有限。本研究研究了基于图神经网络 (GNN) 的空气动力场预测代理模型的训练数据大小和预测精度之间的关系。我们发布了双三角翼的开源多保真空气动力学数据集，其中包括 272 个几何形状的 2448 个流动快照，这些快照是使用涡格法 (VLM) 和雷诺平均纳维斯托克斯 (RANS) 求解器在 Ma=0.3、11（度）到 19（度）攻角下进行评估的。使用嵌套 Saltelli 采样方案生成几何图形，以支持未来的数据集扩展和基于方差的敏感性分析。使用该数据集，我们在固定训练预算下构建了 6 个大小从 40 到 1280 个快照不等的训练数据集以及具有 0.1 到 240 万个参数的训练模型，对 MF-VortexNet 代理进行了初步的实证扩展研究。我们发现测试误差随着数据大小的增加而减小，幂律指数为-0.6122，表明数据利用率很高。基于此缩放定律，我们估计最佳采样密度约为 d 维设计空间中每个维度 8 个样本。结果还表明较大代理模型的数据利用效率得到提高，这意味着数据集生成成本和模型训练预算之间存在潜在的权衡。

Title: ReACT-Drug: Reaction-Template Guided Reinforcement Learning for de novo Drug Design

• Authors: R Yadunandan, Nimisha Ghosh
• Subjects: cs.LG, cs.AI
• Abstract URL: https://arxiv.org/abs/2512.20958
• Pdf URL: https://arxiv.org/pdf/2512.20958
• Copy Paste: [[2512.20958]] ReACT-Drug: Reaction-Template Guided Reinforcement Learning for de novo Drug Design(https://arxiv.org/abs/2512.20958)
• Keywords: generation
• Abstract: De novo drug design is a crucial component of modern drug development, yet navigating the vast chemical space to find synthetically accessible, high-affinity candidates remains a significant challenge. Reinforcement Learning (RL) enhances this process by enabling multi-objective optimization and exploration of novel chemical space - capabilities that traditional supervised learning methods lack. In this work, we introduce \textbf{ReACT-Drug}, a fully integrated, target-agnostic molecular design framework based on Reinforcement Learning. Unlike models requiring target-specific fine-tuning, ReACT-Drug utilizes a generalist approach by leveraging ESM-2 protein embeddings to identify similar proteins for a given target from a knowledge base such as Protein Data Base (PDB). Thereafter, the known drug ligands corresponding to such proteins are decomposed to initialize a fragment-based search space, biasing the agent towards biologically relevant subspaces. For each such fragment, the pipeline employs a Proximal Policy Optimization (PPO) agent guiding a ChemBERTa-encoded molecule through a dynamic action space of chemically valid, reaction-template-based transformations. This results in the generation of \textit{de novo} drug candidates with competitive binding affinities and high synthetic accessibility, while ensuring 100\% chemical validity and novelty as per MOSES benchmarking. This architecture highlights the potential of integrating structural biology, deep representation learning, and chemical synthesis rules to automate and accelerate rational drug design. The dataset and code are available at this https URL.
• 摘要：从头药物设计是现代药物开发的重要组成部分，但在广阔的化学空间中寻找可合成的、高亲和力的候选药物仍然是一项重大挑战。强化学习 (RL) 通过实现多目标优化和新型化学空间探索来增强这一过程，而这是传统监督学习方法所缺乏的能力。在这项工作中，我们引入了 \textbf{ReACT-Drug}，一个基于强化学习的完全集成的、目标不可知的分子设计框架。与需要针对特定​​目标进行微调的模型不同，ReACT-Drug 采用通用方法，利用 ESM-2 蛋白质嵌入从蛋白质数据库 (PDB) 等知识库中识别给定目标的相似蛋白质。此后，与此类蛋白质相对应的已知药物配体被分解以初始化基于片段的搜索空间，使药剂偏向生物学相关的子空间。对于每个这样的片段，管道采用近端策略优化 (PPO) 代理，引导 ChemBERTa 编码的分子通过化学有效、基于反应模板的转换的动态动作空间。这导致产生具有竞争性结合亲和力和高合成可及性的 \textit{de novo} 候选药物，同时根据 MOSES 基准确保 100% 的化学有效性和新颖性。该架构凸显了整合结构生物学、深度表征学习和化学合成规则以实现自动化和加速合理药物设计的潜力。数据集和代码可从此 https URL 获取。

Title: Generalization of Diffusion Models Arises with a Balanced Representation Space

• Authors: Zekai Zhang, Xiao Li, Xiang Li, Lianghe Shi, Meng Wu, Molei Tao, Qing Qu
• Subjects: cs.LG, cs.CV
• Abstract URL: https://arxiv.org/abs/2512.20963
• Pdf URL: https://arxiv.org/pdf/2512.20963
• Copy Paste: [[2512.20963]] Generalization of Diffusion Models Arises with a Balanced Representation Space(https://arxiv.org/abs/2512.20963)
• Keywords: generative
• Abstract: Diffusion models excel at generating high-quality, diverse samples, yet they risk memorizing training data when overfit to the training objective. We analyze the distinctions between memorization and generalization in diffusion models through the lens of representation learning. By investigating a two-layer ReLU denoising autoencoder (DAE), we prove that (i) memorization corresponds to the model storing raw training samples in the learned weights for encoding and decoding, yielding localized "spiky" representations, whereas (ii) generalization arises when the model captures local data statistics, producing "balanced" representations. Furthermore, we validate these theoretical findings on real-world unconditional and text-to-image diffusion models, demonstrating that the same representation structures emerge in deep generative models with significant practical implications. Building on these insights, we propose a representation-based method for detecting memorization and a training-free editing technique that allows precise control via representation steering. Together, our results highlight that learning good representations is central to novel and meaningful generative modeling.
• 摘要：扩散模型擅长生成高质量、多样化的样本，但当与训练目标过度拟合时，它们会面临记住训练数据的风险。我们通过表征学习的视角分析扩散模型中记忆和泛化之间的区别。通过研究两层 ReLU 去噪自动编码器 (DAE)，我们证明 (i) 记忆对应于模型将原始训练样本存储在用于编码和解码的学习权重中，产生局部“尖峰”表示，而 (ii) 当模型捕获局部数据统计数据时产生泛化，产生“平衡”表示。此外，我们在现实世界的无条件和文本到图像扩散模型上验证了这些理论发现，证明相同的表示结构出现在深层生成模型中，具有重大的实际意义。基于这些见解，我们提出了一种基于表示的方法来检测记忆，以及一种无需训练的编辑技术，可以通过表示控制进行精确控制。总之，我们的结果强调，学习良好的表示对于新颖且有意义的生成模型至关重要。

Title: X-ray Insights Unleashed: Pioneering the Enhancement of Multi-Label Long-Tail Data

• Authors: Xinquan Yang, Jinheng Xie, Yawen Huang, Yuexiang Li, Huimin Huang, Hao Zheng, Xian Wu, Yefeng Zheng, Linlin Shen
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2512.20980
• Pdf URL: https://arxiv.org/pdf/2512.20980
• Copy Paste: [[2512.20980]] X-ray Insights Unleashed: Pioneering the Enhancement of Multi-Label Long-Tail Data(https://arxiv.org/abs/2512.20980)
• Keywords: generative
• Abstract: Long-tailed pulmonary anomalies in chest radiography present formidable diagnostic challenges. Despite the recent strides in diffusion-based methods for enhancing the representation of tailed lesions, the paucity of rare lesion exemplars curtails the generative capabilities of these approaches, thereby leaving the diagnostic precision less than optimal. In this paper, we propose a novel data synthesis pipeline designed to augment tail lesions utilizing a copious supply of conventional normal X-rays. Specifically, a sufficient quantity of normal samples is amassed to train a diffusion model capable of generating normal X-ray images. This pre-trained diffusion model is subsequently utilized to inpaint the head lesions present in the diseased X-rays, thereby preserving the tail classes as augmented training data. Additionally, we propose the integration of a Large Language Model Knowledge Guidance (LKG) module alongside a Progressive Incremental Learning (PIL) strategy to stabilize the inpainting fine-tuning process. Comprehensive evaluations conducted on the public lung datasets MIMIC and CheXpert demonstrate that the proposed method sets a new benchmark in performance.
• 摘要：胸部X光检查中的长尾肺部异常提出了巨大的诊断挑战。尽管最近基于扩散的方法在增强尾部病变的表现方面取得了长足的进步，但罕见病变范例的缺乏限制了这些方法的生成能力，从而导致诊断精度达不到最佳水平。在本文中，我们提出了一种新颖的数据合成流程，旨在利用大量的传统正常 X 射线来增强尾部病变。具体来说，收集足够数量的正常样本来训练能够生成正常X射线图像的扩散模型。随后利用这种预先训练的扩散模型来修复患病 X 射线中存在的头部病变，从而将尾部类别保留为增强训练数据。此外，我们建议将大型语言模型知识指导（LKG）模块与渐进增量学习（PIL）策略相集成，以稳定修复微调过程。对公共肺部数据集 MIMIC 和 CheXpert 进行的综合评估表明，所提出的方法在性能方面树立了新的基准。

Title: PUFM++: Point Cloud Upsampling via Enhanced Flow Matching

• Authors: Zhi-Song Liu, Chenhang He, Roland Maier, Andreas Rupp
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2512.20988
• Pdf URL: https://arxiv.org/pdf/2512.20988
• Copy Paste: [[2512.20988]] PUFM++: Point Cloud Upsampling via Enhanced Flow Matching(https://arxiv.org/abs/2512.20988)
• Keywords: generative
• Abstract: Recent advances in generative modeling have demonstrated strong promise for high-quality point cloud upsampling. In this work, we present PUFM++, an enhanced flow-matching framework for reconstructing dense and accurate point clouds from sparse, noisy, and partial observations. PUFM++ improves flow matching along three key axes: (i) geometric fidelity, (ii) robustness to imperfect input, and (iii) consistency with downstream surface-based tasks. We introduce a two-stage flow-matching strategy that first learns a direct, straight-path flow from sparse inputs to dense targets, and then refines it using noise-perturbed samples to approximate the terminal marginal distribution better. To accelerate and stabilize inference, we propose a data-driven adaptive time scheduler that improves sampling efficiency based on interpolation behavior. We further impose on-manifold constraints during sampling to ensure that generated points remain aligned with the underlying surface. Finally, we incorporate a recurrent interface network~(RIN) to strengthen hierarchical feature interactions and boost reconstruction quality. Extensive experiments on synthetic benchmarks and real-world scans show that PUFM++ sets a new state of the art in point cloud upsampling, delivering superior visual fidelity and quantitative accuracy across a wide range of tasks. Code and pretrained models are publicly available at this https URL.
• 摘要：生成建模的最新进展已经证明了高质量点云上采样的巨大前景。在这项工作中，我们提出了 PUFM++，这是一种增强的流匹配框架，用于从稀疏、噪声和部分观测中重建密集且准确的点云。 PUFM++ 沿三个关键轴改进了流匹配：(i) 几何保真度，(ii) 对不完美输入的鲁棒性，以及 (iii) 与下游基于表面的任务的一致性。我们引入了一种两阶段流匹配策略，该策略首先学习从稀疏输入到密集目标的直接路径流，然后使用噪声扰动样本对其进行细化，以更好地近似终端边缘分布。为了加速和稳定推理，我们提出了一种数据驱动的自适应时间调度器，它基于插值行为提高了采样效率。我们在采样过程中进一步施加流形约束，以确保生成的点与底层表面保持对齐。最后，我们结合了一个循环接口网络（RIN）来加强分层特征交互并提高重建质量。对综合基准和真实世界扫描的大量实验表明，PUFM++ 在点云上采样方面树立了新的技术水平，在各种任务中提供卓越的视觉保真度和定量准确性。代码和预训练模型可通过此 https URL 公开获取。

Title: Learning from Next-Frame Prediction: Autoregressive Video Modeling Encodes Effective Representations

• Authors: Jinghan Li, Yang Jin, Hao Jiang, Yadong Mu, Yang Song, Kun Xu
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2512.21004
• Pdf URL: https://arxiv.org/pdf/2512.21004
• Copy Paste: [[2512.21004]] Learning from Next-Frame Prediction: Autoregressive Video Modeling Encodes Effective Representations(https://arxiv.org/abs/2512.21004)
• Keywords: generation, generative
• Abstract: Recent advances in pretraining general foundation models have significantly improved performance across diverse downstream tasks. While autoregressive (AR) generative models like GPT have revolutionized NLP, most visual generative pretraining methods still rely on BERT-style masked modeling, which often disregards the temporal information essential for video analysis. The few existing autoregressive visual pretraining methods suffer from issues such as inaccurate semantic localization and poor generation quality, leading to poor semantics. In this work, we propose NExT-Vid, a novel autoregressive visual generative pretraining framework that utilizes masked next-frame prediction to jointly model images and videos. NExT-Vid introduces a context-isolated autoregressive predictor to decouple semantic representation from target decoding, and a conditioned flow-matching decoder to enhance generation quality and diversity. Through context-isolated flow-matching pretraining, our approach achieves strong representations. Extensive experiments on large-scale pretrained models demonstrate that our proposed method consistently outperforms previous generative pretraining methods for visual representation learning via attentive probing in downstream classification.
• 摘要：预训练通用基础模型的最新进展显着提高了各种下游任务的性能。虽然像 GPT 这样的自回归 (AR) 生成模型已经彻底改变了 NLP，但大多数视觉生成预训练方法仍然依赖于 BERT 式的掩模建模，而这种模型通常忽略视频分析所必需的时间信息。现有的少数自回归视觉预训练方法存在语义定位不准确和生成质量差等问题，导致语义较差。在这项工作中，我们提出了 NExT-Vid，一种新颖的自回归视觉生成预训练框架，它利用屏蔽的下一帧预测来联合建模图像和视频。 NExT-Vid 引入了上下文隔离的自回归预测器来将语义表示与目标解码解耦，并引入了条件流匹配解码器来增强生成质量和多样性。通过上下文隔离的流匹配预训练，我们的方法实现了强表示。对大规模预训练模型的大量实验表明，我们提出的方法始终优于以前通过下游分类中的细心探测进行视觉表示学习的生成预训练方法。

Title: LLM Swiss Round: Aggregating Multi-Benchmark Performance via Competitive Swiss-System Dynamics

• Authors: Jiashuo Liu, Jiayun Wu, Chunjie Wu, Jingkai Liu, Zaiyuan Wang, Huan Zhou, Wenhao Huang, Hongseok Namkoong
• Subjects: cs.LG, cs.AI, cs.PF
• Abstract URL: https://arxiv.org/abs/2512.21010
• Pdf URL: https://arxiv.org/pdf/2512.21010
• Copy Paste: [[2512.21010]] LLM Swiss Round: Aggregating Multi-Benchmark Performance via Competitive Swiss-System Dynamics(https://arxiv.org/abs/2512.21010)
• Keywords: generation
• Abstract: The rapid proliferation of Large Language Models (LLMs) and diverse specialized benchmarks necessitates a shift from fragmented, task-specific metrics to a holistic, competitive ranking system that effectively aggregates performance across multiple ability dimensions. Primarily using static scoring, current evaluation methods are fundamentally limited. They struggle to determine the proper mix ratio across diverse benchmarks, and critically, they fail to capture a model's dynamic competitive fitness or its vulnerability when confronted with sequential, high-stakes tasks. To address this, we introduce the novel Competitive Swiss-System Dynamics (CSD) framework. CSD simulates a multi-round, sequential contest where models are dynamically paired across a curated sequence of benchmarks based on their accumulated win-loss record. And Monte Carlo Simulation ($N=100,000$ iterations) is used to approximate the statistically robust Expected Win Score ($E[S_m]$), which eliminates the noise of random pairing and early-round luck. Furthermore, we implement a Failure Sensitivity Analysis by parameterizing the per-round elimination quantity ($T_k$), which allows us to profile models based on their risk appetite--distinguishing between robust generalists and aggressive specialists. We demonstrate that CSD provides a more nuanced and context-aware ranking than traditional aggregate scoring and static pairwise models, representing a vital step towards risk-informed, next-generation LLM evaluation.
• 摘要：大型语言模型 (LLM) 和各种专业基准的快速增长需要从分散的、特定于任务的指标转向整体的、有竞争力的排名系统，该系统可以有效地汇总多个能力维度的表现。目前的评估方法主要使用静态评分，从根本上受到限制。他们很难在不同的基准中确定适当的混合比例，更重要的是，他们无法捕捉模型的动态竞争适应性或其在面对连续的高风险任务时的脆弱性。为了解决这个问题，我们引入了新颖的瑞士竞争系统动力学（CSD）框架。 CSD 模拟多轮连续竞赛，其中模型根据累积的输赢记录在一系列精心策划的基准测试中进行动态配对。蒙特卡罗模拟（$N=100,000$ 迭代）用于近似统计上稳健的预期获胜得分 ($E[S_m]$)，从而消除了随机配对和早期运气的噪音。此外，我们通过参数化每轮消除数量（$T_k$）来实施故障敏感性分析，这使我们能够根据模型的风险偏好来分析模型——区分稳健的通才和激进的专家。我们证明，与传统的综合评分和静态成对模型相比，CSD 提供了更细致、更上下文相关的排名，这代表着迈向风险知情的下一代 LLM 评估的重要一步。

Title: FluencyVE: Marrying Temporal-Aware Mamba with Bypass Attention for Video Editing

• Authors: Mingshu Cai, Yixuan Li, Osamu Yoshie, Yuya Ieiri
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2512.21015
• Pdf URL: https://arxiv.org/pdf/2512.21015
• Copy Paste: [[2512.21015]] FluencyVE: Marrying Temporal-Aware Mamba with Bypass Attention for Video Editing(https://arxiv.org/abs/2512.21015)
• Keywords: generation, generative
• Abstract: Large-scale text-to-image diffusion models have achieved unprecedented success in image generation and editing. However, extending this success to video editing remains challenging. Recent video editing efforts have adapted pretrained text-to-image models by adding temporal attention mechanisms to handle video tasks. Unfortunately, these methods continue to suffer from temporal inconsistency issues and high computational overheads. In this study, we propose FluencyVE, which is a simple yet effective one-shot video editing approach. FluencyVE integrates the linear time-series module, Mamba, into a video editing model based on pretrained Stable Diffusion models, replacing the temporal attention layer. This enables global frame-level attention while reducing the computational costs. In addition, we employ low-rank approximation matrices to replace the query and key weight matrices in the causal attention, and use a weighted averaging technique during training to update the attention scores. This approach significantly preserves the generative power of the text-to-image model while effectively reducing the computational burden. Experiments and analyses demonstrate promising results in editing various attributes, subjects, and locations in real-world videos.
• 摘要：大规模文本到图像的扩散模型在图像生成和编辑方面取得了前所未有的成功。然而，将这一成功扩展到视频编辑仍然具有挑战性。最近的视频编辑工作通过添加时间注意机制来处理视频任务，从而适应了预训练的文本到图像模型。不幸的是，这些方法仍然面临时间不一致问题和高计算开销的问题。在这项研究中，我们提出了 FluencyVE，这是一种简单而有效的一次性视频编辑方法。 FluencyVE 将线性时间序列模块 Mamba 集成到基于预训练稳定扩散模型的视频编辑模型中，取代了时间注意力层。这使得全局帧级注意力成为可能，同时降低了计算成本。此外，我们采用低秩近似矩阵来替换因果注意力中的查询和关键权重矩阵，并在训练期间使用加权平均技术来更新注意力分数。这种方法显着保留了文本到图像模型的生成能力，同时有效减少了计算负担。实验和分析表明，在编辑现实视频中的各种属性、主题和位置方面取得了有希望的结果。

Title: Efficient and Robust Video Defense Framework against 3D-field Personalized Talking Face

• Authors: Rui-qing Sun, Xingshan Yao, Tian Lan, Hui-Yang Zhao, Jia-Ling Shi, Chen-Hao Cui, Zhijing Wu, Chen Yang, Xian-Ling Mao
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2512.21019
• Pdf URL: https://arxiv.org/pdf/2512.21019
• Copy Paste: [[2512.21019]] Efficient and Robust Video Defense Framework against 3D-field Personalized Talking Face(https://arxiv.org/abs/2512.21019)
• Keywords: generation
• Abstract: State-of-the-art 3D-field video-referenced Talking Face Generation (TFG) methods synthesize high-fidelity personalized talking-face videos in real time by modeling 3D geometry and appearance from reference portrait video. This capability raises significant privacy concerns regarding malicious misuse of personal portraits. However, no efficient defense framework exists to protect such videos against 3D-field TFG methods. While image-based defenses could apply per-frame 2D perturbations, they incur prohibitive computational costs, severe video quality degradation, failing to disrupt 3D information for video protection. To address this, we propose a novel and efficient video defense framework against 3D-field TFG methods, which protects portrait video by perturbing the 3D information acquisition process while maintain high-fidelity video quality. Specifically, our method introduces: (1) a similarity-guided parameter sharing mechanism for computational efficiency, and (2) a multi-scale dual-domain attention module to jointly optimize spatial-frequency perturbations. Extensive experiments demonstrate that our proposed framework exhibits strong defense capability and achieves a 47x acceleration over the fastest baseline while maintaining high fidelity. Moreover, it remains robust against scaling operations and state-of-the-art purification attacks, and the effectiveness of our design choices is further validated through ablation studies. Our project is available at this https URL.
• 摘要：最先进的 3D 场视频参考说话人脸生成 (TFG) 方法通过对参考肖像视频的 3D 几何和外观进行建模，实时合成高保真个性化说话人脸视频。此功能引发了有关恶意滥用个人肖像的重大隐私问题。然而，不存在有效的防御框架来保护此类视频免受 3D 场 TFG 方法的影响。虽然基于图像的防御可以应用每帧 2D 扰动，但它们会产生高昂的计算成本、严重的视频质量下降、无法破坏视频保护的 3D 信息。为了解决这个问题，我们提出了一种针对 3D 场 TFG 方法的新型高效视频防御框架，该框架通过扰乱 3D 信息获取过程来保护肖像视频，同时保持高保真视频质量。具体来说，我们的方法引入了：（1）用于提高计算效率的相似性引导参数共享机制，以及（2）用于联合优化空间频率扰动的多尺度双域注意模块。大量的实验表明，我们提出的框架表现出强大的防御能力，在保持高保真度的同时，比最快基线实现了 47 倍的加速。此外，它对于扩展操作和最先进的纯化攻击仍然具有鲁棒性，并且我们的设计选择的有效性通过消融研究得到了进一步验证。我们的项目可以通过此 https URL 获取。

Title: Multi-Attribute guided Thermal Face Image Translation based on Latent Diffusion Model

• Authors: Mingshu Cai, Osamu Yoshie, Yuya Ieiri
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2512.21032
• Pdf URL: https://arxiv.org/pdf/2512.21032
• Copy Paste: [[2512.21032]] Multi-Attribute guided Thermal Face Image Translation based on Latent Diffusion Model(https://arxiv.org/abs/2512.21032)
• Keywords: restoration, generative
• Abstract: Modern surveillance systems increasingly rely on multi-wavelength sensors and deep neural networks to recognize faces in infrared images captured at night. However, most facial recognition models are trained on visible light datasets, leading to substantial performance degradation on infrared inputs due to significant domain shifts. Early feature-based methods for infrared face recognition proved ineffective, prompting researchers to adopt generative approaches that convert infrared images into visible light images for improved recognition. This paradigm, known as Heterogeneous Face Recognition (HFR), faces challenges such as model and modality discrepancies, leading to distortion and feature loss in generated images. To address these limitations, this paper introduces a novel latent diffusion-based model designed to generate high-quality visible face images from thermal inputs while preserving critical identity features. A multi-attribute classifier is incorporated to extract key facial attributes from visible images, mitigating feature loss during infrared-to-visible image restoration. Additionally, we propose the Self-attn Mamba module, which enhances global modeling of cross-modal features and significantly improves inference speed. Experimental results on two benchmark datasets demonstrate the superiority of our approach, achieving state-of-the-art performance in both image quality and identity preservation.
• 摘要：现代监控系统越来越依赖多波长传感器和深度神经网络来识别夜间捕获的红外图像中的人脸。然而，大多数面部识别模型都是在可见光数据集上进行训练的，由于显着的域转移，导致红外输入的性能大幅下降。早期基于特征的红外人脸识别方法被证明是无效的，促使研究人员采用生成方法，将红外图像转换为可见光图像以提高识别能力。这种范例被称为异构人脸识别（HFR），面临着模型和模态差异等挑战，导致生成的图像失真和特征丢失。为了解决这些限制，本文引入了一种新颖的基于潜在扩散的模型，旨在从热输入生成高质量的可见人脸图像，同时保留关键的身份特征。结合了多属性分类器，可以从可见图像中提取关键的面部属性，从而减少红外到可见图像恢复过程中的特征损失。此外，我们提出了 Self-attn Mamba 模块，它增强了跨模态特征的全局建模并显着提高了推理速度。两个基准数据集的实验结果证明了我们方法的优越性，在图像质量和身份保留方面实现了最先进的性能。

Title: Next-Scale Prediction: A Self-Supervised Approach for Real-World Image Denoising

• Authors: Yiwen Shan, Haiyu Zhao, Peng Hu, Xi Peng, Yuanbiao Gou
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2512.21038
• Pdf URL: https://arxiv.org/pdf/2512.21038
• Copy Paste: [[2512.21038]] Next-Scale Prediction: A Self-Supervised Approach for Real-World Image Denoising(https://arxiv.org/abs/2512.21038)
• Keywords: super-resolution
• Abstract: Self-supervised real-world image denoising remains a fundamental challenge, arising from the antagonistic trade-off between decorrelating spatially structured noise and preserving high-frequency details. Existing blind-spot network (BSN) methods rely on pixel-shuffle downsampling (PD) to decorrelate noise, but aggressive downsampling fragments fine structures, while milder downsampling fails to remove correlated noise. To address this, we introduce Next-Scale Prediction (NSP), a novel self-supervised paradigm that decouples noise decorrelation from detail preservation. NSP constructs cross-scale training pairs, where BSN takes low-resolution, fully decorrelated sub-images as input to predict high-resolution targets that retain fine details. As a by-product, NSP naturally supports super-resolution of noisy images without retraining or modification. Extensive experiments demonstrate that NSP achieves state-of-the-art self-supervised denoising performance on real-world benchmarks, significantly alleviating the long-standing conflict between noise decorrelation and detail preservation.
• 摘要：自监督现实世界图像去噪仍然是一个基本挑战，这是由于去相关空间结构噪声和保留高频细节之间的对立权衡而产生的。现有的盲点网络（BSN）方法依靠像素洗牌下采样（PD）来去相关噪声，但激进的下采样会破坏精细结构，而较温和的下采样无法消除相关噪声。为了解决这个问题，我们引入了下一代预测（NSP），这是一种新颖的自监督范例，可以将噪声去相关与细节保留分开。 NSP 构建跨尺度训练对，其中 BSN 将低分辨率、完全去相关的子图像作为输入来预测保留精细细节的高分辨率目标。作为副产品，NSP 自然支持噪声图像的超分辨率，无需重新训练或修改。大量实验表明，NSP 在现实世界基准上实现了最先进的自监督去噪性能，显着缓解了噪声去相关和细节保留之间长期存在的冲突。

Title: A Large-Depth-Range Layer-Based Hologram Dataset for Machine Learning-Based 3D Computer-Generated Holography

• Authors: Jaehong Lee, You Chan No, YoungWoo Kim, Duksu Kim
• Subjects: cs.CV, physics.optics
• Abstract URL: https://arxiv.org/abs/2512.21040
• Pdf URL: https://arxiv.org/pdf/2512.21040
• Copy Paste: [[2512.21040]] A Large-Depth-Range Layer-Based Hologram Dataset for Machine Learning-Based 3D Computer-Generated Holography(https://arxiv.org/abs/2512.21040)
• Keywords: super-resolution, generation
• Abstract: Machine learning-based computer-generated holography (ML-CGH) has advanced rapidly in recent years, yet progress is constrained by the limited availability of high-quality, large-scale hologram datasets. To address this, we present KOREATECH-CGH, a publicly available dataset comprising 6,000 pairs of RGB-D images and complex holograms across resolutions ranging from 256*256 to 2048*2048, with depth ranges extending to the theoretical limits of the angular spectrum method for wide 3D scene coverage. To improve hologram quality at large depth ranges, we introduce amplitude projection, a post-processing technique that replaces amplitude components of hologram wavefields at each depth layer while preserving phase. This approach enhances reconstruction fidelity, achieving 27.01 dB PSNR and 0.87 SSIM, surpassing a recent optimized silhouette-masking layer-based method by 2.03 dB and 0.04 SSIM, respectively. We further validate the utility of KOREATECH-CGH through experiments on hologram generation and super-resolution using state-of-the-art ML models, confirming its applicability for training and evaluating next-generation ML-CGH systems.
• 摘要：基于机器学习的计算机生成全息术（ML-CGH）近年来发展迅速，但进展受到高质量、大规模全息图数据集有限的限制。为了解决这个问题，我们推出了 KOREATECH-CGH，这是一个公开可用的数据集，包含 6,000 对 RGB-D 图像和复杂的全息图，分辨率范围从 256*256 到 2048*2048，深度范围扩展到宽 3D 场景覆盖的角谱方法的理论极限。为了提高大深度范围内的全息图质量，我们引入了幅度投影，这是一种后处理技术，可以在保留相位的同时替换每个深度层的全息图波场的幅度分量。这种方法增强了重建保真度，实现了 27.01 dB PSNR 和 0.87 SSIM，分别超过了最近优化的基于轮廓掩模层的方法 2.03 dB 和 0.04 SSIM。我们通过使用最先进的 ML 模型进行全息图生成和超分辨率实验，进一步验证 KOREATECH-CGH 的实用性，确认其适用于训练和评估下一代 ML-CGH 系统。

Title: DexAvatar: 3D Sign Language Reconstruction with Hand and Body Pose Priors

• Authors: Kaustubh Kundu, Hrishav Bakul Barua, Lucy Robertson-Bell, Zhixi Cai, Kalin Stefanov
• Subjects: cs.CV, cs.AI, cs.HC, cs.LG
• Abstract URL: https://arxiv.org/abs/2512.21054
• Pdf URL: https://arxiv.org/pdf/2512.21054
• Copy Paste: [[2512.21054]] DexAvatar: 3D Sign Language Reconstruction with Hand and Body Pose Priors(https://arxiv.org/abs/2512.21054)
• Keywords: generation, generative
• Abstract: The trend in sign language generation is centered around data-driven generative methods that require vast amounts of precise 2D and 3D human pose data to achieve an acceptable generation quality. However, currently, most sign language datasets are video-based and limited to automatically reconstructed 2D human poses (i.e., keypoints) and lack accurate 3D information. Furthermore, existing state-of-the-art for automatic 3D human pose estimation from sign language videos is prone to self-occlusion, noise, and motion blur effects, resulting in poor reconstruction quality. In response to this, we introduce DexAvatar, a novel framework to reconstruct bio-mechanically accurate fine-grained hand articulations and body movements from in-the-wild monocular sign language videos, guided by learned 3D hand and body priors. DexAvatar achieves strong performance in the SGNify motion capture dataset, the only benchmark available for this task, reaching an improvement of 35.11% in the estimation of body and hand poses compared to the state-of-the-art. The official website of this work is: this https URL.
• 摘要：手语生成的趋势以数据驱动的生成方法为中心，这些方法需要大量精确的 2D 和 3D 人体姿势数据才能达到可接受的生成质量。然而，目前大多数手语数据集都是基于视频的，仅限于自动重建的 2D 人体姿势（即关键点），缺乏准确的 3D 信息。此外，现有最先进的手语视频自动 3D 人体姿势估计容易出现自遮挡、噪声和运动模糊效应，导致重建质量较差。针对这一点，我们引入了 DexAvatar，这是一种新颖的框架，可以在学习的 3D 手部和身体先验的指导下，从野外单眼手语视频中重建生物力学上精确的细粒度手部关节和身体动作。 DexAvatar 在 SGNify 动作捕捉数据集（该任务唯一可用的基准）中取得了强大的性能，与最先进的技术相比，在身体和手部姿势的估计方面达到了 35.11% 的改进。本作品的官网是：这个https网址。

Title: Beyond Pixel Simulation: Pathology Image Generation via Diagnostic Semantic Tokens and Prototype Control

• Authors: Minghao Han, YiChen Liu, Yizhou Liu, Zizhi Chen, Jingqun Tang, Xuecheng Wu, Dingkang Yang, Lihua Zhang
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2512.21058
• Pdf URL: https://arxiv.org/pdf/2512.21058
• Copy Paste: [[2512.21058]] Beyond Pixel Simulation: Pathology Image Generation via Diagnostic Semantic Tokens and Prototype Control(https://arxiv.org/abs/2512.21058)
• Keywords: generation, generative
• Abstract: In computational pathology, understanding and generation have evolved along disparate paths: advanced understanding models already exhibit diagnostic-level competence, whereas generative models largely simulate pixels. Progress remains hindered by three coupled factors: the scarcity of large, high-quality image-text corpora; the lack of precise, fine-grained semantic control, which forces reliance on non-semantic cues; and terminological heterogeneity, where diverse phrasings for the same diagnostic concept impede reliable text conditioning. We introduce UniPath, a semantics-driven pathology image generation framework that leverages mature diagnostic understanding to enable controllable generation. UniPath implements Multi-Stream Control: a Raw-Text stream; a High-Level Semantics stream that uses learnable queries to a frozen pathology MLLM to distill paraphrase-robust Diagnostic Semantic Tokens and to expand prompts into diagnosis-aware attribute bundles; and a Prototype stream that affords component-level morphological control via a prototype bank. On the data front, we curate a 2.65M image-text corpus and a finely annotated, high-quality 68K subset to alleviate data scarcity. For a comprehensive assessment, we establish a four-tier evaluation hierarchy tailored to pathology. Extensive experiments demonstrate UniPath's SOTA performance, including a Patho-FID of 80.9 (51% better than the second-best) and fine-grained semantic control achieving 98.7% of the real-image. The meticulously curated datasets, complete source code, and pre-trained model weights developed in this study will be made openly accessible to the public.
• 摘要：在计算病理学中，理解和生成沿着不同的路径发展：高级理解模型已经表现出诊断级别的能力，而生成模型主要模拟像素。进展仍然受到三个耦合因素的阻碍：缺乏大型、高质量的图像文本语料库；缺乏精确、细粒度的语义控制，迫使人们依赖非语义线索；术语异质性，同一诊断概念的不同措辞阻碍了可靠的文本调节。我们推出 UniPath，这是一种语义驱动的病理图像生成框架，它利用成熟的诊断理解来实现可控的生成。 UniPath 实现多流控制：原始文本流；高级语义流，使用对冻结病理学 MLLM 的可学习查询来提取稳健的诊断语义标记，并将提示扩展为诊断感知属性包；以及通过原型库提供组件级形态控制的原型流。在数据方面，我们整理了 265 万图像文本语料库和精细注释的高质量 68K 子集，以缓解数据稀缺问题。为了进行全面评估，我们建立了适合病理学的四级评估体系。大量实验证明了 UniPath 的 SOTA 性能，包括 80.9 的 Patho-FID（比第二名好 51%）和实现 98.7% 真实图像的细粒度语义控制。本研究中开发的精心策划的数据集、完整的源代码和预训练的模型权重将向公众开放。

Title: T2AV-Compass: Towards Unified Evaluation for Text-to-Audio-Video Generation

• Authors: Zhe Cao, Tao Wang, Jiaming Wang, Yanghai Wang, Yuanxing Zhang, Jialu Chen, Miao Deng, Jiahao Wang, Yubin Guo, Chenxi Liao, Yize Zhang, Zhaoxiang Zhang, Jiaheng Liu
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2512.21094
• Pdf URL: https://arxiv.org/pdf/2512.21094
• Copy Paste: [[2512.21094]] T2AV-Compass: Towards Unified Evaluation for Text-to-Audio-Video Generation(https://arxiv.org/abs/2512.21094)
• Keywords: generation
• Abstract: Text-to-Audio-Video (T2AV) generation aims to synthesize temporally coherent video and semantically synchronized audio from natural language, yet its evaluation remains fragmented, often relying on unimodal metrics or narrowly scoped benchmarks that fail to capture cross-modal alignment, instruction following, and perceptual realism under complex prompts. To address this limitation, we present T2AV-Compass, a unified benchmark for comprehensive evaluation of T2AV systems, consisting of 500 diverse and complex prompts constructed via a taxonomy-driven pipeline to ensure semantic richness and physical plausibility. Besides, T2AV-Compass introduces a dual-level evaluation framework that integrates objective signal-level metrics for video quality, audio quality, and cross-modal alignment with a subjective MLLM-as-a-Judge protocol for instruction following and realism assessment. Extensive evaluation of 11 representative T2AVsystems reveals that even the strongest models fall substantially short of human-level realism and cross-modal consistency, with persistent failures in audio realism, fine-grained synchronization, instruction following, etc. These results indicate significant improvement room for future models and highlight the value of T2AV-Compass as a challenging and diagnostic testbed for advancing text-to-audio-video generation.
• 摘要：文本到音频视频（T2AV）生成旨在从自然语言合成时间连贯的视频和语义同步的音频，但其评估仍然支离破碎，通常依赖于单模态指标或范围狭窄的基准，无法捕获复杂提示下的跨模态对齐、指令遵循和感知现实主义。为了解决这一限制，我们提出了 T2AV-Compass，这是一个用于全面评估 T2AV 系统的统一基准，由通过分类驱动的管道构建的 500 个多样化且复杂的提示组成，以确保语义丰富性和物理合理性。此外，T2AV-Compass 引入了一个双级评估框架，该框架将视频质量、音频质量和跨模式对齐的客观信号级指标与用于指令跟踪和真实性评估的主观 MLLM-as-a-Judge 协议集成在一起。对 11 个代表性 T2AVsystems 的广泛评估表明，即使是最强大的模型也远远达不到人类水平的真实感和跨模态一致性，在音频真实感、细粒度同步、指令遵循等方面持续失败。这些结果表明未来模型有显着的改进空间，并凸显了 T2AV-Compass 作为推进文本到音频视频生成的具有挑战性和诊断性的测试平台的价值。

Title: STLDM: Spatio-Temporal Latent Diffusion Model for Precipitation Nowcasting

• Authors: Shi Quan Foo, Chi-Ho Wong, Zhihan Gao, Dit-Yan Yeung, Ka-Hing Wong, Wai-Kin Wong
• Subjects: cs.LG, cs.AI, cs.CV
• Abstract URL: https://arxiv.org/abs/2512.21118
• Pdf URL: https://arxiv.org/pdf/2512.21118
• Copy Paste: [[2512.21118]] STLDM: Spatio-Temporal Latent Diffusion Model for Precipitation Nowcasting(https://arxiv.org/abs/2512.21118)
• Keywords: generative
• Abstract: Precipitation nowcasting is a critical spatio-temporal prediction task for society to prevent severe damage owing to extreme weather events. Despite the advances in this field, the complex and stochastic nature of this task still poses challenges to existing approaches. Specifically, deterministic models tend to produce blurry predictions while generative models often struggle with poor accuracy. In this paper, we present a simple yet effective model architecture termed STLDM, a diffusion-based model that learns the latent representation from end to end alongside both the Variational Autoencoder and the conditioning network. STLDM decomposes this task into two stages: a deterministic forecasting stage handled by the conditioning network, and an enhancement stage performed by the latent diffusion model. Experimental results on multiple radar datasets demonstrate that STLDM achieves superior performance compared to the state of the art, while also improving inference efficiency. The code is available in this https URL.
• 摘要：临近降水预报是社会预防极端天气事件造成严重损害的一项重要时空预测任务。尽管该领域取得了进展，但这项任务的复杂性和随机性仍然对现有方法提出了挑战。具体来说，确定性模型往往会产生模糊的预测，而生成模型往往准确性较差。在本文中，我们提出了一种简单而有效的模型架构，称为 STLDM，这是一种基于扩散的模型，可以与变分自动编码器和调节网络一起从端到端学习潜在表示。 STLDM 将此任务分解为两个阶段：由调节网络处理的确定性预测阶段和由潜在扩散模型执行的增强阶段。多个雷达数据集上的实验结果表明，与现有技术相比，STLDM 实现了卓越的性能，同时还提高了推理效率。该代码可在此 https URL 中找到。

Title: A Turn Toward Better Alignment: Few-Shot Generative Adaptation with Equivariant Feature Rotation

• Authors: Chenghao Xu, Qi Liu, Jiexi Yan, Muli Yang, Cheng Deng
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2512.21174
• Pdf URL: https://arxiv.org/pdf/2512.21174
• Copy Paste: [[2512.21174]] A Turn Toward Better Alignment: Few-Shot Generative Adaptation with Equivariant Feature Rotation(https://arxiv.org/abs/2512.21174)
• Keywords: generation, generative
• Abstract: Few-shot image generation aims to effectively adapt a source generative model to a target domain using very few training images. Most existing approaches introduce consistency constraints-typically through instance-level or distribution-level loss functions-to directly align the distribution patterns of source and target domains within their respective latent spaces. However, these strategies often fall short: overly strict constraints can amplify the negative effects of the domain gap, leading to distorted or uninformative content, while overly relaxed constraints may fail to leverage the source domain effectively. This limitation primarily stems from the inherent discrepancy in the underlying distribution structures of the source and target domains. The scarcity of target samples further compounds this issue by hindering accurate estimation of the target domain's distribution. To overcome these limitations, we propose Equivariant Feature Rotation (EFR), a novel adaptation strategy that aligns source and target domains at two complementary levels within a self-rotated proxy feature space. Specifically, we perform adaptive rotations within a parameterized Lie Group to transform both source and target features into an equivariant proxy space, where alignment is conducted. These learnable rotation matrices serve to bridge the domain gap by preserving intra-domain structural information without distortion, while the alignment optimization facilitates effective knowledge transfer from the source to the target domain. Comprehensive experiments on a variety of commonly used datasets demonstrate that our method significantly enhances the generative performance within the targeted domain.
• 摘要：少镜头图像生成旨在使用很少的训练图像有效地将源生成模型适应目标域。大多数现有方法引入一致性约束（通常通过实例级或分布级损失函数）来直接对齐源域和目标域在各自潜在空间内的分布模式。然而，这些策略往往存在不足：过于严格的约束可能会放大域差距的负面影响，导致内容扭曲或信息不足，而过于宽松的约束可能无法有效地利用源域。这种限制主要源于源域和目标域的底层分布结构的固有差异。目标样本的稀缺阻碍了对目标域分布的准确估计，从而进一步加剧了这个问题。为了克服这些限制，我们提出了等变特征旋转（EFR），这是一种新颖的适应策略，可以在自旋转代理特征空间内的两个互补级别上对齐源域和目标域。具体来说，我们在参数化李群中执行自适应旋转，将源特征和目标特征转换为等变代理空间，并在其中进行对齐。这些可学习的旋转矩阵通过不失真地保留域内结构信息来弥合域差距，而对齐优化则有助于从源域到目标域的有效知识迁移。对各种常用数据集的综合实验表明，我们的方法显着增强了目标领域内的生成性能。

Title: UltraShape 1.0: High-Fidelity 3D Shape Generation via Scalable Geometric Refinement

• Authors: Tanghui Jia, Dongyu Yan, Dehao Hao, Yang Li, Kaiyi Zhang, Xianyi He, Lanjiong Li, Jinnan Chen, Lutao Jiang, Qishen Yin, Long Quan, Ying-Cong Chen, Li Yuan
• Subjects: cs.CV, cs.GR
• Abstract URL: https://arxiv.org/abs/2512.21185
• Pdf URL: https://arxiv.org/pdf/2512.21185
• Copy Paste: [[2512.21185]] UltraShape 1.0: High-Fidelity 3D Shape Generation via Scalable Geometric Refinement(https://arxiv.org/abs/2512.21185)
• Keywords: generation
• Abstract: In this report, we introduce UltraShape 1.0, a scalable 3D diffusion framework for high-fidelity 3D geometry generation. The proposed approach adopts a two-stage generation pipeline: a coarse global structure is first synthesized and then refined to produce detailed, high-quality geometry. To support reliable 3D generation, we develop a comprehensive data processing pipeline that includes a novel watertight processing method and high-quality data filtering. This pipeline improves the geometric quality of publicly available 3D datasets by removing low-quality samples, filling holes, and thickening thin structures, while preserving fine-grained geometric details. To enable fine-grained geometry refinement, we decouple spatial localization from geometric detail synthesis in the diffusion process. We achieve this by performing voxel-based refinement at fixed spatial locations, where voxel queries derived from coarse geometry provide explicit positional anchors encoded via RoPE, allowing the diffusion model to focus on synthesizing local geometric details within a reduced, structured solution space. Our model is trained exclusively on publicly available 3D datasets, achieving strong geometric quality despite limited training resources. Extensive evaluations demonstrate that UltraShape 1.0 performs competitively with existing open-source methods in both data processing quality and geometry generation. All code and trained models will be released to support future research.
• 摘要：在本报告中，我们介绍了 UltraShape 1.0，这是一种用于高保真 3D 几何生成的可扩展 3D 扩散框架。所提出的方法采用两阶段生成流程：首先合成粗略的全局结构，然后细化以产生详细的高质量几何结构。为了支持可靠的 3D 生成，我们开发了全面的数据处理管道，其中包括新颖的无懈可击的处理方法和高质量的数据过滤。该流程通过删除低质量样本、填充孔洞和加厚薄结构来提高公开可用 3D 数据集的几何质量，同时保留细粒度的几何细节。为了实现细粒度的几何细化，我们将扩散过程中的空间定位与几何细节合成解耦。我们通过在固定空间位置执行基于体素的细化来实现这一点，其中从粗几何导出的体素查询提供通过 RoPE 编码的显式位置锚，允许扩散模型专注于在简化的结构化解决方案空间内合成局部几何细节。我们的模型专门在公开的 3D 数据集上进行训练，尽管训练资源有限，但仍能实现强大的几何质量。广泛的评估表明，UltraShape 1.0 在数据处理质量和几何生成方面与现有开源方法相比具有竞争力。所有代码和训练模型都将发布以支持未来的研究。

Title: MiST: Understanding the Role of Mid-Stage Scientific Training in Developing Chemical Reasoning Models

• Authors: Andres M Bran, Tong Xie, Shai Pranesh, Jeffrey Meng, Xuan Vu Nguyen, Jeremy Goumaz, David Ming Segura, Ruizhi Xu, Dongzhan Zhou, Wenjie Zhang, Bram Hoex, Philippe Schwaller
• Subjects: cs.LG, cond-mat.mtrl-sci
• Abstract URL: https://arxiv.org/abs/2512.21231
• Pdf URL: https://arxiv.org/pdf/2512.21231
• Copy Paste: [[2512.21231]] MiST: Understanding the Role of Mid-Stage Scientific Training in Developing Chemical Reasoning Models(https://arxiv.org/abs/2512.21231)
• Keywords: generation
• Abstract: Large Language Models can develop reasoning capabilities through online fine-tuning with rule-based rewards. However, recent studies reveal a critical constraint: reinforcement learning succeeds only when the base model already assigns non-negligible probability to correct answers -- a property we term 'latent solvability'. This work investigates the emergence of chemical reasoning capabilities and what these prerequisites mean for chemistry. We identify two necessary conditions for RL-based chemical reasoning: 1) Symbolic competence, and 2) Latent chemical knowledge. We propose mid-stage scientific training (MiST): a set of mid-stage training techniques to satisfy these, including data-mixing with SMILES/CIF-aware pre-processing, continued pre-training on 2.9B tokens, and supervised fine-tuning on 1B tokens. These steps raise the latent-solvability score on 3B and 7B models by up to 1.8x, and enable RL to lift top-1 accuracy from 10.9 to 63.9% on organic reaction naming, and from 40.6 to 67.4% on inorganic material generation. Similar results are observed for other challenging chemical tasks, while producing interpretable reasoning traces. Our results define clear prerequisites for chemical reasoning training and highlight the broader role of mid-stage training in unlocking reasoning capabilities.
• 摘要：大型语言模型可以通过基于规则的奖励进行在线微调来开发推理能力。然而，最近的研究揭示了一个关键的限制：只有当基本模型已经为正确答案分配了不可忽略的概率时，强化学习才能成功——我们称之为“潜在可解性”的属性。这项工作研究了化学推理能力的出现以及这些先决条件对化学意味着什么。我们确定了基于强化学习的化学推理的两个必要条件：1）符号能力，2）潜在的化学知识。我们提出中期科学训练（MiST）：一套满足这些要求的中期训练技术，包括使用 SMILES/CIF 感知预处理进行数据混合、对 2.9B 代币进行持续预训练以及对 1B 代币进行监督微调。这些步骤将 3B 和 7B 模型的潜在可解性分数提高了 1.8 倍，并使 RL 将有机反应命名的 top-1 准确率从 10.9% 提高到 63.9%，将无机材料生成的准确度从 40.6% 提高到 67.4%。对于其他具有挑战性的化学任务也观察到类似的结果，同时产生可解释的推理痕迹。我们的结果明确了化学推理训练的先决条件，并强调了中期训练在释放推理能力方面的更广泛作用。

Title: SegMo: Segment-aligned Text to 3D Human Motion Generation

• Authors: Bowen Dang, Lin Wu, Xiaohang Yang, Zheng Yuan, Zhixiang Chen
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2512.21237
• Pdf URL: https://arxiv.org/pdf/2512.21237
• Copy Paste: [[2512.21237]] SegMo: Segment-aligned Text to 3D Human Motion Generation(https://arxiv.org/abs/2512.21237)
• Keywords: generation
• Abstract: Generating 3D human motions from textual descriptions is an important research problem with broad applications in video games, virtual reality, and augmented reality. Recent methods align the textual description with human motion at the sequence level, neglecting the internal semantic structure of modalities. However, both motion descriptions and motion sequences can be naturally decomposed into smaller and semantically coherent segments, which can serve as atomic alignment units to achieve finer-grained correspondence. Motivated by this, we propose SegMo, a novel Segment-aligned text-conditioned human Motion generation framework to achieve fine-grained text-motion alignment. Our framework consists of three modules: (1) Text Segment Extraction, which decomposes complex textual descriptions into temporally ordered phrases, each representing a simple atomic action; (2) Motion Segment Extraction, which partitions complete motion sequences into corresponding motion segments; and (3) Fine-grained Text-Motion Alignment, which aligns text and motion segments with contrastive learning. Extensive experiments demonstrate that SegMo improves the strong baseline on two widely used datasets, achieving an improved TOP 1 score of 0.553 on the HumanML3D test set. Moreover, thanks to the learned shared embedding space for text and motion segments, SegMo can also be applied to retrieval-style tasks such as motion grounding and motion-to-text retrieval.
• 摘要：从文本描述生成 3D 人体动作是一个重要的研究问题，在视频游戏、虚拟现实和增强现实中有着广泛的应用。最近的方法将文本描述与序列级别的人体运动对齐，忽略了模态的内部语义结构。然而，运动描述和运动序列都可以自然地分解为更小的、语义上连贯的片段，这些片段可以作为原子对齐单元来实现更细粒度的对应。受此启发，我们提出了 SegMo，一种新颖的分段对齐文本条件人类运动生成框架，以实现细粒度的文本运动对齐。我们的框架由三个模块组成：（1）文本段提取，它将复杂的文本描述分解为按时间顺序排列的短语，每个短语代表一个简单的原子动作； (2)运动片段提取，将完整的运动序列分割成对应的运动片段； (3)细粒度文本-运动对齐，通过对比学习来对齐文本和运动片段。大量实验表明，SegMo 改进了两个广泛使用的数据集上的强基线，在 HumanML3D 测试集上实现了 0.553 的改进 TOP 1 分数。此外，由于学习了文本和运动片段的共享嵌入空间，SegMo 还可以应用于检索型任务，例如运动基础和运动到文本检索。

Title: DreaMontage: Arbitrary Frame-Guided One-Shot Video Generation

• Authors: Jiawei Liu, Junqiao Li, Jiangfan Deng, Gen Li, Siyu Zhou, Zetao Fang, Shanshan Lao, Zengde Deng, Jianing Zhu, Tingting Ma, Jiayi Li, Yunqiu Wang, Qian He, Xinglong Wu
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2512.21252
• Pdf URL: https://arxiv.org/pdf/2512.21252
• Copy Paste: [[2512.21252]] DreaMontage: Arbitrary Frame-Guided One-Shot Video Generation(https://arxiv.org/abs/2512.21252)
• Keywords: generation
• Abstract: The "one-shot" technique represents a distinct and sophisticated aesthetic in filmmaking. However, its practical realization is often hindered by prohibitive costs and complex real-world constraints. Although emerging video generation models offer a virtual alternative, existing approaches typically rely on naive clip concatenation, which frequently fails to maintain visual smoothness and temporal coherence. In this paper, we introduce DreaMontage, a comprehensive framework designed for arbitrary frame-guided generation, capable of synthesizing seamless, expressive, and long-duration one-shot videos from diverse user-provided inputs. To achieve this, we address the challenge through three primary dimensions. (i) We integrate a lightweight intermediate-conditioning mechanism into the DiT architecture. By employing an Adaptive Tuning strategy that effectively leverages base training data, we unlock robust arbitrary-frame control capabilities. (ii) To enhance visual fidelity and cinematic expressiveness, we curate a high-quality dataset and implement a Visual Expression SFT stage. In addressing critical issues such as subject motion rationality and transition smoothness, we apply a Tailored DPO scheme, which significantly improves the success rate and usability of the generated content. (iii) To facilitate the production of extended sequences, we design a Segment-wise Auto-Regressive (SAR) inference strategy that operates in a memory-efficient manner. Extensive experiments demonstrate that our approach achieves visually striking and seamlessly coherent one-shot effects while maintaining computational efficiency, empowering users to transform fragmented visual materials into vivid, cohesive one-shot cinematic experiences.
• 摘要：“一次性”技术代表了电影制作中独特而复杂的美学。然而，其实际实现往往受到高昂的成本和复杂的现实限制的阻碍。尽管新兴的视频生成模型提供了虚拟替代方案，但现有方法通常依赖于简单的剪辑串联，这常常无法保持视觉平滑度和时间连贯性。在本文中，我们介绍了DreaMontage，这是一种专为任意帧引导生成而设计的综合框架，能够从不同的用户提供的输入中合成无缝、富有表现力和长时间的一次性视频。为了实现这一目标，我们通过三个主要维度应对挑战。 (i) 我们将轻量级中间调节机制集成到 DiT 架构中。通过采用有效利用基础训练数据的自适应调整策略，我们解锁了强大的任意帧控制功能。 (ii) 为了增强视觉保真度和电影表现力，我们策划了高质量的数据集并实现了视觉表达 SFT 阶段。在解决主体运动合理性和过渡平滑性等关键问题时，我们采用了定制的DPO方案，显着提高了生成内容的成功率和可用性。 （iii）为了促进扩展序列的生成，我们设计了一种以内存高效方式运行的分段自回归（SAR）推理策略。大量的实验表明，我们的方法实现了视觉冲击力和无缝连贯的一次性效果，同时保持计算效率，使用户能够将碎片化的视觉材料转化为生动、有凝聚力的一次性电影体验。

Title: ACD: Direct Conditional Control for Video Diffusion Models via Attention Supervision

• Authors: Weiqi Li, Zehao Zhang, Liang Lin, Guangrun Wang
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2512.21268
• Pdf URL: https://arxiv.org/pdf/2512.21268
• Copy Paste: [[2512.21268]] ACD: Direct Conditional Control for Video Diffusion Models via Attention Supervision(https://arxiv.org/abs/2512.21268)
• Keywords: generation
• Abstract: Controllability is a fundamental requirement in video synthesis, where accurate alignment with conditioning signals is essential. Existing classifier-free guidance methods typically achieve conditioning indirectly by modeling the joint distribution of data and conditions, which often results in limited controllability over the specified conditions. Classifier-based guidance enforces conditions through an external classifier, but the model may exploit this mechanism to raise the classifier score without genuinely satisfying the intended condition, resulting in adversarial artifacts and limited effective controllability. In this paper, we propose Attention-Conditional Diffusion (ACD), a novel framework for direct conditional control in video diffusion models via attention supervision. By aligning the model's attention maps with external control signals, ACD achieves better controllability. To support this, we introduce a sparse 3D-aware object layout as an efficient conditioning signal, along with a dedicated Layout ControlNet and an automated annotation pipeline for scalable layout integration. Extensive experiments on benchmark video generation datasets demonstrate that ACD delivers superior alignment with conditioning inputs while preserving temporal coherence and visual fidelity, establishing an effective paradigm for conditional video synthesis.
• 摘要：可控性是视频合成的基本要求，其中与调节信号的精确对准至关重要。现有的无分类器引导方法通常通过对数据和条件的联合分布进行建模来间接实现调节，这通常会导致对指定条件的可控性有限。基于分类器的指导通过外部分类器强制执行条件，但模型可能会利用这种机制来提高分类器分数，而没有真正满足预期条件，从而导致对抗性伪影和有限的有效可控性。在本文中，我们提出了注意力条件扩散（ACD），这是一种通过注意力监督在视频扩散模型中进行直接条件控制的新颖框架。通过将模型的注意力图与外部控制信号对齐，ACD 实现了更好的可控性。为了支持这一点，我们引入了稀疏 3D 感知对象布局作为有效的调节信号，以及专用的布局 ControlNet 和用于可扩展布局集成的自动注释管道。对基准视频生成数据集的大量实验表明，ACD 可以与条件输入实现出色的对齐，同时保持时间连贯性和视觉保真度，从而为条件视频合成建立了有效的范例。

Title: GriDiT: Factorized Grid-Based Diffusion for Efficient Long Image Sequence Generation

• Authors: Snehal Singh Tomar, Alexandros Graikos, Arjun Krishna, Dimitris Samaras, Klaus Mueller
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2512.21276
• Pdf URL: https://arxiv.org/pdf/2512.21276
• Copy Paste: [[2512.21276]] GriDiT: Factorized Grid-Based Diffusion for Efficient Long Image Sequence Generation(https://arxiv.org/abs/2512.21276)
• Keywords: generation, generative
• Abstract: Modern deep learning methods typically treat image sequences as large tensors of sequentially stacked frames. However, is this straightforward representation ideal given the current state-of-the-art (SoTA)? In this work, we address this question in the context of generative models and aim to devise a more effective way of modeling image sequence data. Observing the inefficiencies and bottlenecks of current SoTA image sequence generation methods, we showcase that rather than working with large tensors, we can improve the generation process by factorizing it into first generating the coarse sequence at low resolution and then refining the individual frames at high resolution. We train a generative model solely on grid images comprising subsampled frames. Yet, we learn to generate image sequences, using the strong self-attention mechanism of the Diffusion Transformer (DiT) to capture correlations between frames. In effect, our formulation extends a 2D image generator to operate as a low-resolution 3D image-sequence generator without introducing any architectural modifications. Subsequently, we super-resolve each frame individually to add the sequence-independent high-resolution details. This approach offers several advantages and can overcome key limitations of the SoTA in this domain. Compared to existing image sequence generation models, our method achieves superior synthesis quality and improved coherence across sequences. It also delivers high-fidelity generation of arbitrary-length sequences and increased efficiency in inference time and training data usage. Furthermore, our straightforward formulation enables our method to generalize effectively across diverse data domains, which typically require additional priors and supervision to model in a generative context. Our method consistently outperforms SoTA in quality and inference speed (at least twice-as-fast) across datasets.
• 摘要：现代深度学习方法通​​常将图像序列视为顺序堆叠帧的大张量。然而，考虑到当前最先进的技术（SoTA），这种简单的表示是否理想？在这项工作中，我们在生成模型的背景下解决这个问题，旨在设计一种更有效的图像序列数据建模方法。观察当前 SoTA 图像序列生成方法的低效和瓶颈，我们展示了我们可以通过分解为首先以低分辨率生成粗略序列，然后以高分辨率细化各个帧来改进生成过程，而不是使用大张量。我们仅在包含子采样帧的网格图像上训练生成模型。然而，我们学习生成图像序列，使用扩散变压器（DiT）强大的自注意力机制来捕获帧之间的相关性。实际上，我们的公式扩展了 2D 图像生成器，使其可以作为低分辨率 3D 图像序列生成器运行，而无需引入任何架构修改。随后，我们单独对每个帧进行超解析，以添加与序列无关的高分辨率细节。这种方法具有多种优势，并且可以克服 SoTA 在该领域的关键限制。与现有的图像序列生成模型相比，我们的方法实现了卓越的合成质量并提高了序列之间的一致性。它还提供任意长度序列的高保真生成，并提高推理时间和训练数据使用的效率。此外，我们简单的公式使我们的方法能够有效地推广到不同的数据域，这通常需要额外的先验和监督才能在生成环境中建模。我们的方法在整个数据集的质量和推理速度（至少快两倍）方面始终优于 SoTA。

Title: Transcriptome-Conditioned Personalized De Novo Drug Generation for AML Using Metaheuristic Assembly and Target-Driven Filtering

• Authors: Abdullah G. Elafifi, Basma Mamdouh, Mariam Hanafy, Muhammed Alaa Eldin, Yosef Khaled, Nesma Mohamed El-Gelany, Tarek H.M. Abou-El-Enien
• Subjects: cs.LG, q-bio.QM
• Abstract URL: https://arxiv.org/abs/2512.21301
• Pdf URL: https://arxiv.org/pdf/2512.21301
• Copy Paste: [[2512.21301]] Transcriptome-Conditioned Personalized De Novo Drug Generation for AML Using Metaheuristic Assembly and Target-Driven Filtering(https://arxiv.org/abs/2512.21301)
• Keywords: generation, generative
• Abstract: Acute Myeloid Leukemia (AML) remains a clinical challenge due to its extreme molecular heterogeneity and high relapse rates. While precision medicine has introduced mutation-specific therapies, many patients still lack effective, personalized options. This paper presents a novel, end-to-end computational framework that bridges the gap between patient-specific transcriptomics and de novo drug discovery. By analyzing bulk RNA sequencing data from the TCGA-LAML cohort, the study utilized Weighted Gene Co-expression Network Analysis (WGCNA) to prioritize 20 high-value biomarkers, including metabolic transporters like HK3 and immune-modulatory receptors such as SIGLEC9. The physical structures of these targets were modeled using AlphaFold3, and druggable hotspots were quantitatively mapped via the DOGSiteScorer engine. Then developed a novel, reaction-first evolutionary metaheuristic algorithm as well as multi-objective optimization programming that assembles novel ligands from fragment libraries, guided by spatial alignment to these identified hotspots. The generative model produced structurally unique chemical entities with a strong bias toward drug-like space, as evidenced by QED scores peaking between 0.5 and 0.7. Validation through ADMET profiling and SwissDock molecular docking identified high-confidence candidates, such as Ligand L1, which achieved a binding free energy of -6.571 kcal/mol against the A08A96 biomarker. These results demonstrate that integrating systems biology with metaheuristic molecular assembly can produce pharmacologically viable, patient tailored leads, offering a scalable blueprint for precision oncology in AML and beyond
• 摘要：急性髓系白血病（AML）由于其极端的分子异质性和高复发率，仍然是一个临床挑战。尽管精准医学已经引入了突变特异性疗法，但许多患者仍然缺乏有效、个性化的选择。本文提出了一种新颖的端到端计算框架，弥补了患者特异性转录组学和从头药物发现之间的差距。通过分析来自 TCGA-LAML 队列的大量 RNA 测序数据，该研究利用加权基因共表达网络分析 (WGCNA) 来优先考虑 20 个高价值生物标志物，包括 HK3 等代谢转运蛋白和 SIGLEC9 等免疫调节受体。使用 AlphaFold3 对这些目标的物理结构进行建模，并通过 DOGSiteScorer 引擎定量绘制可药物热点。然后开发了一种新颖的、反应优先的进化元启发式算法以及多目标优化编程，通过与这些已识别的热点的空间对齐引导，从片段库中组装新的配体。生成模型产生了结构独特的化学实体，对类药物空间有强烈的偏向，QED 分数峰值在 0.5 到 0.7 之间就证明了这一点。通过 ADMET 分析和 SwissDock 分子对接进行验证，确定了高可信度候选物，例如配体 L1，它针对 A08A96 生物标志物实现了 -6.571 kcal/mol 的结合自由能。这些结果表明，将系统生物学与元启发式分子组装相结合可以产生药理学上可行的、为患者量身定制的先导化合物，为 AML 及其他领域的精准肿瘤学提供可扩展的蓝图

Title: HiStream: Efficient High-Resolution Video Generation via Redundancy-Eliminated Streaming

• Authors: Haonan Qiu, Shikun Liu, Zijian Zhou, Zhaochong An, Weiming Ren, Zhiheng Liu, Jonas Schult, Sen He, Shoufa Chen, Yuren Cong, Tao Xiang, Ziwei Liu, Juan-Manuel Perez-Rua
• Subjects: cs.CV
• Abstract URL: https://arxiv.org/abs/2512.21338
• Pdf URL: https://arxiv.org/pdf/2512.21338
• Copy Paste: [[2512.21338]] HiStream: Efficient High-Resolution Video Generation via Redundancy-Eliminated Streaming(https://arxiv.org/abs/2512.21338)
• Keywords: generation
• Abstract: High-resolution video generation, while crucial for digital media and film, is computationally bottlenecked by the quadratic complexity of diffusion models, making practical inference infeasible. To address this, we introduce HiStream, an efficient autoregressive framework that systematically reduces redundancy across three axes: i) Spatial Compression: denoising at low resolution before refining at high resolution with cached features; ii) Temporal Compression: a chunk-by-chunk strategy with a fixed-size anchor cache, ensuring stable inference speed; and iii) Timestep Compression: applying fewer denoising steps to subsequent, cache-conditioned chunks. On 1080p benchmarks, our primary HiStream model (i+ii) achieves state-of-the-art visual quality while demonstrating up to 76.2x faster denoising compared to the Wan2.1 baseline and negligible quality loss. Our faster variant, HiStream+, applies all three optimizations (i+ii+iii), achieving a 107.5x acceleration over the baseline, offering a compelling trade-off between speed and quality, thereby making high-resolution video generation both practical and scalable.
• 摘要：高分辨率视频生成虽然对数字媒体和电影至关重要，但由于扩散模型的二次复杂性而成为计算瓶颈，使得实际推理变得不可行。为了解决这个问题，我们引入了 HiStream，一种高效的自回归框架，可以系统地减少三个轴上的冗余： i) 空间压缩：在低分辨率下进行去噪，然后使用缓存特征以高分辨率进行细化； ii) 时间压缩：采用逐块策略，固定大小的锚点缓存，保证稳定的推理速度； iii) 时间步长压缩：对后续的缓存条件块应用更少的去噪步骤。在 1080p 基准测试中，我们的主要 HiStream 模型 (i+ii) 实现了最先进的视觉质量，同时与 Wan2.1 基准相比，去噪速度提高了 76.2 倍，并且质量损失可以忽略不计。我们的更快变体 HiStream+ 应用了所有三种优化 (i+ii+iii)，实现了基线 107.5 倍的加速，在速度和质量之间提供了令人信服的权衡，从而使高分辨率视频生成既实用又可扩展。