2025-12-18

Title: Incentives or Ontology? A Structural Rebuttal to OpenAI's Hallucination Thesis

• Authors: Richard Ackermann, Simeon Emanuilov
• Subjects: cs.CL, cs.AI, cs.LG
• Abstract URL: https://arxiv.org/abs/2512.14801
• Pdf URL: https://arxiv.org/pdf/2512.14801
• Copy Paste: [[2512.14801]] Incentives or Ontology? A Structural Rebuttal to OpenAI's Hallucination Thesis(https://arxiv.org/abs/2512.14801)
• Keywords: language model, hallucination, prompt
• Abstract: OpenAI has recently argued that hallucinations in large language models result primarily from misaligned evaluation incentives that reward confident guessing rather than epistemic humility. On this view, hallucination is a contingent behavioral artifact, remediable through improved benchmarks and reward structures. In this paper, we challenge that interpretation. Drawing on previous work on structural hallucination and empirical experiments using a Licensing Oracle, we argue that hallucination is not an optimization failure but an architectural inevitability of the transformer model. Transformers do not represent the world; they model statistical associations among tokens. Their embedding spaces form a pseudo-ontology derived from linguistic co-occurrence rather than world-referential structure. At ontological boundary conditions - regions where training data is sparse or incoherent - the model necessarily interpolates fictional continuations in order to preserve coherence. No incentive mechanism can modify this structural dependence on pattern completion. Our empirical results demonstrate that hallucination can only be eliminated through external truth-validation and abstention modules, not through changes to incentives, prompting, or fine-tuning. The Licensing Oracle achieves perfect abstention precision across domains precisely because it supplies grounding that the transformer lacks. We conclude that hallucination is a structural property of generative architectures and that reliable AI requires hybrid systems that distinguish linguistic fluency from epistemic responsibility.
• 摘要：OpenAI 最近认为，大型语言模型中的幻觉主要是由于评估激励不一致造成的，这些激励奖励的是自信的猜测，而不是认知上的谦逊。根据这种观点，幻觉是一种偶然的行为产物，可以通过改进基准和奖励结构来补救。在本文中，我们对这种解释提出了质疑。借鉴之前关于结构幻觉的工作和使用许可预言机的实证实验，我们认为幻觉不是优化失败，而是变压器模型的架构必然性。变形金刚并不代表世界；他们对代币之间的统计关联进行建模。它们的嵌入空间形成了一种源自语言共现而不是世界指涉结构的伪本体论。在本体边界条件（训练数据稀疏或不连贯的区域）下，模型必须插入虚构的延续以保持连贯性。没有任何激励机制可以改变这种对模式完成的结构性依赖。我们的实证结果表明，幻觉只能通过外部真理验证和弃权模块来消除，而不能通过改变激励、提示或微调来消除。许可预言机在跨域中实现了完美的弃权精度，正是因为它提供了变压器所缺乏的接地。我们的结论是，幻觉是生成架构的结构属性，可靠的人工智能需要混合系统来区分语言流畅性和认知责任。

Title: T5Gemma 2: Seeing, Reading, and Understanding Longer

• Authors: Biao Zhang, Paul Suganthan, Gaël Liu, Ilya Philippov, Sahil Dua, Ben Hora, Kat Black, Gus Martins, Omar Sanseviero, Shreya Pathak, Cassidy Hardin, Francesco Visin, Jiageng Zhang, Kathleen Kenealy, Qin Yin, Olivier Lacombe, Armand Joulin, Tris Warkentin, Adam Roberts
• Subjects: cs.CL
• Abstract URL: https://arxiv.org/abs/2512.14856
• Pdf URL: https://arxiv.org/pdf/2512.14856
• Copy Paste: [[2512.14856]] T5Gemma 2: Seeing, Reading, and Understanding Longer(https://arxiv.org/abs/2512.14856)
• Keywords: long context
• Abstract: We introduce T5Gemma 2, the next generation of the T5Gemma family of lightweight open encoder-decoder models, featuring strong multilingual, multimodal and long-context capabilities. T5Gemma 2 follows the adaptation recipe (via UL2) in T5Gemma -- adapting a pretrained decoder-only model into an encoder-decoder model, and extends it from text-only regime to multimodal based on the Gemma 3 models. We further propose two methods to improve the efficiency: tied word embedding that shares all embeddings across encoder and decoder, and merged attention that unifies decoder self- and cross-attention into a single joint module. Experiments demonstrate the generality of the adaptation strategy over architectures and modalities as well as the unique strength of the encoder-decoder architecture on long context modeling. Similar to T5Gemma, T5Gemma 2 yields comparable or better pretraining performance and significantly improved post-training performance than its Gemma 3 counterpart. We release the pretrained models (270M-270M, 1B-1B and 4B-4B) to the community for future research.
• 摘要：我们推出 T5Gemma 2，它是 T5Gemma 系列轻量级开放编码器-解码器模型的下一代产品，具有强大的多语言、多模式和长上下文功能。 T5Gemma 2 遵循 T5Gemma 中的适配方法（通过 UL2）——将预训练的纯解码器模型适配为编码器-解码器模型，并将其从纯文本机制扩展到基于 Gemma 3 模型的多模态。我们进一步提出了两种提高效率的方法：共享编码器和解码器之间所有嵌入的绑定词嵌入，以及将解码器自注意力和交叉注意力统一到单个联合模块中的合并注意力。实验证明了适应策略在架构和模式上的通用性，以及编码器-解码器架构在长上下文建模上的独特优势。与 T5Gemma 类似，T5Gemma 2 的预训练性能与 Gemma 3 相当或更好，并且训练后性能显着提高。我们向社区发布预训练模型（270M-270M、1B-1B 和 4B-4B）以供未来研究。

Title: Integrating Large Language Models and Knowledge Graphs to Capture Political Viewpoints in News Media

• Authors: Massimiliano Fadda, Enrico Motta, Francesco Osborne, Diego Reforgiato Recupero, Angelo Salatino
• Subjects: cs.CL, cs.AI, cs.IR
• Abstract URL: https://arxiv.org/abs/2512.14887
• Pdf URL: https://arxiv.org/pdf/2512.14887
• Copy Paste: [[2512.14887]] Integrating Large Language Models and Knowledge Graphs to Capture Political Viewpoints in News Media(https://arxiv.org/abs/2512.14887)
• Keywords: language model, llm
• Abstract: News sources play a central role in democratic societies by shaping political and social discourse through specific topics, viewpoints and voices. Understanding these dynamics is essential for assessing whether the media landscape offers a balanced and fair account of public debate. In earlier work, we introduced a pipeline that, given a news corpus, i) uses a hybrid human-machine approach to identify the range of viewpoints expressed about a given topic, and ii) classifies relevant claims with respect to the identified viewpoints, defined as sets of semantically and ideologically congruent claims (e.g., positions arguing that immigration positively impacts the UK economy). In this paper, we improve this pipeline by i) fine-tuning Large Language Models (LLMs) for viewpoint classification and ii) enriching claim representations with semantic descriptions of relevant actors drawn from Wikidata. We evaluate our approach against alternative solutions on a benchmark centred on the UK immigration debate. Results show that while both mechanisms independently improve classification performance, their integration yields the best results, particularly when using LLMs capable of processing long inputs.
• 摘要：新闻来源通过特定主题、观点和声音塑造政治和社会话语，在民主社会中发挥着核心作用。了解这些动态对于评估媒体格局是否对公共辩论提供平衡和公平的描述至关重要。在早期的工作中，我们引入了一个管道，在给定新闻语料库的情况下，i）使用混合人机方法来识别针对给定主题表达的观点范围，ii）对所识别观点的相关主张进行分类，定义为语义和意识形态上一致的主张集（例如，认为移民对英国经济产生积极影响的立场）。在本文中，我们通过 i）微调大型语言模型（LLM）以进行观点分类，以及 ii）利用从维基数据中提取的相关参与者的语义描述来丰富声明表示，从而改进了这一流程。我们根据以英国移民辩论为中心的基准来评估我们的方法与替代解决方案。结果表明，虽然两种机制独立地提高了分类性能，但它们的集成产生了最佳结果，特别是在使用能够处理长输入的 LLM 时。

Title: DrugRAG: Enhancing Pharmacy LLM Performance Through A Novel Retrieval-Augmented Generation Pipeline

• Authors: Houman Kazemzadeh, Kiarash Mokhtari Dizaji, Seyed Reza Tavakoli, Farbod Davoodi, MohammadReza KarimiNejad, Parham Abed Azad, Ali Sabzi, Armin Khosravi, Siavash Ahmadi, Mohammad Hossein Rohban, Glolamali Aminian, Tahereh Javaheri
• Subjects: cs.CL, cs.AI
• Abstract URL: https://arxiv.org/abs/2512.14896
• Pdf URL: https://arxiv.org/pdf/2512.14896
• Copy Paste: [[2512.14896]] DrugRAG: Enhancing Pharmacy LLM Performance Through A Novel Retrieval-Augmented Generation Pipeline(https://arxiv.org/abs/2512.14896)
• Keywords: language model, gpt, llm, prompt, retrieval-augmented generation
• Abstract: Objectives: To evaluate large language model (LLM) performance on pharmacy licensure-style question-answering (QA) tasks and develop an external knowledge integration method to improve their accuracy. Methods: We benchmarked eleven existing LLMs with varying parameter sizes (8 billion to 70+ billion) using a 141-question pharmacy dataset. We measured baseline accuracy for each model without modification. We then developed a three-step retrieval-augmented generation (RAG) pipeline, DrugRAG, that retrieves structured drug knowledge from validated sources and augments model prompts with evidence-based context. This pipeline operates externally to the models, requiring no changes to model architecture or parameters. Results: Baseline accuracy ranged from 46% to 92%, with GPT-5 (92%) and o3 (89%) achieving the highest scores. Models with fewer than 8 billion parameters scored below 50%. DrugRAG improved accuracy across all tested models, with gains ranging from 7 to 21 percentage points (e.g., Gemma 3 27B: 61% to 71%, Llama 3.1 8B: 46% to 67%) on the 141-item benchmark. Conclusion: We demonstrate that external structured drug knowledge integration through DrugRAG measurably improves LLM accuracy on pharmacy tasks without modifying the underlying models. This approach provides a practical pipeline for enhancing pharmacy-focused AI applications with evidence-based information.
• 摘要：目标：评估大语言模型 (LLM) 在药房许可式问答 (QA) 任务中的表现，并开发外部知识集成方法以提高其准确性。方法：我们使用包含 141 个问题的药学数据集，对 11 名具有不同参数大小（80 亿至 70+ 十亿）的现有法学硕士进行了基准测试。我们在没有修改的情况下测量了每个模型的基线准确性。然后，我们开发了一个三步检索增强生成（RAG）管道 DrugRAG，它从经过验证的来源检索结构化药物知识，并通过基于证据的上下文增强模型提示。该管道在模型外部运行，无需更改模型架构或参数。结果：基线准确度范围为 46% 至 92%，其中 GPT-5 (92%) 和 o3 (89%) 得分最高。参数少于 80 亿的模型得分低于 50%。 DrugRAG 提高了所有测试模型的准确性，在 141 项基准上提高了 7 至 21 个百分点（例如，Gemma 3 27B：61% 至 71%，Llama 3.1 8B：46% 至 67%）。结论：我们证明，通过 DrugRAG 进行的外部结构化药物知识集成可显着提高 LLM 在药学任务上的准确性，而无需修改基础模型。这种方法提供了一个实用的管道，可以利用基于证据的信息来增强以药房为中心的人工智能应用。

Title: Multiscale Aggregated Hierarchical Attention (MAHA): A Game Theoretic and Optimization Driven Approach to Efficient Contextual Modeling in Large Language Models

• Authors: Caner Erden
• Subjects: cs.CL
• Abstract URL: https://arxiv.org/abs/2512.14925
• Pdf URL: https://arxiv.org/pdf/2512.14925
• Copy Paste: [[2512.14925]] Multiscale Aggregated Hierarchical Attention (MAHA): A Game Theoretic and Optimization Driven Approach to Efficient Contextual Modeling in Large Language Models(https://arxiv.org/abs/2512.14925)
• Keywords: language model, llm
• Abstract: The quadratic computational complexity of MultiHead SelfAttention (MHSA) remains a fundamental bottleneck in scaling Large Language Models (LLMs) for longcontext tasks. While sparse and linearized attention mechanisms attempt to mitigate this, they often compromise the representation of global dependencies or fail to capture multiscale semantic granularity effectively. In this paper, we propose Multiscale Aggregated Hierarchical Attention (MAHA), a novel architectural framework that reformulates the attention mechanism through hierarchical decomposition and mathematically rigorous aggregation. Unlike conventional approaches that treat token interactions at a single resolution, MAHA dynamically partitions the input sequence into hierarchical scales via learnable downsampling operators. The core innovation lies in its aggregation strategy: we model the fusion of scalespecific attention matrices as a resource allocation problem, solved via a convex optimization framework or a Nash equilibriumbased gametheoretic approach. This ensures a theoretically optimal balance between local nuance and global context fidelity. Implemented within a hybrid dilatedconvolutional transformer backbone, MAHA utilizes differentiable optimization layers to enable endtoend training. Experimental evaluations demonstrate that MAHA achieves superior scalability; empirical FLOPs analysis confirms an 81% reduction in computational cost at a sequence length of 4096 compared to standard attention. This work bridges the gap between optimization theory and sequence modeling, offering a scalable solution for nextgeneration LLMs.
• 摘要：多头自注意力（MHSA）的二次计算复杂性仍然是扩展大型语言模型（LLM）以处理长上下文任务的基本瓶颈。虽然稀疏和线性化注意力机制试图缓解这一问题，但它们通常会损害全局依赖关系的表示或无法有效捕获多尺度语义粒度。在本文中，我们提出了多尺度聚合层次注意力（MAHA），这是一种新颖的架构框架，它通过层次分解和数学上严格的聚合重新构建注意力机制。与以单一分辨率处理令牌交互的传统方法不同，MAHA 通过可学习的下采样算子将输入序列动态划分为分层尺度。核心创新在于其聚合策略：我们将特定尺度注意力矩阵的融合建模为资源分配问题，通过凸优化框架或基于纳什均衡的博弈论方法来解决。这确保了局部细微差别和全局上下文保真度之间理论上的最佳平衡。 MAHA 在混合扩张卷积变压器主干中实现，利用可微优化层来实现端到端训练。实验评估表明MAHA实现了卓越的可扩展性；经验 FLOPs 分析证实，与标准注意力相比，序列长度为 4096 时计算成本降低了 81%。这项工作弥合了优化理论和序列建模之间的差距，为下一代法学硕士提供了可扩展的解决方案。

Title: Parameter Efficient Multimodal Instruction Tuning for Romanian Vision Language Models

• Authors: George-Andrei Dima, Dumitru-Clementin Cercel
• Subjects: cs.CL, cs.AI, cs.LG
• Abstract URL: https://arxiv.org/abs/2512.14926
• Pdf URL: https://arxiv.org/pdf/2512.14926
• Copy Paste: [[2512.14926]] Parameter Efficient Multimodal Instruction Tuning for Romanian Vision Language Models(https://arxiv.org/abs/2512.14926)
• Keywords: language model, llm
• Abstract: Focusing on low-resource languages is an essential step toward democratizing generative AI. In this work, we contribute to reducing the multimodal NLP resource gap for Romanian. We translate the widely known Flickr30k dataset into Romanian and further extend it for visual question answering by leveraging open-source LLMs. We demonstrate the usefulness of our datasets by fine-tuning open-source VLMs on Romanian visual question answering. We select VLMs from three widely used model families: LLaMA 3.2, LLaVA 1.6, and Qwen2. For fine-tuning, we employ the parameter-efficient LoRA method. Our models show improved Romanian capabilities in visual QA, as well as on tasks they were not trained on, such as Romanian image description generation. The seven-billion-parameter Qwen2-VL-RoVQA obtains top scores on both tasks, with improvements of +6.05% and +2.61% in BERTScore F1 over its original version. Finally, the models show substantial reductions in grammatical errors compared to their original forms, indicating improvements not only in language understanding but also in Romanian fluency.
• 摘要：关注资源匮乏的语言是实现生成式人工智能民主化的重要一步。在这项工作中，我们致力于缩小罗马尼亚语的多模式 NLP 资源缺口。我们将广为人知的 Flickr30k 数据集翻译成罗马尼亚语，并利用开源法学硕士进一步将其扩展为视觉问答。我们通过在罗马尼亚语视觉问答上微调开源 VLM 来展示数据集的实用性。我们从三个广泛使用的模型系列中选择 VLM：LLaMA 3.2、LLaVA 1.6 和 Qwen2。为了进行微调，我们采用参数高效的 LoRA 方法。我们的模型显示了罗马尼亚语在视觉 QA 以及未受过训练的任务（例如罗马尼亚语图像描述生成）方面的能力有所提高。 70 亿参数的 Qwen2-VL-RoVQA 在两项​​任务上均获得最高分，BERTScore F1 较原始版本分别提高了 +6.05% 和 +2.61%。最后，与原始形式相比，这些模型显示语法错误大幅减少，这表明不仅在语言理解方面有所提高，而且罗马尼亚语的流利程度也有所提高。

Title: Cross-Tokenizer Likelihood Scoring Algorithms for Language Model Distillation

• Authors: Buu Phan, Ashish Khisti, Karen Ullrich
• Subjects: cs.CL, cs.LG
• Abstract URL: https://arxiv.org/abs/2512.14954
• Pdf URL: https://arxiv.org/pdf/2512.14954
• Copy Paste: [[2512.14954]] Cross-Tokenizer Likelihood Scoring Algorithms for Language Model Distillation(https://arxiv.org/abs/2512.14954)
• Keywords: language model
• Abstract: Computing next-token likelihood ratios between two language models (LMs) is a standard task in training paradigms such as knowledge distillation. Since this requires both models to share the same probability space, it becomes challenging when the teacher and student LMs use different tokenizers, for instance, when edge-device deployment necessitates a smaller vocabulary size to lower memory overhead. In this work, we address this vocabulary misalignment problem by uncovering an implicit recursive structure in the commonly deployed Byte-Pair Encoding (BPE) algorithm and utilizing it to create a probabilistic framework for cross-tokenizer likelihood scoring. Our method enables sequence likelihood evaluation for vocabularies different from the teacher model native tokenizer, addressing two specific scenarios: when the student vocabulary is a subset of the teacher vocabulary, and the general case where it is arbitrary. In the subset regime, our framework computes exact likelihoods and provides next-token probabilities for sequential sampling with only O(1) model evaluations per token. When used for distillation, this yields up to a 12% reduction in memory footprint for the Qwen2.5-1.5B model while also improving baseline performance up to 4% on the evaluated tasks. For the general case, we introduce a rigorous lossless procedure that leverages BPE recursive structure, complemented by a fast approximation that keeps large-vocabulary settings practical. Applied to distillation for mathematical reasoning, our approach improves GSM8K accuracy by more than 2% over the current state of the art.
• 摘要：计算两种语言模型 (LM) 之间的下一个标记似然比是知识蒸馏等训练范例中的标准任务。由于这需要两个模型共享相同的概率空间，因此当教师和学生 LM 使用不同的分词器时（例如，当边缘设备部署需要更小的词汇量以降低内存开销时），这就变得具有挑战性。在这项工作中，我们通过揭示普遍部署的字节对编码（BPE）算法中的隐式递归结构并利用它来创建用于跨分词器似然评分的概率框架来解决词汇不一致问题。我们的方法能够对与教师模型本机分词器不同的词汇进行序列似然评估，解决两个特定场景：当学生词汇是教师词汇的子集时，以及它是任意的一般情况。在子集机制中，我们的框架计算精确的可能性，并为顺序采样提供下一个令牌概率，每个令牌仅进行 O(1) 模型评估。当用于蒸馏时，Qwen2.5-1.5B 模型的内存占用量最多可减少 12%，同时还将评估任务的基线性能提高最多 4%。对于一般情况，我们引入了严格的无损过程，该过程利用 BPE 递归结构，并辅以快速近似，以保持大词汇量设置的实用性。我们的方法应用于数学推理的蒸馏，与当前最先进的技术相比，将 GSM8K 精度提高了 2% 以上。

Title: Evaluating Large Language Models on Multimodal Chemistry Olympiad Exams

• Authors: Yiming Cui, Xin Yao, Yuxuan Qin, Xin Li, Shijin Wang, Guoping Hu
• Subjects: cs.CL, cs.AI, cs.CV
• Abstract URL: https://arxiv.org/abs/2512.14989
• Pdf URL: https://arxiv.org/pdf/2512.14989
• Copy Paste: [[2512.14989]] Evaluating Large Language Models on Multimodal Chemistry Olympiad Exams(https://arxiv.org/abs/2512.14989)
• Keywords: language model, gpt, llm, prompt, chain-of-thought
• Abstract: Multimodal scientific reasoning remains a significant challenge for large language models (LLMs), particularly in chemistry, where problem-solving relies on symbolic diagrams, molecular structures, and structured visual data. Here, we systematically evaluate 40 proprietary and open-source multimodal LLMs, including GPT-5, o3, Gemini-2.5-Pro, and Qwen2.5-VL, on a curated benchmark of Olympiad-style chemistry questions drawn from over two decades of U.S. National Chemistry Olympiad (USNCO) exams. These questions require integrated visual and textual reasoning across diverse modalities. We find that many models struggle with modality fusion, where in some cases, removing the image even improves accuracy, indicating misalignment in vision-language integration. Chain-of-Thought prompting consistently enhances both accuracy and visual grounding, as demonstrated through ablation studies and occlusion-based interpretability. Our results reveal critical limitations in the scientific reasoning abilities of current MLLMs, providing actionable strategies for developing more robust and interpretable multimodal systems in chemistry. This work provides a timely benchmark for measuring progress in domain-specific multimodal AI and underscores the need for further advances at the intersection of artificial intelligence and scientific reasoning.
• 摘要：多模态科学推理对于大型语言模型 (LLM) 来说仍然是一个重大挑战，特别是在化学领域，因为问题的解决依赖于符号图、分子结构和结构化视觉数据。在这里，我们系统地评估了 40 个专有和开源多模式法学硕士，包括 GPT-5、o3、Gemini-2.5-Pro 和 Qwen2.5-VL，基于从二十多年的美国国家化学奥林匹克 (USNCO) 考试中抽取的奥林匹克式化学问题的策划基准。这些问题需要跨不同模式的综合视觉和文本推理。我们发现许多模型都在模态融合方面遇到困难，在某些情况下，删除图像甚至可以提高准确性，这表明视觉语言集成存在偏差。正如消融研究和基于遮挡的可解释性所证明的那样，思想链提示始终能够提高准确性和视觉基础。我们的结果揭示了当前 MLLM 科学推理能力的关键局限性，为开发更强大和可解释的化学多模态系统提供了可行的策略。这项工作为衡量特定领域的多模式人工智能的进展提供了及时的基准，并强调了人工智能和科学推理交叉领域进一步进步的必要性。

Title: DASH: Dialogue-Aware Similarity and Handshake Recognition for Topic Segmentation in Public-Channel Conversations

• Authors: Sijin Sun, Liangbin Zhao, Ming Deng, Xiuju Fu
• Subjects: cs.CL, cs.IR
• Abstract URL: https://arxiv.org/abs/2512.15042
• Pdf URL: https://arxiv.org/pdf/2512.15042
• Copy Paste: [[2512.15042]] DASH: Dialogue-Aware Similarity and Handshake Recognition for Topic Segmentation in Public-Channel Conversations(https://arxiv.org/abs/2512.15042)
• Keywords: llm
• Abstract: Dialogue Topic Segmentation (DTS) is crucial for understanding task-oriented public-channel communications, such as maritime VHF dialogues, which feature informal speech and implicit transitions. To address the limitations of traditional methods, we propose DASH-DTS, a novel LLM-based framework. Its core contributions are: (1) topic shift detection via dialogue handshake recognition; (2) contextual enhancement through similarity-guided example selection; and (3) the generation of selective positive and negative samples to improve model discrimination and robustness. Additionally, we release VHF-Dial, the first public dataset of real-world maritime VHF communications, to advance research in this domain. DASH-DTS provides interpretable reasoning and confidence scores for each segment. Experimental results demonstrate that our framework achieves several sota segmentation trusted accuracy on both VHF-Dial and standard benchmarks, establishing a strong foundation for stable monitoring and decision support in operational dialogues.
• 摘要：对话主题分段 (DTS) 对于理解面向任务的公共频道通信至关重要，例如海上 VHF 对话，其特点是非正式语音和隐式转换。为了解决传统方法的局限性，我们提出了 DASH-DTS，一种基于 LLM 的新型框架。其核心贡献是：（1）通过对话握手识别进行主题转移检测； (2)通过相似性引导的示例选择来增强上下文； (3)选择性正样本和负样本的生成，以提高模型的辨别力和鲁棒性。此外，我们还发布了 VHF-Dial，这是现实世界海上 VHF 通信的第一个公共数据集，以推进该领域的研究。 DASH-DTS 为每个细分提供可解释的推理和置信度分数。实验结果表明，我们的框架在 VHF-Dial 和标准基准上实现了多个 sota 分段可信精度，为操作对话中的稳定监控和决策支持奠定了坚实的基础。

Title: SGM: Safety Glasses for Multimodal Large Language Models via Neuron-Level Detoxification

• Authors: Hongbo Wang, MaungMaung AprilPyone, Isao Echizen
• Subjects: cs.CL, cs.AI
• Abstract URL: https://arxiv.org/abs/2512.15052
• Pdf URL: https://arxiv.org/pdf/2512.15052
• Copy Paste: [[2512.15052]] SGM: Safety Glasses for Multimodal Large Language Models via Neuron-Level Detoxification(https://arxiv.org/abs/2512.15052)
• Keywords: language model, llm
• Abstract: Disclaimer: Samples in this paper may be harmful and cause discomfort. Multimodal large language models (MLLMs) enable multimodal generation but inherit toxic, biased, and NSFW signals from weakly curated pretraining corpora, causing safety risks, especially under adversarial triggers that late, opaque training-free detoxification methods struggle to handle. We propose SGM, a white-box neuron-level multimodal intervention that acts like safety glasses for toxic neurons: it selectively recalibrates a small set of toxic expert neurons via expertise-weighted soft suppression, neutralizing harmful cross-modal activations without any parameter updates. We establish MM-TOXIC-QA, a multimodal toxicity evaluation framework, and compare SGM with existing detoxification techniques. Experiments on open-source MLLMs show that SGM mitigates toxicity in standard and adversarial conditions, cutting harmful rates from 48.2\% to 2.5\% while preserving fluency and multimodal reasoning. SGM is extensible, and its combined defenses, denoted as SGM*, integrate with existing detoxification methods for stronger safety performance, providing an interpretable, low-cost solution for toxicity-controlled multimodal generation.
• 摘要：免责声明：本文中的示例可能有害并引起不适。多模态大语言模型 (MLLM) 能够实现多模态生成，但会继承来自弱管理的预训练语料库的有毒、有偏见和 NSFW 信号，从而导致安全风险，特别是在后期、不透明的免训练解毒方法难以处理的对抗性触发下。我们提出了 SGM，一种白盒神经元级多模式干预，其作用就像有毒神经元的安全眼镜：它通过专业知识加权软抑制选择性地重新校准一小组有毒专家神经元，在没有任何参数更新的情况下中和有害的跨模式激活。我们建立了多模式毒性评估框架 MM-TOXIC-QA，并将 SGM 与现有的解毒技术进行比较。开源 MLLM 的实验表明，SGM 减轻了标准和对抗条件下的毒性，将有害率从 48.2% 降低到 2.5%，同时保持流畅性和多模态推理。 SGM 是可扩展的，其组合防御（表示为 SGM*）与现有的解毒方法集成，以实现更强的安全性能，为毒性控制的多模式生成提供可解释的、低成本的解决方案。

Title: The Meta-Prompting Protocol: Orchestrating LLMs via Adversarial Feedback Loops

• Authors: Fanzhe Fu
• Subjects: cs.CL, cs.AI, cs.LG, cs.SE
• Abstract URL: https://arxiv.org/abs/2512.15053
• Pdf URL: https://arxiv.org/pdf/2512.15053
• Copy Paste: [[2512.15053]] The Meta-Prompting Protocol: Orchestrating LLMs via Adversarial Feedback Loops(https://arxiv.org/abs/2512.15053)
• Keywords: language model, llm, hallucination, prompt, chat
• Abstract: The transition of Large Language Models (LLMs) from stochastic chat interfaces to reliable software components necessitates a fundamental re-engineering of interaction paradigms. Current methodologies, predominantly heuristic-based "prompt engineering," fail to provide the deterministic guarantees required for mission-critical applications. We introduce the Meta-Prompting Protocol, a rigorous theoretical framework that formalizes the orchestration of LLMs as a programmable, self-optimizing system. Central to this protocol is the Adversarial Trinity, a tripartite topology comprising a Generator (P), an Auditor (A), and an Optimizer (O). By treating natural language instructions as differentiable variables within a semantic computation graph and utilizing textual critiques as gradients, this architecture mitigates hallucination and prevents model collapse. We demonstrate the theoretical viability of this approach using declarative programming paradigms (DSPy) and automatic textual differentiation (TextGrad), establishing a foundation for "Observable Software Engineering" in the era of probabilistic computing.
• 摘要：大型语言模型 (LLM) 从随机聊天界面到可靠的软件组件的转变需要对交互范例进行根本性的重新设计。当前的方法，主要是基于启发式的“即时工程”，无法提供关键任务应用程序所需的确定性保证。我们引入了元提示协议，这是一个严格的理论框架，它将法学硕士的编排形式化为一个可编程的、自我优化的系统。该协议的核心是对抗三位一体，即由生成器 (P)、审核器 (A) 和优化器 (O) 组成的三方拓扑。通过将自然语言指令视为语义计算图中的可微变量，并将文本批评用作梯度，该架构减轻了幻觉并防止模型崩溃。我们使用声明性编程范式（DSPy）和自动文本微分（TextGrad）证明了这种方法的理论可行性，为概率计算时代的“可观察软件工程”奠定了基础。

Title: Beyond Majority Voting: Towards Fine-grained and More Reliable Reward Signal for Test-Time Reinforcement Learning

• Authors: Weiqin Wang, Yile Wang, Kehao Chen, Hui Huang
• Subjects: cs.CL
• Abstract URL: https://arxiv.org/abs/2512.15146
• Pdf URL: https://arxiv.org/pdf/2512.15146
• Copy Paste: [[2512.15146]] Beyond Majority Voting: Towards Fine-grained and More Reliable Reward Signal for Test-Time Reinforcement Learning(https://arxiv.org/abs/2512.15146)
• Keywords: language model, llm
• Abstract: Test-time reinforcement learning mitigates the reliance on annotated data by using majority voting results as pseudo-labels, emerging as a complementary direction to reinforcement learning with verifiable rewards (RLVR) for improving reasoning ability of large language models (LLMs). However, this voting strategy often induces confirmation bias and suffers from sparse rewards, limiting the overall performance. In this work, we propose subgroup-specific step-wise confidence-weighted pseudo-label estimation (SCOPE), a framework integrating model confidence and dynamic subgroup partitioning to address these issues. Specifically, SCOPE integrates the proposed step-wise confidence into pseudo label deduction, prioritizing high-quality reasoning paths over simple frequency count. Furthermore, it dynamically partitions the candidate outputs pool into independent subgroups by balancing reasoning quality against exploration diversity. By deriving local consensus via repeat sampling for each sub group, SCOPE provides diverse supervision targets to encourage broader exploration. We conduct experiments across various models and benchmarks, experimental results show that SCOPE consistently outperforms recent baselines. Notably, SCOPE achieving relative improvements of 13.1\% on challenging AIME 2025 and 8.1\% on AMC. The code is released at \href{this https URL}{this https URL}.
• 摘要：测试时强化学习通过使用多数投票结果作为伪标签来减轻对注释数据的依赖，成为可验证奖励强化学习（RLVR）的补充方向，用于提高大型语言模型（LLM）的推理能力。然而，这种投票策略经常会引起确认偏差，并且奖励稀疏，从而限制了整体性能。在这项工作中，我们提出了子组特定的逐步置信加权伪标签估计（SCOPE），这是一个集成模型置信度和动态子组划分的框架来解决这些问题。具体来说，SCOPE 将所提出的逐步置信度集成到伪标签推导中，优先考虑高质量的推理路径而不是简单的频率计数。此外，它通过平衡推理质量和探索多样性，将候选输出池动态划分为独立的子组。通过对每个子组进行重复抽样来得出局部共识，SCOPE 提供了多样化的监督目标，以鼓励更广泛的探索。我们对各种模型和基准进行了实验，实验结果表明 SCOPE 始终优于最近的基线。值得注意的是，SCOPE 在具有挑战性的 AIME 2025 上实现了 13.1% 的相对改进，在 AMC 上实现了 8.1% 的相对改进。代码发布于\href{此 https URL}{此 https URL}。

Title: MCP-SafetyBench: A Benchmark for Safety Evaluation of Large Language Models with Real-World MCP Servers

• Authors: Xuanjun Zong, Zhiqi Shen, Lei Wang, Yunshi Lan, Chao Yang
• Subjects: cs.CL, cs.AI
• Abstract URL: https://arxiv.org/abs/2512.15163
• Pdf URL: https://arxiv.org/pdf/2512.15163
• Copy Paste: [[2512.15163]] MCP-SafetyBench: A Benchmark for Safety Evaluation of Large Language Models with Real-World MCP Servers(https://arxiv.org/abs/2512.15163)
• Keywords: language model, llm, agent
• Abstract: Large language models (LLMs) are evolving into agentic systems that reason, plan, and operate external tools. The Model Context Protocol (MCP) is a key enabler of this transition, offering a standardized interface for connecting LLMs with heterogeneous tools and services. Yet MCP's openness and multi-server workflows introduce new safety risks that existing benchmarks fail to capture, as they focus on isolated attacks or lack real-world coverage. We present MCP-SafetyBench, a comprehensive benchmark built on real MCP servers that supports realistic multi-turn evaluation across five domains: browser automation, financial analysis, location navigation, repository management, and web search. It incorporates a unified taxonomy of 20 MCP attack types spanning server, host, and user sides, and includes tasks requiring multi-step reasoning and cross-server coordination under uncertainty. Using MCP-SafetyBench, we systematically evaluate leading open- and closed-source LLMs, revealing large disparities in safety performance and escalating vulnerabilities as task horizons and server interactions grow. Our results highlight the urgent need for stronger defenses and establish MCP-SafetyBench as a foundation for diagnosing and mitigating safety risks in real-world MCP deployments.
• 摘要：大型语言模型 (LLM) 正在演变成推理、规划和操作外部工具的代理系统。模型上下文协议 (MCP) 是这一转变的关键推动者，它提供了一个标准化接口，用于将法学硕士与异构工具和服务连接起来。然而，MCP 的开放性和多服务器工作流程引入了现有基准无法捕获的新安全风险，因为它们专注于孤立的攻击或缺乏现实世界的覆盖。我们推出了 MCP-SafetyBench，这是一个基于真实 MCP 服务器构建的综合基准测试，支持跨五个领域的实际多轮评估：浏览器自动化、财务分析、位置导航、存储库管理和网络搜索。它整合了跨越服务器、主机和用户端的 20 种 MCP 攻击类型的统一分类法，并包括需要在不确定性下进行多步推理和跨服务器协调的任务。使用 MCP-SafetyBench，我们系统地评估了领先的开源和闭源法学硕士，揭示了安全性能的巨大差异，以及随着任务范围和服务器交互的增长而不断升级的漏洞。我们的结果强调迫切需要更强大的防御，并将 MCP-SafetyBench 建立为诊断和减轻实际 MCP 部署中的安全风险的基础。

Title: From NLG Evaluation to Modern Student Assessment in the Era of ChatGPT: The Great Misalignment Problem and Pedagogical Multi-Factor Assessment (P-MFA)

• Authors: Mika Hämäläinen, Kimmo Leiviskä
• Subjects: cs.CL
• Abstract URL: https://arxiv.org/abs/2512.15183
• Pdf URL: https://arxiv.org/pdf/2512.15183
• Copy Paste: [[2512.15183]] From NLG Evaluation to Modern Student Assessment in the Era of ChatGPT: The Great Misalignment Problem and Pedagogical Multi-Factor Assessment (P-MFA)(https://arxiv.org/abs/2512.15183)
• Keywords: gpt, chat
• Abstract: This paper explores the growing epistemic parallel between NLG evaluation and grading of students in a Finnish University. We argue that both domains are experiencing a Great Misalignment Problem. As students increasingly use tools like ChatGPT to produce sophisticated outputs, traditional assessment methods that focus on final products rather than learning processes have lost their validity. To address this, we introduce the Pedagogical Multi-Factor Assessment (P-MFA) model, a process-based, multi-evidence framework inspired by the logic of multi-factor authentication.
• 摘要：本文探讨了芬兰大学 NLG 评估和学生评分之间日益增长的认知相似性。我们认为这两个领域都正在经历严重的错位问题。随着学生越来越多地使用 ChatGPT 等工具来产生复杂的输出，注重最终产品而不是学习过程的传统评估方法已经失去了有效性。为了解决这个问题，我们引入了教学多因素评估（P-MFA）模型，这是一种基于流程的多证据框架，其灵感来自多因素认证的逻辑。

Title: RFKG-CoT: Relation-Driven Adaptive Hop-count Selection and Few-Shot Path Guidance for Knowledge-Aware QA

• Authors: Chao Zhang, Minghan Li, Tianrui Lv, Guodong Zhou
• Subjects: cs.CL, cs.AI
• Abstract URL: https://arxiv.org/abs/2512.15219
• Pdf URL: https://arxiv.org/pdf/2512.15219
• Copy Paste: [[2512.15219]] RFKG-CoT: Relation-Driven Adaptive Hop-count Selection and Few-Shot Path Guidance for Knowledge-Aware QA(https://arxiv.org/abs/2512.15219)
• Keywords: language model, llm, hallucination, prompt
• Abstract: Large language models (LLMs) often generate hallucinations in knowledge-intensive QA due to parametric knowledge limitations. While existing methods like KG-CoT improve reliability by integrating knowledge graph (KG) paths, they suffer from rigid hop-count selection (solely question-driven) and underutilization of reasoning paths (lack of guidance). To address this, we propose RFKG-CoT: First, it replaces the rigid hop-count selector with a relation-driven adaptive hop-count selector that dynamically adjusts reasoning steps by activating KG relations (e.g., 1-hop for direct "brother" relations, 2-hop for indirect "father-son" chains), formalized via a relation mask. Second, it introduces a few-shot in-context learning path guidance mechanism with CoT (think) that constructs examples in a "question-paths-answer" format to enhance LLMs' ability to understand reasoning paths. Experiments on four KGQA benchmarks show RFKG-CoT improves accuracy by up to 14.7 pp (Llama2-7B on WebQSP) over KG-CoT. Ablations confirm the hop-count selector and the path prompt are complementary, jointly transforming KG evidence into more faithful answers.
• 摘要：由于参数化知识的限制，大型语言模型（LLM）经常在知识密集型 QA 中产生幻觉。虽然 KG-CoT 等现有方法通过集成知识图 (KG) 路径来提高可靠性，但它们存在严格的跳数选择（完全由问题驱动）和推理路径利用不足（缺乏指导）的问题。为了解决这个问题，我们提出了 RFKG-CoT：首先，它将严格的跳数选择器替换为关系驱动的自适应跳数选择器，该选择器通过激活 KG 关系（例如，直接“兄弟”关系的 1 跳，间接“父子”链的 2 跳）动态调整推理步骤，通过关系掩码形式化。其次，它引入了CoT（思考）的少量上下文学习路径引导机制，以“问题-路径-答案”的格式构建示例，以增强法学硕士理解推理路径的能力。对四个 KGQA 基准测试的实验表明，RFKG-CoT 的准确度比 KG-CoT 提高了 14.7 pp（WebQSP 上的 Llama2-7B）。消融确认跳数选择器和路径提示是互补的，共同将知识图谱证据转化为更忠实的答案。

Title: Yes-MT's Submission to the Low-Resource Indic Language Translation Shared Task in WMT 2024

• Authors: Yash Bhaskar, Parameswari Krishnamurthy
• Subjects: cs.CL, cs.AI
• Abstract URL: https://arxiv.org/abs/2512.15226
• Pdf URL: https://arxiv.org/pdf/2512.15226
• Copy Paste: [[2512.15226]] Yes-MT's Submission to the Low-Resource Indic Language Translation Shared Task in WMT 2024(https://arxiv.org/abs/2512.15226)
• Keywords: language model, llm, prompt
• Abstract: This paper presents the systems submitted by the Yes-MT team for the Low-Resource Indic Language Translation Shared Task at WMT 2024 (Pakray et al., 2024), focusing on translating between English and the Assamese, Mizo, Khasi, and Manipuri languages. The experiments explored various approaches, including fine-tuning pre-trained models like mT5 (Xue et al., 2020) and IndicBart (Dabre et al., 2021) in both multilingual and monolingual settings, LoRA (Hu et al., 2021) fine-tuning IndicTrans2 (Gala et al., 2023), zero-shot and few-shot prompting (Brown, 2020) with large language models (LLMs) like Llama 3 (Dubey et al., 2024) and Mixtral 8x7b (Jiang et al., 2024), LoRA supervised fine-tuning of Llama 3 (Mecklenburg et al., 2024), and training Transformer models (Vaswani, 2017) from scratch. The results were evaluated on the WMT23 Low-Resource Indic Language Translation Shared Task test data using SacreBLEU (Post, 2018) and CHRF (Popovic, 2015), highlighting the challenges of low-resource translation and the potential of LLMs for these tasks, particularly with fine-tuning.
• 摘要：本文介绍了 Yes-MT 团队为 WMT 2024 低资源印度语翻译共享任务（Pakray 等人，2024）提交的系统，重点关注英语与阿萨姆语、米佐语、卡西语和曼尼普尔语之间的翻译。实验探索了各种方法，包括在多语言和单语言环境中微调 mT5（Xue 等人，2020）和 IndicBart（Dabre 等人，2021）等预训练模型，LoRA（Hu 等人，2021）微调 IndicTrans2（Gala 等人，2023），零样本和少样本提示（Brown，2020） Llama 3 (Dubey et al., 2024) 和 Mixtral 8x7b (Jiang et al., 2024) 等语言模型 (LLM)、LoRA 监督 Llama 3 (Mecklenburg et al., 2024) 的微调，以及从头开始训练 Transformer 模型 (Vaswani, 2017)。使用 SacreBLEU（Post，2018）和 CHRF（Popovic，2015）在 WMT23 低资源印度语翻译共享任务测试数据上对结果进行了评估，强调了低资源翻译的挑战以及法学硕士在这些任务上的潜力，特别是在微调方面。

Title: FAME: Fictional Actors for Multilingual Erasure

• Authors: Claudio Savelli, Moreno La Quatra, Alkis Koudounas, Flavio Giobergia
• Subjects: cs.CL
• Abstract URL: https://arxiv.org/abs/2512.15235
• Pdf URL: https://arxiv.org/pdf/2512.15235
• Copy Paste: [[2512.15235]] FAME: Fictional Actors for Multilingual Erasure(https://arxiv.org/abs/2512.15235)
• Keywords: llm
• Abstract: LLMs trained on web-scale data raise concerns about privacy and the right to be forgotten. To address these issues, Machine Unlearning provides techniques to remove specific information from trained models without retraining from scratch. However, existing benchmarks for evaluating unlearning in LLMs face two major limitations: they focus only on English and support only entity-level forgetting (removing all information about a person). We introduce FAME (Fictional Actors for Multilingual Erasure), a synthetic benchmark for evaluating Machine Unlearning across five languages: English, French, German, Italian, and Spanish. FAME contains 1,000 fictional actor biographies and 20,000 question-answer pairs. Each biography includes information on 20 topics organized into structured categories (biography, career, achievements, personal information). This design enables both entity-level unlearning (i.e., forgetting entire identities) and instance-level unlearning (i.e., forgetting specific facts while retaining others). We provide two dataset splits to support these two different unlearning scenarios and enable systematic comparison of unlearning techniques across languages. Since FAME uses entirely fictional data, it ensures that the information was never encountered during model pretraining, allowing for a controlled evaluation of unlearning methods.
• 摘要：受过网络规模数据培训的法学硕士引起了人们对隐私和被遗忘权的担忧。为了解决这些问题，机器取消学习提供了从训练模型中删除特定信息的技术，而无需从头开始重新训练。然而，评估法学硕士遗忘的现有基准面临两个主要局限性：它们仅关注英语并且仅支持实体级遗忘（删除有关一个人的所有信息）。我们引入了 FAME（多语言擦除虚构演员），这是一个用于评估跨五种语言的机器遗忘的综合基准：英语、法语、德语、意大利语和西班牙语。 FAME 包含 1,000 个虚构的演员传记和 20,000 个问答对。每本传记都包含 20 个主题的信息，这些主题被组织成结构化类别（传记、职业、成就、个人信息）。这种设计可以实现实体级遗忘（即忘记整个身份）和实例级遗忘（即忘记特定事实而保留其他事实）。我们提供两个数据集分割来支持这两种不同的遗忘场景，并能够系统地比较跨语言的遗忘技术。由于 FAME 使用完全虚构的数据，因此它确保在模型预训练期间从未遇到过该信息，从而可以对取消学习方法进行受控评估。

Title: The Moralization Corpus: Frame-Based Annotation and Analysis of Moralizing Speech Acts across Diverse Text Genres

• Authors: Maria Becker, Mirko Sommer, Lars Tapken, Yi Wan Teh, Bruno Brocai
• Subjects: cs.CL
• Abstract URL: https://arxiv.org/abs/2512.15248
• Pdf URL: https://arxiv.org/pdf/2512.15248
• Copy Paste: [[2512.15248]] The Moralization Corpus: Frame-Based Annotation and Analysis of Moralizing Speech Acts across Diverse Text Genres(https://arxiv.org/abs/2512.15248)
• Keywords: language model, llm, prompt
• Abstract: Moralizations - arguments that invoke moral values to justify demands or positions - are a yet underexplored form of persuasive communication. We present the Moralization Corpus, a novel multi-genre dataset designed to analyze how moral values are strategically used in argumentative discourse. Moralizations are pragmatically complex and often implicit, posing significant challenges for both human annotators and NLP systems. We develop a frame-based annotation scheme that captures the constitutive elements of moralizations - moral values, demands, and discourse protagonists - and apply it to a diverse set of German texts, including political debates, news articles, and online discussions. The corpus enables fine-grained analysis of moralizing language across communicative formats and domains. We further evaluate several large language models (LLMs) under varied prompting conditions for the task of moralization detection and moralization component extraction and compare it to human annotations in order to investigate the challenges of automatic and manual analysis of moralizations. Results show that detailed prompt instructions has a greater effect than few-shot or explanation-based prompting, and that moralization remains a highly subjective and context-sensitive task. We release all data, annotation guidelines, and code to foster future interdisciplinary research on moral discourse and moral reasoning in NLP.
• 摘要：道德化——援引道德价值观来证明要求或立场合理的论点——是一种尚未得到充分探索的说服性沟通形式。我们提出了道德化语料库，这是一个新颖的多流派数据集，旨在分析如何在辩论话语中战略性地使用道德价值观。道德化在实用上是复杂的，而且通常是隐含的，这给人类注释者和 NLP 系统带来了重大挑战。我们开发了一种基于框架的注释方案，捕捉道德化的构成要素——道德价值观、要求和话语主角——并将其应用于各种德语文本，包括政治辩论、新闻文章和在线讨论。该语料库可以对跨交流格式和领域的道德语言进行细粒度分析。我们进一步评估了几种大型语言模型（LLM）在不同提示条件下的道德化检测和道德化成分提取任务，并将其与人类注释进行比较，以研究自动和手动分析道德化的挑战。结果表明，详细的提示指令比几次或基于解释的提示具有更大的效果，并且道德化仍然是一项高度主观和情境敏感的任务。我们发布所有数据、注释指南和代码，以促进未来 NLP 中道德话语和道德推理的跨学科研究。

Title: Well Begun, Half Done: Reinforcement Learning with Prefix Optimization for LLM Reasoning

• Authors: Yiliu Sun, Zicheng Zhao, Yang Wei, Yanfang Zhang, Chen Gong
• Subjects: cs.CL, cs.AI
• Abstract URL: https://arxiv.org/abs/2512.15274
• Pdf URL: https://arxiv.org/pdf/2512.15274
• Copy Paste: [[2512.15274]] Well Begun, Half Done: Reinforcement Learning with Prefix Optimization for LLM Reasoning(https://arxiv.org/abs/2512.15274)
• Keywords: language model, llm
• Abstract: Reinforcement Learning with Verifiable Rewards (RLVR) significantly enhances the reasoning capability of Large Language Models (LLMs). Current RLVR approaches typically conduct training across all generated tokens, but neglect to explore which tokens (e.g., prefix tokens) actually contribute to reasoning. This uniform training strategy spends substantial effort on optimizing low-return tokens, which in turn impedes the potential improvement from high-return tokens and reduces overall training effectiveness. To address this issue, we propose a novel RLVR approach called Progressive Prefix-token Policy Optimization (PPPO), which highlights the significance of the prefix segment of generated outputs. Specifically, inspired by the well-established human thinking theory of Path Dependence, where early-stage thoughts substantially constrain subsequent thinking trajectory, we identify an analogous phenomenon in LLM reasoning termed Beginning Lock-in Effect (BLE). PPPO leverages this finding by focusing its optimization objective on the prefix reasoning process of LLMs. This targeted optimization strategy can positively influence subsequent reasoning processes, and ultimately improve final results. To improve the learning effectiveness of LLMs on how to start reasoning with high quality, PPPO introduces two training strategies: (a) Progressive Prefix Retention, which shapes a progressive learning process by increasing the proportion of retained prefix tokens during training; (b) Continuation Accumulated Reward, which mitigates reward bias by sampling multiple continuations for one prefix token sequence, and accumulating their scores as the reward signal. Extensive experimental results on various reasoning tasks demonstrate that our proposed PPPO outperforms representative RLVR methods, with the accuracy improvements of 18.02% on only 26.17% training tokens.
• 摘要：具有可验证奖励的强化学习（RLVR）显着增强了大型语言模型（LLM）的推理能力。当前的 RLVR 方法通常对所有生成的标记进行训练，但忽略探索哪些标记（例如前缀标记）实际上有助于推理。这种统一的训练策略花费了大量精力来优化低回报令牌，这反过来又阻碍了高回报令牌的潜在改进，并降低了整体训练效果。为了解决这个问题，我们提出了一种称为渐进式前缀令牌策略优化（PPPO）的新型 RLVR 方法，它强调了生成输出的前缀段的重要性。具体来说，受到完善的人类思维路径依赖理论的启发，其中早期思维在很大程度上限制了后续思维轨迹，我们在法学硕士推理中发现了一种类似的现象，称为开始锁定效应（BLE）。 PPPO 通过将其优化目标集中在法学硕士的前缀推理过程上来利用这一发现。这种有针对性的优化策略可以积极影响后续的推理过程，并最终改善最终结果。为了提高法学硕士如何开始高质量推理的学习效果，PPPO 引入了两种训练策略： (a) 渐进式前缀保留，通过增加训练期间保留的前缀标记的比例来形成渐进式学习过程； (b) 连续累积奖励，它通过对一个前缀标记序列的多个连续进行采样，并累积它们的分数作为奖励信号来减轻奖励偏差。各种推理任务的大量实验结果表明，我们提出的 PPPO 优于代表性的 RLVR 方法，仅在 26.17% 的训练标记上准确率提高了 18.02%。

Title: Towards Proactive Personalization through Profile Customization for Individual Users in Dialogues

• Authors: Xiaotian Zhang, Yuan Wang, Ruizhe Chen, Zeya Wang, Runchen Hou, Zuozhu Liu
• Subjects: cs.CL
• Abstract URL: https://arxiv.org/abs/2512.15302
• Pdf URL: https://arxiv.org/pdf/2512.15302
• Copy Paste: [[2512.15302]] Towards Proactive Personalization through Profile Customization for Individual Users in Dialogues(https://arxiv.org/abs/2512.15302)
• Keywords: language model, llm, prompt, agent
• Abstract: The deployment of Large Language Models (LLMs) in interactive systems necessitates a deep alignment with the nuanced and dynamic preferences of individual users. Current alignment techniques predominantly address universal human values or static, single-turn preferences, thereby failing to address the critical needs of long-term personalization and the initial user cold-start problem. To bridge this gap, we propose PersonalAgent, a novel user-centric lifelong agent designed to continuously infer and adapt to user preferences. PersonalAgent constructs and dynamically refines a unified user profile by decomposing dialogues into single-turn interactions, framing preference inference as a sequential decision-making task. Experiments show that PersonalAgent achieves superior performance over strong prompt-based and policy optimization baselines, not only in idealized but also in noisy conversational contexts, while preserving cross-session preference consistency. Furthermore, human evaluation confirms that PersonalAgent excels at capturing user preferences naturally and coherently. Our findings underscore the importance of lifelong personalization for developing more inclusive and adaptive conversational agents. Our code is available here.
• 摘要：在交互式系统中部署大型语言模型 (LLM) 需要与个人用户的细微差别和动态偏好进行深度调整。当前的对齐技术主要解决普遍的人类价值观或静态的单轮偏好，从而无法解决长期个性化和初始用户冷启动问题的关键需求。为了弥补这一差距，我们提出了 PersonalAgent，这是一种新颖的以用户为中心的终身代理，旨在不断推断和适应用户偏好。 PersonalAgent 通过将对话分解为单轮交互，将偏好推断构建为顺序决策任务，构建并动态完善统一的用户配置文件。实验表明，PersonalAgent 不仅在理想化的环境中，而且在嘈杂的对话环境中，都比强大的基于提示和策略优化基线实现了卓越的性能，同时保持了跨会话偏好的一致性。此外，人工评估证实 PersonalAgent 擅长自然、连贯地捕捉用户偏好。我们的研究结果强调了终身个性化对于开发更具包容性和适应性的对话代理的重要性。我们的代码可以在这里找到。

Title: Evaluating LLMs for Zeolite Synthesis Event Extraction (ZSEE): A Systematic Analysis of Prompting Strategies

• Authors: Charan Prakash Rathore, Saumi Ray, Dhruv Kumar
• Subjects: cs.CL, cs.AI
• Abstract URL: https://arxiv.org/abs/2512.15312
• Pdf URL: https://arxiv.org/pdf/2512.15312
• Copy Paste: [[2512.15312]] Evaluating LLMs for Zeolite Synthesis Event Extraction (ZSEE): A Systematic Analysis of Prompting Strategies(https://arxiv.org/abs/2512.15312)
• Keywords: language model, gpt, llm, hallucination, prompt
• Abstract: Extracting structured information from zeolite synthesis experimental procedures is critical for materials discovery, yet existing methods have not systematically evaluated Large Language Models (LLMs) for this domain-specific task. This work addresses a fundamental question: what is the efficacy of different prompting strategies when applying LLMs to scientific information extraction? We focus on four key subtasks: event type classification (identifying synthesis steps), trigger text identification (locating event mentions), argument role extraction (recognizing parameter types), and argument text extraction (extracting parameter values). We evaluate four prompting strategies - zero-shot, few-shot, event-specific, and reflection-based - across six state-of-the-art LLMs (Gemma-3-12b-it, GPT-5-mini, O4-mini, Claude-Haiku-3.5, DeepSeek reasoning and non-reasoning) using the ZSEE dataset of 1,530 annotated sentences. Results demonstrate strong performance on event type classification (80-90\% F1) but modest performance on fine-grained extraction tasks, particularly argument role and argument text extraction (50-65\% F1). GPT-5-mini exhibits extreme prompt sensitivity with 11-79\% F1 variation. Notably, advanced prompting strategies provide minimal improvements over zero-shot approaches, revealing fundamental architectural limitations. Error analysis identifies systematic hallucination, over-generalization, and inability to capture synthesis-specific nuances. Our findings demonstrate that while LLMs achieve high-level understanding, precise extraction of experimental parameters requires domain-adapted models, providing quantitative benchmarks for scientific information extraction.
• 摘要：从沸石合成实验程序中提取结构化信息对于材料发现至关重要，但现有方法尚未针对该特定领域的任务系统地评估大型语言模型（LLM）。这项工作解决了一个基本问题：将法学硕士应用于科学信息提取时，不同的提示策略的功效是什么？我们专注于四个关键子任务：事件类型分类（识别合成步骤）、触发文本识别（定位事件提及）、参数角色提取（识别参数类型）和参数文本提取（提取参数值）。我们使用包含 1,530 个注释句子的 ZSEE 数据集，评估了六种最先进的法学硕士（Gemma-3-12b-it、GPT-5-mini、O4-mini、Claude-Haiku-3.5、DeepSeek 推理和非推理）的四种提示策略——零样本、少样本、特定事件和基于反射。结果表明，在事件类型分类 (80-90\% F1) 上表现出色，但在细粒度提取任务上表现一般，尤其是论点角色和论点文本提取 (50-65\% F1)。 GPT-5-mini 表现出极高的即时灵敏度，F1 变化为 11-79\%。值得注意的是，高级提示策略相对于零样本方法提供了最小的改进，揭示了基本的架构限制。错误分析可以识别系统性幻觉、过度概括以及无法捕获合成特定的细微差别。我们的研究结果表明，虽然法学硕士实现了高层次的理解，但实验参数的精确提取需要适应领域的模型，为科学信息提取提供定量基准。

Title: Adversarial versification in portuguese as a jailbreak operator in LLMs

• Authors: Joao Queiroz
• Subjects: cs.CL, cs.AI
• Abstract URL: https://arxiv.org/abs/2512.15353
• Pdf URL: https://arxiv.org/pdf/2512.15353
• Copy Paste: [[2512.15353]] Adversarial versification in portuguese as a jailbreak operator in LLMs(https://arxiv.org/abs/2512.15353)
• Keywords: language model, llm, prompt
• Abstract: Recent evidence shows that the versification of prompts constitutes a highly effective adversarial mechanism against aligned LLMs. The study 'Adversarial poetry as a universal single-turn jailbreak mechanism in large language models' demonstrates that instructions routinely refused in prose become executable when rewritten as verse, producing up to 18 x more safety failures in benchmarks derived from MLCommons AILuminate. Manually written poems reach approximately 62% ASR, and automated versions 43%, with some models surpassing 90% success in single-turn interactions. The effect is structural: systems trained with RLHF, constitutional AI, and hybrid pipelines exhibit consistent degradation under minimal semiotic formal variation. Versification displaces the prompt into sparsely supervised latent regions, revealing guardrails that are excessively dependent on surface patterns. This dissociation between apparent robustness and real vulnerability exposes deep limitations in current alignment regimes. The absence of evaluations in Portuguese, a language with high morphosyntactic complexity, a rich metric-prosodic tradition, and over 250 million speakers, constitutes a critical gap. Experimental protocols must parameterise scansion, metre, and prosodic variation to test vulnerabilities specific to Lusophone patterns, which are currently ignored.
• 摘要：最近的证据表明，提示的验证构成了针对一致的法学硕士的高效对抗机制。 “对抗性诗歌作为大型语言模型中通用的单轮越狱机制”的研究表明，在散文中通常被拒绝的指令在重写为诗歌时变得可执行，在源自 MLCommons AILuminate 的基准中产生高达 18 倍的安全失败。手动编写的诗歌 ASR 达到约 62%，自动化版本达到 43%，某些模型在单轮交互中成功率超过 90%。其效果是结构性的：使用 RLHF、宪法人工智能和混合管道训练的系统在最小的符号形式变化下表现出一致的退化。验证将提示转移到稀疏监督的潜在区域，揭示了过度依赖表面模式的护栏。表面上的稳健性与实际脆弱性之间的这种分离暴露了当前对齐机制的深层局限性。葡萄牙语是一种形态句法复杂性高、韵律丰富的传统、拥有超过 2.5 亿使用者的语言，但缺乏对葡萄牙语的评估，构成了一个关键的差距。实验协议必须参数化扫描、韵律和韵律变化，以测试特定于葡语模式的漏洞，而这些漏洞目前被忽略。

Title: Dual-Density Inference for Efficient Language Model Reasoning

• Authors: Zhengyi Zhao, Shubo Zhang, Yuxi Zhang, Huimin Wang, Binyang Li, Kam-Fai Wong
• Subjects: cs.CL
• Abstract URL: https://arxiv.org/abs/2512.15358
• Pdf URL: https://arxiv.org/pdf/2512.15358
• Copy Paste: [[2512.15358]] Dual-Density Inference for Efficient Language Model Reasoning(https://arxiv.org/abs/2512.15358)
• Keywords: language model, llm, chain-of-thought
• Abstract: Large Language Models (LLMs) have shown impressive capabilities in complex reasoning tasks. However, current approaches employ uniform language density for both intermediate reasoning and final answers, leading to computational inefficiency. Our observation found that reasoning process serves a computational function for the model itself, while answering serves a communicative function for human understanding. This distinction enables the use of compressed, symbol-rich language for intermediate computations while maintaining human-readable final explanations. To address this inefficiency, we present Denser: \underline{D}ual-d\underline{ens}ity inf\underline{er}ence, a novel framework that optimizes information density separately for reasoning and answering phases. Our framework implements this through three components: a query processing module that analyzes input problems, a high-density compressed reasoning mechanism for efficient intermediate computations, and an answer generation component that translates compressed reasoning into human-readable solutions. Experimental evaluation across multiple reasoning question answering benchmarks demonstrates that Denser reduces token consumption by up to 62\% compared to standard Chain-of-Thought methods while preserving or improving accuracy. These efficiency gains are particularly significant for complex multi-step reasoning problems where traditional methods generate extensive explanations.
• 摘要：大型语言模型 (LLM) 在复杂的推理任务中表现出了令人印象深刻的能力。然而，当前的方法对于中间推理和最终答案都采用统一的语言密度，导致计算效率低下。我们的观察发现，推理过程为模型本身提供计算功能，而回答则为人类理解提供交流功能。这种区别使得能够使用压缩的、符号丰富的语言进行中间计算，同时保持人类可读的最终解释。为了解决这种低效率问题，我们提出了 Denser：\underline{D}ual-d\underline{ens}ity inf\underline{er}ence，这是一种新颖的框架，可以分别优化推理和回答阶段的信息密度。我们的框架通过三个组件来实现这一点：分析输入问题的查询处理模块、用于高效中间计算的高密度压缩推理机制以及将压缩推理转换为人类可读解决方案的答案生成组件。跨多个推理问答基准的实验评估表明，与标准思想链方法相比，Denser 减少了高达 62% 的令牌消耗，同时保持或提高了准确性。这些效率提升对于传统方法产生广泛解释的复杂多步骤推理问题尤其重要。

Title: ORACLE: Time-Dependent Recursive Summary Graphs for Foresight on News Data Using LLMs

• Authors: Lev Kharlashkin, Eiaki Morooka, Yehor Tereshchenko, Mika Hämäläinen
• Subjects: cs.CL
• Abstract URL: https://arxiv.org/abs/2512.15397
• Pdf URL: https://arxiv.org/pdf/2512.15397
• Copy Paste: [[2512.15397]] ORACLE: Time-Dependent Recursive Summary Graphs for Foresight on News Data Using LLMs(https://arxiv.org/abs/2512.15397)
• Keywords: llm
• Abstract: ORACLE turns daily news into week-over-week, decision-ready insights for one of the Finnish University of Applied Sciences. The platform crawls and versions news, applies University-specific relevance filtering, embeds content, classifies items into PESTEL dimensions and builds a concise Time-Dependent Recursive Summary Graph (TRSG): two clustering layers summarized by an LLM and recomputed weekly. A lightweight change detector highlights what is new, removed or changed, then groups differences into themes for PESTEL-aware analysis. We detail the pipeline, discuss concrete design choices that make the system stable in production and present a curriculum-intelligence use case with an evaluation plan.
• 摘要：ORACLE 将每日新闻转化为芬兰应用科学大学每周的决策洞察。该平台抓取和版本新闻，应用大学特定的相关性过滤，嵌入内容，将项目分类为 PESTEL 维度，并构建简洁的时间相关递归摘要图（TRSG）：由法学硕士总结并每周重新计算的两个聚类层。轻量级变更检测器会突出显示新增内容、删除内容或更改内容，然后将差异分组到主题中以进行 PESTEL 感知分析。我们详细介绍了流程，讨论了使系统在生产中稳定的具体设计选择，并提出了带有评估计划的课程智能用例。

Title: Toward expert-level motivational interviewing for health behavior improvement with LLMs

• Authors: Run-ze Hu, Yang Yang, Yi-hang Yang, Jing-qi Kong, Jia-hui Luo, Wen-yu Yang, Jing Chen, Jing-yao Liu, Hui-qun Zeng, Lei Zhang, Zheng Liu
• Subjects: cs.CL
• Abstract URL: https://arxiv.org/abs/2512.15446
• Pdf URL: https://arxiv.org/pdf/2512.15446
• Copy Paste: [[2512.15446]] Toward expert-level motivational interviewing for health behavior improvement with LLMs(https://arxiv.org/abs/2512.15446)
• Keywords: language model, gpt, llm, prompt, chat
• Abstract: Background: Motivational interviewing (MI) is an effective counseling approach for promoting health behavior change, but its impact is constrained by the need for highly trained human counselors. Objective: This study aimed to explore a scalable alternative by developing and evaluating Large Language Models for Motivational Interviewing (MI-LLMs). Methods: We first curated five Chinese psychological counseling corpora and, using GPT-4 with an MI-informed prompt, transcribed multi-turn dialogues from the two highest-quality datasets (CPsyCounD and PsyDTCorpus) into 2,040 MI-style counseling conversations, of which 2,000 were used for training and 40 for testing. Three Chinese-capable open-source LLMs (Baichuan2-7B-Chat, ChatGLM-4-9B-Chat and Llama-3-8B-Chinese-Chat-v2) were fine-tuned on this corpus and were named as MI-LLMs. We evaluated MI-LLMs using round-based automatic metrics and expert manual coding with the Motivational Interviewing Treatment Integrity (MITI) Coding Manual 4.2.1. Results: Across all three models, fine-tuning substantially improved BLEU-4 and ROUGE scores compared with the base models, and manual coding showed that MI-LLMs achieved technical and relational global scores, and MI-adherent ratios that approached those of real MI dialogues, although complex reflections and reflection-to-question ratios remained less frequent. Conclusions: These findings provide initial evidence that MI-oriented fine-tuning can endow general-purpose LLMs with core MI-consistent counseling behaviors, suggesting a scalable pathway toward AI-assisted health behavior change support while underscoring the need for further work on data scale, complex MI skills and real-world intervention trials.
• 摘要：背景：动机访谈（MI）是促进健康行为改变的有效咨询方法，但其影响受到对训练有素的人类咨询师的需求的限制。目的：本研究旨在通过开发和评估动机面试大型语言模型 (MI-LLM) 来探索可扩展的替代方案。方法：我们首先策划了五个中国心理咨询语料库，并使用 GPT-4 和 MI 提示提示，将两个最高质量数据集（CPsyCounD 和 PsyDTCorpus）中的多轮对话转录为 2,040 个 MI 风格的咨询对话，其中 2,000 个用于训练，40 个用于测试。三个具有中文能力的开源LLM（Baichuan2-7B-Chat、ChatGLM-4-9B-Chat和Llama-3-8B-Chinese-Chat-v2）在此语料库上进行了微调，并被命名为MI-LLM。我们使用基于回合的自动指标和专家手动编码以及动机面试治疗完整性 (MITI) 编码手册 4.2.1 来评估 MI-LLM。结果：在所有三个模型中，与基本模型相比，微调显着提高了 BLEU-4 和 ROUGE 分数，并且手动编码表明 MI-LLM 实现了技术和关系全局分数，并且 MI 遵守率接近真实 MI 对话的比率，尽管复杂的反思和反思与问题的比率仍然不那么频繁。结论：这些研究结果提供了初步证据，表明以 MI 为导向的微调可以赋予通用法学硕士与 MI 一致的核心咨询行为，这表明了人工智能辅助健康行为改变支持的可扩展途径，同时强调了在数据规模、复杂 MI 技能和现实世界干预试验方面进一步开展工作的必要性。

Title: CTkvr: KV Cache Retrieval for Long-Context LLMs via Centroid then Token Indexing

• Authors: Kuan Lu, Shuhang Lin, Sai Wu, Yichen Yao, Junhan Yang, Huan Li, Wei Chu, Xu Yinghui, Yuan Qi, Gang Chen
• Subjects: cs.CL
• Abstract URL: https://arxiv.org/abs/2512.15550
• Pdf URL: https://arxiv.org/pdf/2512.15550
• Copy Paste: [[2512.15550]] CTkvr: KV Cache Retrieval for Long-Context LLMs via Centroid then Token Indexing(https://arxiv.org/abs/2512.15550)
• Keywords: language model, llm, long context
• Abstract: Large language models (LLMs) are increasingly applied in long-context scenarios such as multi-turn conversations. However, long contexts pose significant challenges for inference efficiency, including high memory overhead from Key-Value (KV) cache and increased latency due to excessive memory accesses. Recent methods for dynamic KV selection struggle with trade-offs: block-level indexing degrades accuracy by retrieving irrelevant KV entries, while token-level indexing incurs high latency from inefficient retrieval mechanisms. In this paper, we propose CTKVR, a novel centroid-then-token KV retrieval scheme that addresses these limitations. CTKVR leverages a key observation: query vectors adjacent in position exhibit high similarity after Rotary Position Embedding (RoPE) and share most of their top-k KV cache entries. Based on this insight, CTKVR employs a two-stage retrieval strategy: lightweight centroids are precomputed during prefilling for centroid-grained indexing, followed by token-level refinement for precise KV retrieval. This approach balances retrieval efficiency and accuracy. To further enhance performance, we implement an optimized system for indexing construction and search using CPU-GPU co-execution. Experimentally, CTKVR achieves superior performance across multiple benchmarks with less than 1% accuracy degradation. Meanwhile, CTKVR delivers 3 times and 4 times throughput speedups on Llama-3-8B and Yi-9B at 96K context length across diverse GPU hardware.
• 摘要：大语言模型（LLM）越来越多地应用于多轮对话等长上下文场景。然而，长上下文对推理效率提出了重大挑战，包括键值 (KV) 缓存的高内存开销以及由于过多的内存访问而导致的延迟增加。最近的动态 KV 选择方法面临着权衡：块级索引通过检索不相关的 KV 条目而降低了准确性，而令牌级索引则因低效的检索机制而导致高延迟。在本文中，我们提出了 CTKVR，一种新颖的质心然后令牌 KV 检索方案，可以解决这些限制。 CTKVR 利用了一个关键观察结果：位置相邻的查询向量在旋转位置嵌入 (RoPE) 后表现出高度相似性，并且共享大部分 top-k KV 缓存条目。基于这一见解，CTKVR 采用了两阶段检索策略：在预填充过程中预先计算轻量级质心以进行质心粒度索引，然后进行 token 级细化以实现精确的 KV 检索。这种方法平衡了检索效率和准确性。为了进一步提高性能，我们使用 CPU-GPU 协同执行来实现索引构建和搜索的优化系统。通过实验，CTKVR 在多个基准测试中实现了卓越的性能，且精度下降幅度小于 1%。与此同时，CTKVR 在 Llama-3-8B 和 Yi-9B 上以 96K 上下文长度跨不同 GPU 硬件提供了 3 倍和 4 倍的吞吐量加速。

Title: Learning inflection classes using Adaptive Resonance Theory

• Authors: Peter Dekker, Heikki Rasilo, Bart de Boer
• Subjects: cs.CL
• Abstract URL: https://arxiv.org/abs/2512.15551
• Pdf URL: https://arxiv.org/pdf/2512.15551
• Copy Paste: [[2512.15551]] Learning inflection classes using Adaptive Resonance Theory(https://arxiv.org/abs/2512.15551)
• Keywords: agent
• Abstract: The concept of inflection classes is an abstraction used by linguists, and provides a means to describe patterns in languages that give an analogical base for deducing previously unencountered forms. This ability is an important part of morphological acquisition and processing. We study the learnability of a system of verbal inflection classes by the individual language user by performing unsupervised clustering of lexemes into inflection classes. As a cognitively plausible and interpretable computational model, we use Adaptive Resonance Theory, a neural network with a parameter that determines the degree of generalisation (vigilance). The model is applied to Latin, Portuguese and Estonian. The similarity of clustering to attested inflection classes varies depending on the complexity of the inflectional system. We find the best performance in a narrow region of the generalisation parameter. The learned features extracted from the model show similarity with linguistic descriptions of the inflection classes. The proposed model could be used to study change in inflection classes in the future, by including it in an agent-based model.
• 摘要：词形变化类的概念是语言学家使用的抽象概念，它提供了一种描述语言模式的方法，为推导以前未遇到的形式提供了类比基础。这种能力是形态学获取和处理的重要组成部分。我们通过将词素无监督地聚类成屈折变化类别来研究单个语言用户对言语屈折变化类别系统的可学习性。作为一种认知上合理且可解释的计算模型，我们使用自适应共振理论，这是一种神经网络，其参数决定了泛化程度（警惕性）。该模型适用于拉丁语、葡萄牙语和爱沙尼亚语。聚类与已证明的词形变化类别的相似性根据词形变化系统的复杂性而变化。我们发现在泛化参数的狭窄区域内具有最佳性能。从模型中提取的学习特征与词形变化类别的语言描述具有相似性。所提出的模型可以通过将其包含在基于代理的模型中来研究未来的变化类别的变化。

Title: Bolmo: Byteifying the Next Generation of Language Models

• Authors: Benjamin Minixhofer, Tyler Murray, Tomasz Limisiewicz, Anna Korhonen, Luke Zettlemoyer, Noah A. Smith, Edoardo M. Ponti, Luca Soldaini, Valentin Hofmann
• Subjects: cs.CL
• Abstract URL: https://arxiv.org/abs/2512.15586
• Pdf URL: https://arxiv.org/pdf/2512.15586
• Copy Paste: [[2512.15586]] Bolmo: Byteifying the Next Generation of Language Models(https://arxiv.org/abs/2512.15586)
• Keywords: language model
• Abstract: We introduce Bolmo, the first family of competitive fully open byte-level language models (LMs) at the 1B and 7B parameter scales. In contrast to prior research on byte-level LMs, which focuses predominantly on training from scratch, we train Bolmo by byteifying existing subword-level LMs. Byteification enables overcoming the limitations of subword tokenization - such as insufficient character understanding and efficiency constraints due to the fixed subword vocabulary - while performing at the level of leading subword-level LMs. Bolmo is specifically designed for byteification: our architecture resolves a mismatch between the expressivity of prior byte-level architectures and subword-level LMs, which makes it possible to employ an effective exact distillation objective between Bolmo and the source subword model. This allows for converting a subword-level LM to a byte-level LM by investing less than 1\% of a typical pretraining token budget. Bolmo substantially outperforms all prior byte-level LMs of comparable size, and outperforms the source subword-level LMs on character understanding and, in some cases, coding, while coming close to matching the original LMs' performance on other tasks. Furthermore, we show that Bolmo can achieve inference speeds competitive with subword-level LMs by training with higher token compression ratios, and can be cheaply and effectively post-trained by leveraging the existing ecosystem around the source subword-level LM. Our results finally make byte-level LMs a practical choice competitive with subword-level LMs across a wide set of use cases.
• 摘要：我们推出 Bolmo，这是第一个具有 1B 和 7B 参数规模的竞争性完全开放字节级语言模型 (LM) 系列。与之前对字节级 LM 的研究主要侧重于从头开始训练相比，我们通过对现有子字级 LM 进行字节化来训练 Bolmo。字节化能够克服子词标记化的局限性 - 例如由于固定子词词汇而导致的字符理解不足和效率限制 - 同时在领先的子词级 LM 的水平上执行。 Bolmo 专为字节​​化而设计：我们的架构解决了先前字节级架构和子字级 LM 的表达能力之间的不匹配问题，这使得在 Bolmo 和源子字模型之间采用有效的精确蒸馏目标成为可能。这允许通过投资不到典型预训练令牌预算的 1% 来将子字级 LM 转换为字节级 LM。 Bolmo 大大优于所有先前大小相当的字节级 LM，并且在字符理解和（在某些情况下）编码方面优于源子字级 LM，同时在其他任务上接近匹配原始 LM 的性能。此外，我们还表明，Bolmo 通过使用更高的 token 压缩比进行训练，可以实现与子字级 LM 竞争的推理速度，并且可以通过利用围绕源子字级 LM 的现有生态系统进行廉价且有效的后期训练。我们的结果最终使字节级 LM 成为在广泛的用例中与子字级 LM 竞争的实用选择。

Title: You Never Know a Person, You Only Know Their Defenses: Detecting Levels of Psychological Defense Mechanisms in Supportive Conversations

• Authors: Hongbin Na, Zimu Wang, Zhaoming Chen, Peilin Zhou, Yining Hua, Grace Ziqi Zhou, Haiyang Zhang, Tao Shen, Wei Wang, John Torous, Shaoxiong Ji, Ling Chen
• Subjects: cs.CL
• Abstract URL: https://arxiv.org/abs/2512.15601
• Pdf URL: https://arxiv.org/pdf/2512.15601
• Copy Paste: [[2512.15601]] You Never Know a Person, You Only Know Their Defenses: Detecting Levels of Psychological Defense Mechanisms in Supportive Conversations(https://arxiv.org/abs/2512.15601)
• Keywords: language model, prompt
• Abstract: Psychological defenses are strategies, often automatic, that people use to manage distress. Rigid or overuse of defenses is negatively linked to mental health and shapes what speakers disclose and how they accept or resist help. However, defenses are complex and difficult to reliably measure, particularly in clinical dialogues. We introduce PsyDefConv, a dialogue corpus with help seeker utterances labeled for defense level, and DMRS Co-Pilot, a four-stage pipeline that provides evidence-based pre-annotations. The corpus contains 200 dialogues and 4709 utterances, including 2336 help seeker turns, with labeling and Cohen's kappa 0.639. In a counterbalanced study, the co-pilot reduced average annotation time by 22.4%. In expert review, it averaged 4.62 for evidence, 4.44 for clinical plausibility, and 4.40 for insight on a seven-point scale. Benchmarks with strong language models in zero-shot and fine-tuning settings demonstrate clear headroom, with the best macro F1-score around 30% and a tendency to overpredict mature defenses. Corpus analyses confirm that mature defenses are most common and reveal emotion-specific deviations. We will release the corpus, annotations, code, and prompts to support research on defensive functioning in language.
• 摘要：心理防御是人们用来应对痛苦的策略，通常是自动的。僵化或过度使用防御措施与心理健康呈负相关，并影响演讲者披露的内容以及他们如何接受或拒绝帮助。然而，防御很复杂且难以可靠地衡量，特别是在临床对话中。我们引入了 PsyDefConv，一个对话语料库，其中包含标记为防御级别的求助者话语，以及 DMRS Co-Pilot，一个提供基于证据的预注释的四阶段管道。该语料库包含 200 个对话和 4709 个话语，其中包括 2336 个求助者轮流，带有标签，Cohen 的 kappa 为 0.639。在一项平衡研究中，副驾驶将平均注释时间减少了 22.4%。在专家评审中，七分制的证据平均分为 4.62，临床合理性平均分为 4.44，洞察力平均分为 4.40。在零样本和微调设置中具有强大语言模型的基准显示出明显的空间，最佳宏观 F1 分数约为 30%，并且有过度预测成熟防御的倾向。语料库分析证实，成熟的防御是最常见的，并揭示了特定于情绪的偏差。我们将发布语料库、注释、代码和提示，以支持语言防御功能的研究。

Title: Evaluating Metrics for Safety with LLM-as-Judges

• Authors: Kester Clegg, Richard Hawkins, Ibrahim Habli, Tom Lawton
• Subjects: cs.CL, cs.AI
• Abstract URL: https://arxiv.org/abs/2512.15617
• Pdf URL: https://arxiv.org/pdf/2512.15617
• Copy Paste: [[2512.15617]] Evaluating Metrics for Safety with LLM-as-Judges(https://arxiv.org/abs/2512.15617)
• Keywords: language model, llm
• Abstract: LLMs (Large Language Models) are increasingly used in text processing pipelines to intelligently respond to a variety of inputs and generation tasks. This raises the possibility of replacing human roles that bottleneck existing information flows, either due to insufficient staff or process complexity. However, LLMs make mistakes and some processing roles are safety critical. For example, triaging post-operative care to patients based on hospital referral letters, or updating site access schedules in nuclear facilities for work crews. If we want to introduce LLMs into critical information flows that were previously performed by humans, how can we make them safe and reliable? Rather than make performative claims about augmented generation frameworks or graph-based techniques, this paper argues that the safety argument should focus on the type of evidence we get from evaluation points in LLM processes, particularly in frameworks that employ LLM-as-Judges (LaJ) evaluators. This paper argues that although we cannot get deterministic evaluations from many natural language processing tasks, by adopting a basket of weighted metrics it may be possible to lower the risk of errors within an evaluation, use context sensitivity to define error severity and design confidence thresholds that trigger human review of critical LaJ judgments when concordance across evaluators is low.
• 摘要：LLM（大型语言模型）越来越多地用于文本处理管道，以智能地响应各种输入和生成任务。这增加了替换由于人员不足或流程复杂而成为现有信息流瓶颈的人员角色的可能性。然而，法学硕士会犯错误，并且某些处理角色对安全至关重要。例如，根据医院转介信对患者进行术后护理分类，或更新工作人员核设施的现场访问时间表。如果我们想将法学硕士引入以前由人类执行的关键信息流中，我们如何才能使其安全可靠？本文认为，安全性论证应该集中于我们从法学硕士流程的评估点中获得的证据类型，尤其是在采用法学硕士作为法官（LaJ）评估者的框架中，而不是对增强生成框架或基于图的技术做出表演性的主张。本文认为，虽然我们无法从许多自然语言处理任务中获得确定性评估，但通过采用一篮子加权指标，可能会降低评估中出现错误的风险，使用上下文敏感性来定义错误严重性，并设计置信度阈值，当评估者之间的一致性较低时，触发对关键 LaJ 判断的人工审查。

Title: How Much is Too Much? Exploring LoRA Rank Trade-offs for Retaining Knowledge and Domain Robustness

• Authors: Darshita Rathore, Vineet Kumar, Chetna Bansal, Anindya Moitra
• Subjects: cs.CL, cs.AI, cs.LG
• Abstract URL: https://arxiv.org/abs/2512.15634
• Pdf URL: https://arxiv.org/pdf/2512.15634
• Copy Paste: [[2512.15634]] How Much is Too Much? Exploring LoRA Rank Trade-offs for Retaining Knowledge and Domain Robustness(https://arxiv.org/abs/2512.15634)
• Keywords: language model
• Abstract: Large language models are increasingly adapted to downstream tasks through fine-tuning. Full supervised fine-tuning (SFT) and parameter-efficient fine-tuning (PEFT) methods, such as Low-Rank Adaptation (LoRA), are two dominant approaches. While PEFT methods are widely used for their computational efficiency, the implications of their configurations (e.g., rank) remain under-explored in downstream Q&A tasks and generalisation. In this work, we perform a comprehensive evaluation across multiple reasoning and recall datasets, conducting a rank sweep to quantify the trade-off between SFT and PEFT. We also compare the accuracy of PEFT and SFT models across in-domain and out-of-domain adaptation, highlighting distinct generalisation behaviour and task-specific forgetting. We demonstrate that LoRA achieves competitive and in some cases superior performance compared to SFT, particularly on reasoning tasks at specific rank values. Additionally, we analyze the internal representations via spectral features and layer-wise attention structures, offering insights into representational drift and structural changes in attention patterns.
• 摘要：大型语言模型通过微调越来越适应下游任务。全监督微调（SFT）和参数高效微调（PEFT）方法，例如低秩适应（LoRA），是两种主要方法。虽然 PEFT 方法因其计算效率而被广泛使用，但其配置（例如排名）的影响在下游问答任务和泛化中仍未得到充分探索。在这项工作中，我们对多个推理和召回数据集进行了全面评估，进行排名扫描以量化 SFT 和 PEFT 之间的权衡。我们还比较了 PEFT 和 SFT 模型在域内和域外适应方面的准确性，突出了不同的泛化行为和特定于任务的遗忘。我们证明，与 SFT 相比，LoRA 实现了竞争性的甚至在某些情况下更优越的性能，特别是在特定排名值的推理任务上。此外，我们通过光谱特征和分层注意力结构分析内部表征，从而深入了解注意力模式的表征漂移和结构变化。

Title: Characterizing Mamba's Selective Memory using Auto-Encoders

• Authors: Tamanna Hossain, Robert L. Logan IV, Ganesh Jagadeesan, Sameer Singh, Joel Tetreault, Alejandro Jaimes
• Subjects: cs.CL
• Abstract URL: https://arxiv.org/abs/2512.15653
• Pdf URL: https://arxiv.org/pdf/2512.15653
• Copy Paste: [[2512.15653]] Characterizing Mamba's Selective Memory using Auto-Encoders(https://arxiv.org/abs/2512.15653)
• Keywords: language model
• Abstract: State space models (SSMs) are a promising alternative to transformers for language modeling because they use fixed memory during inference. However, this fixed memory usage requires some information loss in the hidden state when processing long sequences. While prior work has studied the sequence length at which this information loss occurs, it does not characterize the types of information SSM language models (LMs) tend to forget. In this paper, we address this knowledge gap by identifying the types of tokens (e.g., parts of speech, named entities) and sequences (e.g., code, math problems) that are more frequently forgotten by SSM LMs. We achieve this by training an auto-encoder to reconstruct sequences from the SSM's hidden state, and measure information loss by comparing inputs with their reconstructions. We perform experiments using the Mamba family of SSM LMs (130M--1.4B) on sequences ranging from 4--256 tokens. Our results show significantly higher rates of information loss on math-related tokens (e.g., numbers, variables), mentions of organization entities, and alternative dialects to Standard American English. We then examine the frequency that these tokens appear in Mamba's pretraining data and find that less prevalent tokens tend to be the ones Mamba is most likely to forget. By identifying these patterns, our work provides clear direction for future research to develop methods that better control Mamba's ability to retain important information.
• 摘要：状态空间模型 (SSM) 是语言建模转换器的一个有前途的替代品，因为它们在推理过程中使用固定内存。然而，在处理长序列时，这种固定的内存使用需要隐藏状态下的一些信息丢失。虽然之前的工作研究了发生这种信息丢失的序列长度，但它并没有描述 SSM 语言模型 (LM) 容易忘记的信息类型。在本文中，我们通过识别 SSM LM 更常忘记的标记类型（例如，词性、命名实体）和序列（例如，代码、数学问题）来解决这一知识差距。我们通过训练自动编码器从 SSM 的隐藏状态重建序列来实现这一目标，并通过将输入与其重建进行比较来测量信息损失。我们使用 Mamba 系列 SSM LM (130M--1.4B) 对 4--256 个 token 的序列进行实验。我们的结果显示，与数学相关的标记（例如数字、变量）、组织实体的提及以及标准美式英语的替代方言的信息丢失率明显更高。然后，我们检查这些标记在 Mamba 预训练数据中出现的频率，发现不太常见的标记往往是 Mamba 最有可能忘记的标记。通过识别这些模式，我们的工作为未来的研究提供了明确的方向，以开发更好地控制曼巴保留重要信息的能力的方法。

Title: Activation Oracles: Training and Evaluating LLMs as General-Purpose Activation Explainers

• Authors: Adam Karvonen, James Chua, Clément Dumas, Kit Fraser-Taliente, Subhash Kantamneni, Julian Minder, Euan Ong, Arnab Sen Sharma, Daniel Wen, Owain Evans, Samuel Marks
• Subjects: cs.CL, cs.AI, cs.LG
• Abstract URL: https://arxiv.org/abs/2512.15674
• Pdf URL: https://arxiv.org/pdf/2512.15674
• Copy Paste: [[2512.15674]] Activation Oracles: Training and Evaluating LLMs as General-Purpose Activation Explainers(https://arxiv.org/abs/2512.15674)
• Keywords: language model, llm
• Abstract: Large language model (LLM) activations are notoriously difficult to understand, with most existing techniques using complex, specialized methods for interpreting them. Recent work has proposed a simpler approach known as LatentQA: training LLMs to directly accept LLM activations as inputs and answer arbitrary questions about them in natural language. However, prior work has focused on narrow task settings for both training and evaluation. In this paper, we instead take a generalist perspective. We evaluate LatentQA-trained models, which we call Activation Oracles (AOs), in far out-of-distribution settings and examine how performance scales with training data diversity. We find that AOs can recover information fine-tuned into a model (e.g., biographical knowledge or malign propensities) that does not appear in the input text, despite never being trained with activations from a fine-tuned model. Our main evaluations are four downstream tasks where we can compare to prior white- and black-box techniques. We find that even narrowly-trained LatentQA models can generalize well, and that adding additional training datasets (such as classification tasks and a self-supervised context prediction task) yields consistent further improvements. Overall, our best AOs match or exceed prior white-box baselines on all four tasks and are the best method on 3 out of 4. These results suggest that diversified training to answer natural-language queries imparts a general capability to verbalize information about LLM activations.
• 摘要：大型语言模型 (LLM) 激活非常难以理解，大多数现有技术都使用复杂、专门的方法来解释它们。最近的工作提出了一种称为 LatentQA 的更简单方法：训练 LLM 直接接受 LLM 激活作为输入，并用自然语言回答有关它们的任意问题。然而，之前的工作主要集中在训练和评估的狭隘任务设置上。在本文中，我们采取的是通才的观点。我们在远离分布的环境中评估经 LatentQA 训练的模型（我们称之为激活预言机 (AO)），并检查性能如何随训练数据多样性而变化。我们发现 AO 可以恢复微调到模型中的信息（例如，传记知识或恶意倾向），这些信息不会出现在输入文本中，尽管从未使用微调模型的激活进行过训练。我们的主要评估是四个下游任务，我们可以在其中与之前的白盒和黑盒技术进行比较。我们发现，即使是经过严格训练的 LatentQA 模型也可以很好地泛化，并且添加额外的训练数据集（例如分类任务和自监督上下文预测任务）可以带来持续的进一步改进。总体而言，我们最好的 AO 在所有四项任务上都匹配或超过了先前的白盒基线，并且是 4 项任务中的 3 项的最佳方法。这些结果表明，回答自然语言查询的多样化训练赋予了用语言表达有关 LLM 激活信息的一般能力。