2026-03-09

Title: Verify as You Go: An LLM-Powered Browser Extension for Fake News Detection

• Authors: Dorsaf Sallami, Esma Aïmeur
• Subjects: cs.CL, cs.HC, cs.IR
• Abstract URL: https://arxiv.org/abs/2603.05519
• Pdf URL: https://arxiv.org/pdf/2603.05519
• Copy Paste: [[2603.05519]] Verify as You Go: An LLM-Powered Browser Extension for Fake News Detection(https://arxiv.org/abs/2603.05519)
• Keywords: language model, llm, retrieval-augmented generation
• Abstract: The rampant spread of fake news in the digital age poses serious risks to public trust and democratic institutions, underscoring the need for effective, transparent, and user-centered detection tools. Existing browser extensions often fall short due to opaque model behavior, limited explanatory support, and a lack of meaningful user engagement. This paper introduces Aletheia, a novel browser extension that leverages Retrieval-Augmented Generation (RAG) and Large Language Models (LLMs) to detect fake news and provide evidence-based explanations. Aletheia further includes two interactive components: a Discussion Hub that enables user dialogue around flagged content and a Stay Informed feature that surfaces recent fact-checks. Through extensive experiments, we show that Aletheia outperforms state-of-the-art baselines in detection performance. Complementing this empirical evaluation, a complementary user study with 250 participants confirms the system's usability and perceived effectiveness, highlighting its potential as a transparent tool for combating online fake news.
• 摘要：数字时代假新闻的猖獗传播给公众信任和民主机构带来了严重风险，凸显了有效、透明和以用户为中心的检测工具的必要性。由于不透明的模型行为、有限的解释性支持以及缺乏有意义的用户参与，现有的浏览器扩展常常达不到要求。本文介绍了 Aletheia，这是一种新颖的浏览器扩展，它利用检索增强生成 (RAG) 和大型语言模型 (LLM) 来检测假新闻并提供基于证据的解释。 Aletheia 还包括两个交互式组件：一个讨论中心，允许用户围绕标记的内容进行对话；以及一个显示最新事实核查的“保持知情”功能。通过大量实验，我们证明 Aletheia 在检测性能方面优于最先进的基线。作为对这一实证评估的补充，一项由 250 名参与者参与的补充用户研究证实了该系统的可用性和感知有效性，强调了其作为打击在线假新闻的透明工具的潜力。

Title: Attention Meets Reachability: Structural Equivalence and Efficiency in Grammar-Constrained LLM Decoding

• Authors: Faruk Alpay, Bilge Senturk
• Subjects: cs.CL, cs.FL, cs.LG
• Abstract URL: https://arxiv.org/abs/2603.05540
• Pdf URL: https://arxiv.org/pdf/2603.05540
• Copy Paste: [[2603.05540]] Attention Meets Reachability: Structural Equivalence and Efficiency in Grammar-Constrained LLM Decoding(https://arxiv.org/abs/2603.05540)
• Keywords: llm
• Abstract: We study grammar-constrained decoding (GCD) as a coupling between an autoregressive next-token distribution and a reachability oracle over a pushdown system compiled from a context-free grammar (CFG). We prove an oracle invariance theorem: language-equivalent grammars induce identical admissible next-token sets for every prefix, hence identical logit masks, yet can yield provably different compiled state spaces and online ambiguity costs. We give exact control-state blowup counts for the canonical $a^n b^n$ language under redundant nonterminal delegation, and introduce a left-to-right structural ambiguity cost (SAC) measuring incremental packed-parse-forest growth per token. For two equivalent grammars over all finite strings, SAC is $O(1)$ per token under right-recursion but $\Theta(t^2)$ per token and $\Theta(n^3)$ cumulatively under concatenation. We establish engine-independent lower bounds: any sound, retrieval-efficient, parse-preserving online masking engine must incur $\Omega(t^2)$ work per token on a specific constant-size CFG family, unconditionally within this model. We define decoding-cost equivalence classes of grammars and prove existence of minimal-SAC representatives within bounded rewrite families. Finally, we characterize the true conditional sampler via a Doob $h$-transform and derive sharp one-step KL and total-variation distortion bounds for hard-masked decoding in terms of survival-probability spread among admissible next tokens. We integrate these results with Transformer and Mixture-of-Experts architectures, derive latency envelopes in terms of vocabulary size, active state sets, and beam width, and connect SAC to instrumentation-based predictive performance models and automated grammar optimization.
• 摘要：我们研究语法约束解码（GCD）作为自回归下一个令牌分布和从上下文无关语法（CFG）编译的下推系统上的可达性预言机之间的耦合。我们证明了一个预言不变性定理：语言等效语法为每个前缀引入相同的可接受的下一个标记集，因此相同的逻辑掩码，但可以产生可证明不同的编译状态空间和在线歧义成本。我们给出了冗余非终结委托下规范 $a^n b^n$ 语言的精确控制状态爆炸计数，并引入了从左到右的结构模糊成本（SAC）来测量每个令牌增量打包解析森林的增长。对于所有有限字符串上的两个等价语法，SAC 在右递归下每个标记为 $O(1)$，但在串联下每个标记为 $\Theta(t^2)$ 和 $\Theta(n^3)$ 累积。我们建立与引擎无关的下限：任何健全的、检索高效的、解析保留的在线掩码引擎都必须无条件地在该模型内对特定的恒定大小 CFG 系列上的每个标记产生 $\Omega(t^2)$ 工作。我们定义了语法的解码成本等价类，并证明了有界重写族中最小 SAC 代表的存在。最后，我们通过 Doob $h$ 变换来表征真实条件采样器，并根据可接受的下一个标记之间的生存概率分布，导出用于硬掩码解码的尖锐单步 KL 和总变异失真界限。我们将这些结果与 Transformer 和 Mixture-of-Experts 架构集成，根据词汇大小、活动状态集和波束宽度得出延迟包络，并将 SAC 连接到基于仪器的预测性能模型和自动语法优化。

Title: NOTAI.AI: Explainable Detection of Machine-Generated Text via Curvature and Feature Attribution

• Authors: Oleksandr Marchenko Breneur, Adelaide Danilov, Aria Nourbakhsh, Salima Lamsiyah
• Subjects: cs.CL
• Abstract URL: https://arxiv.org/abs/2603.05617
• Pdf URL: https://arxiv.org/pdf/2603.05617
• Copy Paste: [[2603.05617]] NOTAI.AI: Explainable Detection of Machine-Generated Text via Curvature and Feature Attribution(https://arxiv.org/abs/2603.05617)
• Keywords: gpt, llm
• Abstract: We present this http URL, an explainable framework for machine-generated text detection that extends Fast-DetectGPT by integrating curvature-based signals with neural and stylometric features in a supervised setting. The system combines 17 interpretable features, including Conditional Probability Curvature, ModernBERT detector score, readability metrics, and stylometric cues, within a gradient-boosted tree (XGBoost) meta-classifier to determine whether a text is human- or AI-generated. Furthermore, this http URL applies Shapley Additive Explanations (SHAP) to provide both local and global feature-level attribution. These attributions are further translated into structured natural-language rationales through an LLM-based explanation layer, which enables user-facing interpretability. The system is deployed as an interactive web application that supports real-time analysis, visual feature inspection, and structured evidence presentation. A web interface allows users to input text and inspect how neural and statistical signals influence the final decision. The source code and demo video are publicly available to support reproducibility.
• 摘要：我们提出了这个 http URL，这是一个用于机器生成文本检测的可解释框架，它通过在监督环境中将基于曲率的信号与神经和文体特征相集成来扩展 Fast-DetectGPT。该系统在梯度增强树 (XGBoost) 元分类器中结合了 17 个可解释的特征，包括条件概率曲率、ModernBERT 检测器评分、可读性指标和文体提示，以确定文本是人类生成的还是人工智能生成的。此外，此 http URL 应用 Shapley Additive Explanations (SHAP) 来提供本地和全局特征级别归因。这些属性通过基于法学硕士的解释层进一步转化为结构化的自然语言基本原理，从而实现面向用户的可解释性。该系统部署为交互式 Web 应用程序，支持实时分析、视觉特征检查和结构化证据呈现。网络界面允许用户输入文本并检查神经和统计信号如何影响最终决策。源代码和演示视频是公开的，以支持可重复性。

Title: Safer Reasoning Traces: Measuring and Mitigating Chain-of-Thought Leakage in LLMs

• Authors: Patrick Ahrend, Tobias Eder, Xiyang Yang, Zhiyi Pan, Georg Groh
• Subjects: cs.CL
• Abstract URL: https://arxiv.org/abs/2603.05618
• Pdf URL: https://arxiv.org/pdf/2603.05618
• Copy Paste: [[2603.05618]] Safer Reasoning Traces: Measuring and Mitigating Chain-of-Thought Leakage in LLMs(https://arxiv.org/abs/2603.05618)
• Keywords: llm, prompt, chain-of-thought
• Abstract: Chain-of-Thought (CoT) prompting improves LLM reasoning but can increase privacy risk by resurfacing personally identifiable information (PII) from the prompt into reasoning traces and outputs, even under policies that instruct the model not to restate PII. We study such direct, inference-time PII leakage using a model-agnostic framework that (i) defines leakage as risk-weighted, token-level events across 11 PII types, (ii) traces leakage curves as a function of the allowed CoT budget, and (iii) compares open- and closed-source model families on a structured PII dataset with a hierarchical risk taxonomy. We find that CoT consistently elevates leakage, especially for high-risk categories, and that leakage is strongly family- and budget-dependent. Increasing the reasoning budget can either amplify or attenuate leakage depending on the base model. We then benchmark lightweight inference-time gatekeepers: a rule-based detector, a TF-IDF + logistic regression classifier, a GLiNER-based NER model, and an LLM-as-judge, using risk-weighted F1, Macro-F1, and recall. No single method dominates across models or budgets, motivating hybrid, style-adaptive gatekeeping policies that balance utility and risk under a common, reproducible protocol.
• 摘要：思想链 (CoT) 提示改进了 LLM 推理，但可能会通过将提示中的个人身份信息 (PII) 重新呈现到推理跟踪和输出中来增加隐私风险，即使在指示模型不要重述 PII 的政策下也是如此。我们使用与模型无关的框架来研究这种直接的推理时间 PII 泄漏，该框架 (i) 将泄漏定义为跨 11 种 PII 类型的风险加权、代币级事件，(ii) 跟踪泄漏曲线作为允许的 CoT 预算的函数，以及 (iii) 将结构化 PII 数据集上的开源和闭源模型系列与分层风险分类法进行比较。我们发现，CoT 持续增加泄漏，特别是对于高风险类别，并且泄漏强烈依赖于家庭和预算。增加推理预算可以放大或减弱泄漏，具体取决于基本模型。然后，我们使用风险加权 F1、Macro-F1 和召回率对轻量级推理时间看门人进行基准测试：基于规则的检测器、TF-IDF + 逻辑回归分类器、基于 GLiNER 的 NER 模型和 LLM 作为法官。没有一种方法能够在模型或预算中占据主导地位，从而激发混合的、风格自适应的把关政策，在通用的、可重复的协议下平衡效用和风险。

Title: The Fragility Of Moral Judgment In Large Language Models

• Authors: Tom van Nuenen, Pratik S. Sachdeva
• Subjects: cs.CL, cs.AI, cs.HC
• Abstract URL: https://arxiv.org/abs/2603.05651
• Pdf URL: https://arxiv.org/pdf/2603.05651
• Copy Paste: [[2603.05651]] The Fragility Of Moral Judgment In Large Language Models(https://arxiv.org/abs/2603.05651)
• Keywords: language model, gpt, llm, prompt
• Abstract: People increasingly use large language models (LLMs) for everyday moral and interpersonal guidance, yet these systems cannot interrogate missing context and judge dilemmas as presented. We introduce a perturbation framework for testing the stability and manipulability of LLM moral judgments while holding the underlying moral conflict constant. Using 2,939 dilemmas from r/AmItheAsshole (January-March 2025), we generate three families of content perturbations: surface edits (lexical/structural noise), point-of-view shifts (voice and stance neutralization), and persuasion cues (self-positioning, social proof, pattern admissions, victim framing). We also vary the evaluation protocol (output ordering, instruction placement, and unstructured prompting). We evaluated all variants with four models (GPT-4.1, Claude 3.7 Sonnet, DeepSeek V3, Qwen2.5-72B) (N=129,156 judgments). Surface perturbations produce low flip rates (7.5%), largely within the self-consistency noise floor (4-13%), whereas point-of-view shifts induce substantially higher instability (24.3%). A large subset of dilemmas (37.9%) is robust to surface noise yet flips under perspective changes, indicating that models condition on narrative voice as a pragmatic cue. Instability concentrates in morally ambiguous cases; scenarios where no party is assigned blame are most susceptible. Persuasion perturbations yield systematic directional shifts. Protocol choices dominate all other factors: agreement between structured protocols is only 67.6% (kappa=0.55), and only 35.7% of model-scenario units match across all three protocols. These results show that LLM moral judgments are co-produced by narrative form and task scaffolding, raising reproducibility and equity concerns when outcomes depend on presentation skill rather than moral substance.
• 摘要：人们越来越多地使用大型语言模型（LLM）进行日常道德和人际指导，但这些系统无法询问缺失的上下文并判断所呈现的困境。我们引入了一个扰动框架来测试法学硕士道德判断的稳定性和可操纵性，同时保持潜在的道德冲突不变。利用 r/AmItheAsshole（2025 年 1 月至 3 月）中的 2,939 个困境，我们生成了三类内容扰动：表面编辑（词汇/结构噪音）、观点转变（声音和立场中和）和说服线索（自我定位、社会证明、模式承认、受害者框架）。我们还改变了评估协议（输出排序、指令放置和非结构化提示）。我们使用四种模型（GPT-4.1、Claude 3.7 Sonnet、DeepSeek V3、Qwen2.5-72B）评估了所有变体（N=129,156 个判断）。表面扰动产生较低的翻转率 (7.5%)，主要在自洽本底噪声 (4-13%) 内，而视角变化会导致更高的不稳定性 (24.3%)。很大一部分困境（37.9%）对表面噪音具有鲁棒性，但在视角变化下会发生翻转，这表明模型将叙事声音作为务实的线索。不稳定集中在道德模棱两可的情况下；没有一方受到指责的情况是最容易受到影响的。说服扰动会产生系统性的方向转变。协议选择主导所有其他因素：结构化协议之间的一致性仅为 67.6%（kappa=0.55），并且只有 35.7% 的模型场景单元在所有三个协议中匹配。这些结果表明，法学硕士的道德判断是由叙述形式和任务支架共同产生的，当结果取决于表达技巧而不是道德实质时，会引发可重复性和公平性问题。

Title: Towards Robust Retrieval-Augmented Generation Based on Knowledge Graph: A Comparative Analysis

• Authors: Hazem Amamou, Stéphane Gagnon, Alan Davoust, Anderson R. Avila
• Subjects: cs.CL
• Abstract URL: https://arxiv.org/abs/2603.05698
• Pdf URL: https://arxiv.org/pdf/2603.05698
• Copy Paste: [[2603.05698]] Towards Robust Retrieval-Augmented Generation Based on Knowledge Graph: A Comparative Analysis(https://arxiv.org/abs/2603.05698)
• Keywords: language model, llm, hallucination, retrieval-augmented generation
• Abstract: Retrieval-Augmented Generation (RAG) was introduced to enhance the capabilities of Large Language Models (LLMs) beyond their encoded prior knowledge. This is achieved by providing LLMs with an external source of knowledge, which helps reduce factual hallucinations and enables access to new information not available during pretraining. However, inconsistent retrieved information can negatively affect LLM responses. The Retrieval-Augmented Generation Benchmark (RGB) was introduced to evaluate the robustness of RAG systems under such conditions. In this work, we use the RGB corpus to evaluate LLMs in four scenarios: noise robustness, information integration, negative rejection, and counterfactual robustness. We perform a comparative analysis between the RGB RAG baseline and GraphRAG, a knowledge graph based retrieval system. We test three GraphRAG customizations to improve robustness. Results show improvements over the RGB baseline and provide insights for designing more reliable RAG systems for real world scenarios.
• 摘要：引入检索增强生成 (RAG) 是为了增强大型语言模型 (LLM) 的能力，使其超越其编码的先验知识。这是通过为法学硕士提供外部知识来源来实现的，这有助于减少事实幻觉，并能够访问预培训期间无法获得的新信息。然而，不一致的检索信息可能会对 LLM 响应产生负面影响。引入检索增强生成基准（RGB）来评估 RAG 系统在这种条件下的鲁棒性。在这项工作中，我们使用 RGB 语料库在四种场景下评估 LLM：噪声鲁棒性、信息集成、否定拒绝和反事实鲁棒性。我们对 RGB RAG 基线和基于知识图的检索系统 GraphRAG 进行了比较分析。我们测试了三种 GraphRAG 定制以提高稳健性。结果显示了 RGB 基线的改进，并为为现实场景设计更可靠的 RAG 系统提供了见解。

Title: Structured Multidimensional Representation Learning for Large Language Models

• Authors: Alaa El Ichi, Khalide Jbilou, Mohamed El Guide, Franck Dufrenois
• Subjects: cs.CL, math.NA
• Abstract URL: https://arxiv.org/abs/2603.05727
• Pdf URL: https://arxiv.org/pdf/2603.05727
• Copy Paste: [[2603.05727]] Structured Multidimensional Representation Learning for Large Language Models(https://arxiv.org/abs/2603.05727)
• Keywords: language model
• Abstract: Transformer architectures achieve state-of-the-art performance across a wide range of pattern recognition and natural language processing tasks, but their scaling is accompanied by substantial parameter growth and redundancy in the embedding dimension. In this work, we introduce a structured spectral factorization of the embedding space based on the L-product for third-order tensors. By reshaping token representations into spectral tensor slices and performing attention and feed-forward operations in the transform domain, we obtain a Tensor Transformer architecture that decomposes the encoder into p independent spectral sub-transformers while preserving standard Transformer semantics. We prove that the proposed L-Transformer is spectrally equivalent to p parallel Transformers operating on reduceddimensional embeddings, which yields approximately 1/p reduction (up to lower-order terms such as biases and normalization parameters) in encoder parameters under fixed total embedding size. When instantiated with a real-valued Discrete Cosine Transform (DCT), the method remains fully differentiable and compatible with existing training pipelines. Beyond compression, the spectral decomposition introduces an inductive bias over embedding frequencies, enabling slice-dependent frequency scaling that improves generalization. Experiments on IMDB and AG~News show that the proposed model can substantially reduce encoder parameters (up to 75\% for p=4) while maintaining competitive accuracy. On IMDB, the tensorized encoder matches or improves upon the standard baseline under compression, whereas on AG~News at moderate width we observe a small accuracy decrease in exchange for a 4 times encoder reduction; at BERT-base width (d=768), performance returns to parity.
• 摘要：Transformer 架构在广泛的模式识别和自然语言处理任务中实现了最先进的性能，但它们的扩展伴随着嵌入维度的大量参数增长和冗余。在这项工作中，我们引入了基于三阶张量的 L 乘积的嵌入空间的结构化谱分解。通过将 token 表示重塑为谱张量切片并在变换域中执行注意力和前馈操作，我们获得了一个张量 Transformer 架构，该架构将编码器分解为 p 个独立的谱子变换器，同时保留标准 Transformer 语义。我们证明，所提出的 L-Transformer 在频谱上等效于在降维嵌入上运行的 p 个并行 Transformer，这在固定总嵌入大小下编码器参数产生了大约 1/p 的减少（直到低阶项，例如偏差和归一化参数）。当使用实值离散余弦变换 (DCT) 进行实例化时，该方法保持完全可微分并与现有训练流程兼容。除了压缩之外，频谱分解还引入了嵌入频率的感应偏差，从而实现了切片相关的频率缩放，从而提高了泛化能力。 IMDB 和 AG~News 上的实验表明，所提出的模型可以大幅减少编码器参数（p=4 时最多减少 75%），同时保持有竞争力的精度。在 IMDB 上，张量化编码器在压缩下匹配或改进了标准基线，而在中等宽度的 AG~News 上，我们观察到精度略有下降，但编码器减少了 4 倍；在 BERT 基宽度 (d=768) 处，性能恢复到同等水平。

Title: Let's Talk, Not Type: An Oral-First Multi-Agent Architecture for Guaraní

• Authors: Samantha Adorno, Akshata Kishore Moharir, Ratna Kandala
• Subjects: cs.CL
• Abstract URL: https://arxiv.org/abs/2603.05743
• Pdf URL: https://arxiv.org/pdf/2603.05743
• Copy Paste: [[2603.05743]] Let's Talk, Not Type: An Oral-First Multi-Agent Architecture for Guaraní(https://arxiv.org/abs/2603.05743)
• Keywords: agent
• Abstract: Although artificial intelligence (AI) and Human-Computer Interaction (HCI) systems are often presented as universal solutions, their design remains predominantly text-first, underserving primarily oral languages and indigenous communities. This position paper uses Guaraní, an official and widely spoken language of Paraguay, as a case study to argue that language support in AI remains insufficient unless it aligns with lived oral practices. We propose an alternative to the standard "text-to-speech" pipeline, proposing instead an oral-first multi-agent architecture. By decoupling Guaraní natural language understanding from dedicated agents for conversation state and community-led governance, we demonstrate a technical framework that respects indigenous data sovereignty and diglossia. Our work moves beyond mere recognition to focus on turn-taking, repair, and shared context as the primary locus of interaction. We conclude that for AI to be truly culturally grounded, it must shift from adapting oral languages to text-centric systems to treating spoken conversation as a first-class design requirement, ensuring digital ecosystems empower rather than overlook diverse linguistic practices.
• 摘要：尽管人工智能 (AI) 和人机交互 (HCI) 系统通常被视为通用解决方案，但它们的设计仍然主要是文本优先，主要服务于口头语言和土著社区。本立场文件使用瓜拉尼语（巴拉圭的一种官方语言和广泛使用的语言）作为案例研究，认为人工智能的语言支持仍然不足，除非它与生活口头实践相一致。我们提出了标准“文本到语音”管道的替代方案，提出了口头优先的多代理架构。通过将瓜拉尼自然语言理解与对话状态和社区主导治理的专用代理分离，我们展示了一个尊重土著数据主权和双语的技术框架。我们的工作超越了单纯的识别，重点关注轮流、修复和共享环境作为互动的主要场所。我们的结论是，人工智能要真正扎根于文化，必须从适应口头语言转向以文本为中心的系统，转变为将口语对话视为一流的设计要求，确保数字生态系统赋予而不是忽视多样化的语言实践。

Title: CodeScout: Contextual Problem Statement Enhancement for Software Agents

• Authors: Manan Suri, Xiangci Li, Mehdi Shojaie, Songyang Han, Chao-Chun Hsu, Shweta Garg, Aniket Anand Deshmukh, Varun Kumar
• Subjects: cs.CL, cs.SE
• Abstract URL: https://arxiv.org/abs/2603.05744
• Pdf URL: https://arxiv.org/pdf/2603.05744
• Copy Paste: [[2603.05744]] CodeScout: Contextual Problem Statement Enhancement for Software Agents(https://arxiv.org/abs/2603.05744)
• Keywords: language model, agent
• Abstract: Current AI-powered code assistance tools often struggle with poorly-defined problem statements that lack sufficient task context and requirements specification. Recent analysis of software engineering agents reveals that failures on such underspecified requests are highly correlated with longer trajectories involving either over-exploration or repeated attempts at applying the same fix without proper evolution or testing, leading to suboptimal outcomes across software development tasks. We introduce CodeScout, a contextual query refinement approach that systematically converts underspecified user requests into comprehensive, actionable problem statements through lightweight pre-exploration of the target codebase. Our key innovation is demonstrating that structured analysis before task execution can supplement existing agentic capabilities without requiring any modifications to their underlying scaffolds. CodeScout performs targeted context scoping, conducts multi-perspective analysis examining potential fixes and exploration opportunities, then synthesizes these insights into enhanced problem statements with reproduction steps, expected behaviors, and targeted exploration hints. This pre-exploration directly addresses the identified failure patterns by reducing non-converging agent trajectories while clarifying user intent in natural language space. We evaluate CodeScout using state-of-the-art agentic scaffolds and language models on SWEBench-Verified, demonstrating a 20\% improvement in resolution rates with up to 27 additional issues resolved compared to the default baseline method. Our results suggest that systematic query refinement through contextual analysis represents a promising direction for enhancing AI code assistance capabilities.
• 摘要：当前人工智能驱动的代码辅助工具经常遇到定义不明确的问题陈述，缺乏足够的任务上下文和需求规范。最近对软件工程代理的分析表明，此类未指定请求的失败与较长的轨迹高度相关，涉及过度探索或在没有适当的演化或测试的情况下重复尝试应用相同的修复，从而导致整个软件开发任务的结果不理想。我们引入了 CodeScout，这是一种上下文查询细化方法，通过对目标代码库的轻量级预探索，系统地将未指定的用户请求转换为全面的、可操作的问题陈述。我们的关键创新在于证明任务执行前的结构化分析可以补充现有的代理功能，而无需对其底层支架进行任何修改。 CodeScout 执行有针对性的上下文范围界定，进行多角度分析，检查潜在的修复和探索机会，然后将这些见解综合到增强的问题陈述中，包括重现步骤、预期行为和有针对性的探索提示。这种预探索通过减少非收敛代理轨迹，同时澄清自然语言空间中的用户意图，直接解决已识别的故障模式。我们在 SWEBench-Verified 上使用最先进的代理支架和语言模型来评估 CodeScout，与默认基线方法相比，解决率提高了 20%，解决了多达 27 个额外问题。我们的结果表明，通过上下文分析进行系统查询细化是增强人工智能代码辅助能力的一个有希望的方向。

Title: NERdME: a Named Entity Recognition Dataset for Indexing Research Artifacts in Code Repositories

• Authors: Genet Asefa Gesese, Zongxiong Chen, Shufan Jiang, Mary Ann Tan, Zhaotai Liu, Sonja Schimmler, Harald Sack
• Subjects: cs.CL
• Abstract URL: https://arxiv.org/abs/2603.05750
• Pdf URL: https://arxiv.org/pdf/2603.05750
• Copy Paste: [[2603.05750]] NERdME: a Named Entity Recognition Dataset for Indexing Research Artifacts in Code Repositories(https://arxiv.org/abs/2603.05750)
• Keywords: language model
• Abstract: Existing scholarly information extraction (SIE) datasets focus on scientific papers and overlook implementation-level details in code repositories. README files describe datasets, source code, and other implementation-level artifacts, however, their free-form Markdown offers little semantic structure, making automatic information extraction difficult. To address this gap, NERdME is introduced: 200 manually annotated README files with over 10,000 labeled spans and 10 entity types. Baseline results using large language models and fine-tuned transformers show clear differences between paperlevel and implementation-level entities, indicating the value of extending SIE benchmarks with entity types available in README files. A downstream entity-linking experiment was conducted to demonstrate that entities derived from READMEs can support artifact discovery and metadata integration.
• 摘要：现有的学术信息提取（SIE）数据集侧重于科学论文，而忽略了代码存储库中的实现级细节。自述文件描述了数据集、源代码和其他实现级工件，但是，它们的自由格式 Markdown 提供的语义结构很少，使得自动信息提取变得困难。为了弥补这一差距，引入了 NERdME：200 个手动注释的 README 文件，其中包含超过 10,000 个标记的跨度和 10 种实体类型。使用大型语言模型和微调转换器的基线结果显示了论文级和实现级实体之间的明显差异，表明使用 README 文件中提供的实体类型扩展 SIE 基准的价值。进行了下游实体链接实验，以证明从 README 派生的实体可以支持工件发现和元数据集成。

Title: PVminerLLM: Structured Extraction of Patient Voice from Patient-Generated Text using Large Language Models

• Authors: Samah Fodeh, Linhai Ma, Ganesh Puthiaraju, Srivani Talakokkul, Afshan Khan, Ashley Hagaman, Sarah Lowe, Aimee Roundtree
• Subjects: cs.CL, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.05776
• Pdf URL: https://arxiv.org/pdf/2603.05776
• Copy Paste: [[2603.05776]] PVminerLLM: Structured Extraction of Patient Voice from Patient-Generated Text using Large Language Models(https://arxiv.org/abs/2603.05776)
• Keywords: language model, llm, prompt
• Abstract: Motivation: Patient-generated text contains critical information about patients' lived experiences, social circumstances, and engagement in care, including factors that strongly influence adherence, care coordination, and health equity. However, these patient voice signals are rarely available in structured form, limiting their use in patient-centered outcomes research and clinical quality improvement. Reliable extraction of such information is therefore essential for understanding and addressing non-clinical drivers of health outcomes at scale. Results: We introduce PVminer, a benchmark for structured extraction of patient voice, and propose PVminerLLM, a supervised fine-tuned large language model tailored to this task. Across multiple datasets and model sizes, PVminerLLM substantially outperforms prompt-based baselines, achieving up to 83.82% F1 for Code prediction, 80.74% F1 for Sub-code prediction, and 87.03% F1 for evidence Span extraction. Notably, strong performance is achieved even with smaller models, demonstrating that reliable patient voice extraction is feasible without extreme model scale. These results enable scalable analysis of social and experiential signals embedded in patient-generated text. Availability and Implementation: Code, evaluation scripts, and trained LLMs will be released publicly. Annotated datasets will be made available upon request for research use. Keywords: Large Language Models, Supervised Fine-Tuning, Medical Annotation, Patient-Generated Text, Clinical NLP
• 摘要：动机：患者生成的文本包含有关患者生活经历、社会环境和护理参与的关键信息，包括强烈影响依从性、护理协调和健康公平的因素。然而，这些患者语音信号很少以结构化形式提供，限制了它们在以患者为中心的结果研究和临床质量改进中的使用。因此，可靠地提取此类信息对于大规模理解和解决健康结果的非临床驱动因素至关重要。结果：我们引入了 PVminer，这是一种用于结构化提取患者语音的基准，并提出了 PVminerLLM，这是一种针对此任务量身定制的有监督的微调大语言模型。在多个数据集和模型大小中，PVminerLLM 的性能大大优于基于提示的基线，代码预测的 F1 高达 83.82%，子代码预测的 F1 高达 80.74%，证据跨度提取的 F1 高达 87.03%。值得注意的是，即使使用较小的模型也能实现强大的性能，这表明可靠的患者语音提取在没有极端模型规模的情况下是可行的。这些结果使得能够对患者生成的文本中嵌入的社交和体验信号进行可扩展的分析。可用性和实施​​：代码、评估脚本和经过培训的法学硕士将公开发布。带注释的数据集将根据要求提供以供研究使用。关键词：大型语言模型、监督微调、医学注释、患者生成文本、临床 NLP

Title: RouteGoT: Node-Adaptive Routing for Cost-Efficient Graph of Thoughts Reasoning

• Authors: Yuhang Liu, Ruijie Wang, Yunlong Chu, Bing Hao, Yumeng Lin, Shengzhong Liu, Minglai Shao
• Subjects: cs.CL
• Abstract URL: https://arxiv.org/abs/2603.05818
• Pdf URL: https://arxiv.org/pdf/2603.05818
• Copy Paste: [[2603.05818]] RouteGoT: Node-Adaptive Routing for Cost-Efficient Graph of Thoughts Reasoning(https://arxiv.org/abs/2603.05818)
• Keywords: language model, llm, prompt, chain-of-thought
• Abstract: Large Language Models (LLMs) excel at multi-step reasoning, yet increasing the structural complexity of inference does not consistently improve system-level returns. Methods such as Tree of Thoughts (ToT), Graph of Thoughts (GoT), and Adaptive Graph of Thoughts (AGoT) can boost accuracy on some benchmarks, but often introduce substantial overhead in token consumption and latency, and their gains can be unstable across task distributions-sometimes underperforming simpler Chain-of-Thought (CoT) or direct input-output prompting (IO). We attribute this inefficiency to stage-wise and node-wise heterogeneity inside GoT-style reasoning pipelines: high-quality planning and final synthesis are globally coupled and typically benefit from strong models, whereas many intermediate subtasks are localized and can be solved accurately by lighter models with far fewer tokens. Motivated by these observations, we propose RouteGoT, a budget-controllable, node-adaptive routing framework for graph-structured reasoning. RouteGoT performs in-graph routing by prioritizing strong models for planning and synthesis, while dynamically allocating lightweight models and cost-effective strategies to leaf subtasks based on predicted difficulty. It further integrates explicit budget constraints into a global inference scheduler to control graph expansion under a user-specified token budget, enabling predictable performance-cost trade-offs. Experiments across reasoning, retrieval, and multi-hop QA benchmarks show that RouteGoT matching or improving accuracy while substantially reducing token usage; specifically, it achieves an average 8.1 percentage points accuracy improvement and 79.1\% output token reduction compared to AGoT. Furthermore, RouteGoT outperforms existing routing baselines by maintaining a superior cost-accuracy trade-off, demonstrating improved robustness under varying budget targets and tasks.
• 摘要：大型语言模型 (LLM) 擅长多步推理，但增加推理的结构复杂性并不能持续提高系统级回报。思想树 (ToT)、思想图 (GoT) 和自适应思想图 (AGoT) 等方法可以提高某些基准测试的准确性，但通常会在令牌消耗和延迟方面带来大量开销，并且它们的增益在任务分布中可能不稳定 - 有时表现不佳更简单的思想链 (CoT) 或直接输入输出提示 (IO)。我们将这种低效率归因于 GoT 式推理管道内的阶段式和节点式异构性：高质量规划和最终综合是全局耦合的，通常受益于强大的模型，而许多中间子任务是本地化的，可以通过具有更少标记的较轻模型来准确解决。受这些观察的启发，我们提出了 RouteGoT，一种用于图结构推理的预算可控、节点自适应的路由框架。 RouteGoT 通过优先考虑强大的模型进行规划和综合来执行图内路由，同时根据预测的难度动态地将轻量级模型和具有成本效益的策略分配给叶子任务。它将显式预算约束进一步集成到全局推理调度程序中，以在用户指定的令牌预算下控制图扩展，从而实现可预测的性能成本权衡。推理、检索和多跳 QA 基准测试表明，RouteGoT 匹配或提高准确性，同时大幅减少令牌使用；具体来说，与 AGoT 相比，它的准确率平均提高了 8.1 个百分点，输出代币减少了 79.1%。此外，RouteGoT 通过保持卓越的成本精度权衡，优于现有的路由基线，在不同的预算目标和任务下展示出更高的稳健性。

Title: HART: Data-Driven Hallucination Attribution and Evidence-Based Tracing for Large Language Models

• Authors: Shize Liang, Hongzhi Wang
• Subjects: cs.CL
• Abstract URL: https://arxiv.org/abs/2603.05828
• Pdf URL: https://arxiv.org/pdf/2603.05828
• Copy Paste: [[2603.05828]] HART: Data-Driven Hallucination Attribution and Evidence-Based Tracing for Large Language Models(https://arxiv.org/abs/2603.05828)
• Keywords: language model, llm, hallucination
• Abstract: Large language models (LLMs) have demonstrated remarkable performance in text generation and knowledge-intensive question answering. Nevertheless, they are prone to producing hallucinated content, which severely undermines their reliability in high-stakes application domains. Existing hallucination attribution approaches, based on either external knowledge retrieval or internal model mechanisms, primarily focus on semantic similarity matching or representation-level discrimination. As a result, they have difficulty establishing structured correspondences at the span level between hallucination types, underlying error generation mechanisms, and external factual evidence, thereby limiting the interpretability of hallucinated fragments and the traceability of supporting or opposing evidence. To address these limitations, we propose HART, a fine-grained hallucination attribution and evidence retrieval framework for large language models. HART formalizes hallucination tracing as a structured modeling task comprising four stages: span localization, mechanism attribution, evidence retrieval, and causal tracing. Based upon this formulation, we develop the first structured dataset tailored for hallucination tracing, in which hallucination types, error mechanisms, and sets of counterfactual evidence are jointly annotated to enable causal-level interpretability evaluation. Experimental results on the proposed dataset demonstrate that HART substantially outperforms strong retrieval baselines, including BM25 and DPR, validating the effectiveness and generalization capability of the proposed tracing paradigm for hallucination analysis and evidence alignment.
• 摘要：大型语言模型（LLM）在文本生成和知识密集型问答方面表现出了卓越的性能。然而，它们很容易产生幻觉内容，这严重损害了它们在高风险应用领域的可靠性。现有的幻觉归因方法基于外部知识检索或内部模型机制，主要关注语义相似性匹配或表示级别区分。因此，他们很难在幻觉类型、潜在错误生成机制和外部事实证据之间建立跨度水平的结构化对应关系，从而限制了幻觉片段的可解释性以及支持或反对证据的可追溯性。为了解决这些限制，我们提出了 HART，一种用于大型语言模型的细粒度幻觉归因和证据检索框架。 HART 将幻觉追踪形式化为结构化建模任务，包括四个阶段：跨度定位、机制归因、证据检索和因果追踪。基于这个公式，我们开发了第一个专为幻觉追踪而定制的结构化数据集，其中幻觉类型、错误机制和反事实证据集被联合注释，以实现因果级别的可解释性评估。所提出的数据集的实验结果表明，HART 大大优于强大的检索基线，包括 BM25 和 DPR，验证了所提出的幻觉分析和证据对齐追踪范式的有效性和泛化能力。

Title: ReflexiCoder: Teaching Large Language Models to Self-Reflect on Generated Code and Self-Correct It via Reinforcement Learning

• Authors: Juyong Jiang, Jiasi Shen, Sunghun Kim, Kang Min Yoo, Jeonghoon Kim, Sungju Kim
• Subjects: cs.CL, cs.LG, cs.SE
• Abstract URL: https://arxiv.org/abs/2603.05863
• Pdf URL: https://arxiv.org/pdf/2603.05863
• Copy Paste: [[2603.05863]] ReflexiCoder: Teaching Large Language Models to Self-Reflect on Generated Code and Self-Correct It via Reinforcement Learning(https://arxiv.org/abs/2603.05863)
• Keywords: language model, gpt, llm, prompt
• Abstract: While Large Language Models (LLMs) have revolutionized code generation, standard "System 1" approaches, generating solutions in a single forward pass, often hit a performance ceiling when faced with complex algorithmic tasks. Existing iterative refinement strategies attempt to bridge this gap at inference time, yet they predominantly rely on external oracles, execution feedback, or computationally expensive prompt-response cycles. In this work, we propose ReflexiCoder, a novel reinforcement learning (RL) framework that internalizes the structured reasoning trajectory, encompassing initial generation, bug and optimization aware reflection, and self-correction, directly into the model's weights. Unlike prior methods, ReflexiCoder shifts the paradigm from external-dependent refinement to an intrinsic, fully autonomous self-reflection and self-correction capabilities at inference time. We utilize an RL-zero training paradigm with granular reward functions to optimize the entire reflection-correction trajectory, teaching the model how to debug without reliance on ground-truth feedback or execution engines at inference time. Extensive experiments across seven benchmarks demonstrate that our ReflexiCoder-8B establishes a new state-of-the-art (SOTA) among leading open-source models in the 1.5B-14B range, achieving 94.51% (87.20%) on HumanEval (Plus), 81.80% (78.57%) on MBPP (Plus), 35.00% on BigCodeBench, 52.21% on LiveCodeBench, and 37.34% on CodeForces in a single-attempt setting, rivaling or surpassing proprietary models like GPT-5.1. Notably, our framework is significantly more token-efficient than base models, reducing inference-time compute overhead by approximately 40% through disciplined, high-speed reasoning and reflection patterns. Source code is available at this https URL.
• 摘要：虽然大型语言模型 (LLM) 彻底改变了代码生成，但在单次前向传递中生成解决方案的标准“系统 1”方法在面对复杂的算法任务时通常会达到性能上限。现有的迭代细化策略试图在推理时弥补这一差距，但它们主要依赖于外部预言、执行反馈或计算成本昂贵的提示响应周期。在这项工作中，我们提出了 ReflexiCoder，一种新颖的强化学习 (RL) 框架，它将结构化推理轨迹（包括初始生成、错误和优化感知反射以及自我校正）直接内化到模型的权重中。与之前的方法不同，ReflexiCoder 将范式从依赖于外部的细化转变为推理时内在的、完全自主的自我反思和自我纠正能力。我们利用具有细粒度奖励函数的 RL-zero 训练范例来优化整个反射校正轨迹，教导模型如何在推理时不依赖真实反馈或执行引擎进行调试。跨越七个基准的大量实验表明，我们的 ReflexiCoder-8B 在 1.5B-14B 范围内领先的开源模型中建立了新的最先进 (SOTA)，在 HumanEval (Plus) 上实现了 94.51% (87.20%)，在 MBPP (Plus) 上实现了 81.80% (78.57%)，在 BigCodeBench 上实现了 35.00%，在单次尝试设置中，LiveCodeBench 上的得分为 52.21%，CodeForces 上的得分为 37.34%，可与 GPT-5.1 等专有模型相媲美或超越。值得注意的是，我们的框架比基本模型具有更高的令牌效率，通过规范的高速推理和反射模式将推理时间计算开销减少了约 40%。源代码可从此 https URL 获取。

Title: ROSE: Reordered SparseGPT for More Accurate One-Shot Large Language Models Pruning

• Authors: Mingluo Su, Huan Wang
• Subjects: cs.CL, cs.LG
• Abstract URL: https://arxiv.org/abs/2603.05878
• Pdf URL: https://arxiv.org/pdf/2603.05878
• Copy Paste: [[2603.05878]] ROSE: Reordered SparseGPT for More Accurate One-Shot Large Language Models Pruning(https://arxiv.org/abs/2603.05878)
• Keywords: language model, gpt, llm
• Abstract: Pruning is widely recognized as an effective method for reducing the parameters of large language models (LLMs), potentially leading to more efficient deployment and inference. One classic and prominent path of LLM one-shot pruning is to leverage second-order gradients (i.e., Hessian), represented by the pioneering work SparseGPT. However, the predefined left-to-right pruning order in SparseGPT leads to suboptimal performance when the weights exhibit columnar patterns. This paper studies the effect of pruning order under the SparseGPT framework. The analyses lead us to propose ROSE, a reordered SparseGPT method that prioritizes weights with larger potential pruning errors to be pruned earlier. ROSE first performs pre-pruning to identify candidate weights for removal, and estimates both column and block pruning loss. Subsequently, two-level reordering is performed: columns within each block are reordered in descending order of column loss, while blocks are reordered based on block loss. We introduce the relative range of block loss as a metric to identify columnar layers, enabling adaptive reordering across the entire model. Substantial empirical results on prevalent LLMs (LLaMA2-7B/13B/70B, LLaMA3-8B, Mistral-7B) demonstrate that ROSE surpasses the original SparseGPT and other counterpart pruning methods. Our code is available at this https URL.
• 摘要：剪枝被广泛认为是减少大型语言模型（LLM）参数的有效方法，可能会导致更有效的部署和推理。 LLM一次性剪枝的一个经典且突出的路径是利用二阶梯度（即Hessian），以开创性工作SparseGPT为代表。然而，当权重呈现柱状模式时，SparseGPT 中预定义的从左到右的剪枝顺序会导致性能不佳。本文研究了SparseGPT框架下剪枝顺序的影响。这些分析促使我们提出 ROSE，这是一种重新排序的 SparseGPT 方法，它优先考虑具有较大潜在剪枝误差的权重，以便更早地剪枝。 ROSE 首先执行预剪枝以确定要删除的候选权重，并估计列和块剪枝损失。随后，执行两级重新排序：每个块内的列按列丢失的降序重新排序，而块则根据块丢失重新排序。我们引入块损失的相对范围作为识别柱状层的指标，从而实现整个模型的自适应重新排序。对流行的 LLM（LLaMA2-7B/13B/70B、LLaMA3-8B、Mistral-7B）的大量实证结果表明，ROSE 超越了原始的 SparseGPT 和其他对应的剪枝方法。我们的代码可以在这个 https URL 上找到。

Title: Confidence Before Answering: A Paradigm Shift for Efficient LLM Uncertainty Estimation

• Authors: Changcheng Li, Jiancan Wu, Hengheng Zhang, Zhengsu Chen, Guo An, Junxiang Qiu, Xiang Wang, Qi Tian
• Subjects: cs.CL
• Abstract URL: https://arxiv.org/abs/2603.05881
• Pdf URL: https://arxiv.org/pdf/2603.05881
• Copy Paste: [[2603.05881]] Confidence Before Answering: A Paradigm Shift for Efficient LLM Uncertainty Estimation(https://arxiv.org/abs/2603.05881)
• Keywords: language model, llm
• Abstract: Reliable deployment of large language models (LLMs) requires accurate uncertainty estimation. Existing methods are predominantly answer-first, producing confidence only after generating an answer, which measure the correctness of a specific response and limits practical usability. We study a confidence-first paradigm, where the model outputs its confidence before answering, interpreting this score as the model's probability of answering the question correctly under its current policy. We propose CoCA(Co-optimized Confidence and Answers), a GRPO reinforcement learning framework that jointly optimizes confidence calibration and answer accuracy via segmented credit assignment. By assigning separate rewards and group-relative advantages to confidence and answer segments, CoCA enables stable joint optimization and avoids reward hacking. Experiments across math, code, and factual QA benchmarks show improved calibration and uncertainty discrimination while preserving answer quality, thereby enabling a broader range of downstream applications.
• 摘要：大型语言模型 (LLM) 的可靠部署需要准确的不确定性估计。现有方法主要是答案优先，仅在生成答案后才产生置信度，这衡量特定响应的正确性并限制实际可用性。我们研究置信度优先的范式，其中模型在回答之前输出其置信度，将该分数解释为模型在当前策略下正确回答问题的概率。我们提出了 CoCA（Co-optimized Confidence and Answers），一种 GRPO 强化学习框架，通过分段学分分配联合优化置信度校准和答案准确性。通过将单独的奖励和群体相对优势分配给置信度和答案部分，CoCA 可以实现稳定的联合优化并避免奖励黑客攻击。数学、代码和事实 QA 基准的实验表明，在保持答案质量的同时，校准和不确定性辨别能力得到了改善，从而实现了更广泛的下游应用。

Title: VerChol -- Grammar-First Tokenization for Agglutinative Languages

• Authors: Prabhu Raja
• Subjects: cs.CL
• Abstract URL: https://arxiv.org/abs/2603.05883
• Pdf URL: https://arxiv.org/pdf/2603.05883
• Copy Paste: [[2603.05883]] VerChol -- Grammar-First Tokenization for Agglutinative Languages(https://arxiv.org/abs/2603.05883)
• Keywords: language model, llm
• Abstract: Tokenization is the foundational step in all large language model (LLM) pipelines, yet the dominant approach Byte Pair Encoding (BPE) and its variants is inherently script agnostic and optimized for English like morphology. For agglutinative languages a typological class encompassing the Dravidian family (Tamil, Kannada, Telugu, Malayalam), Turkic languages (Turkish, Azerbaijani, Uzbek), Uralic languages (Finnish, Hungarian, Estonian), Korean, Japanese, Swahili, Basque, and others, a single word may encode root, tense, aspect, person, number, gender agreement, case, and postpositions into one orthographic unit. Statistical tokenizers fragment these words into byte pair chunks that sever morpheme boundaries and inflate token counts.
• 摘要：标记化是所有大型语言模型 (LLM) 流程中的基础步骤，但占主导地位的方法字节对编码 (BPE) 及其变体本质上与脚本无关，并针对类似英语的形态进行了优化。对于包含德拉威语系（泰米尔语、卡纳达语、泰卢固语、马拉雅拉姆语）、突厥语系（土耳其语、阿塞拜疆语、乌兹别克语）、乌拉尔语系（芬兰语、匈牙利语、爱沙尼亚语）、韩语、日语、斯瓦希里语、巴斯克语等的粘着语言，单个单词可以将词根、时态、体、人称、数字、性别一致、格和后置词编码为一个拼字法单位。统计标记器将这些单词分割成字节对块，从而切断语素边界并增加标记计数。

Title: Lost in Stories: Consistency Bugs in Long Story Generation by LLMs

• Authors: Junjie Li, Xinrui Guo, Yuhao Wu, Roy Ka-Wei Lee, Hongzhi Li, Yutao Xie
• Subjects: cs.CL, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.05890
• Pdf URL: https://arxiv.org/pdf/2603.05890
• Copy Paste: [[2603.05890]] Lost in Stories: Consistency Bugs in Long Story Generation by LLMs(https://arxiv.org/abs/2603.05890)
• Keywords: language model, llm, prompt
• Abstract: What happens when a storyteller forgets its own story? Large Language Models (LLMs) can now generate narratives spanning tens of thousands of words, but they often fail to maintain consistency throughout. When generating long-form narratives, these models can contradict their own established facts, character traits, and world rules. Existing story generation benchmarks focus mainly on plot quality and fluency, leaving consistency errors largely unexplored. To address this gap, we present ConStory-Bench, a benchmark designed to evaluate narrative consistency in long-form story generation. It contains 2,000 prompts across four task scenarios and defines a taxonomy of five error categories with 19 fine-grained subtypes. We also develop ConStory-Checker, an automated pipeline that detects contradictions and grounds each judgment in explicit textual evidence. Evaluating a range of LLMs through five research questions, we find that consistency errors show clear tendencies: they are most common in factual and temporal dimensions, tend to appear around the middle of narratives, occur in text segments with higher token-level entropy, and certain error types tend to co-occur. These findings can inform future efforts to improve consistency in long-form narrative generation. Our project page is available at this https URL.
• 摘要：当讲故事的人忘记自己的故事时会发生什么？大型语言模型 (LLM) 现在可以生成跨越数万个单词的叙述，但它们往往无法保持整个过程的一致性。当生成长篇叙事时，这些模型可能与它们自己既定的事实、性格特征和世界规则相矛盾。现有的故事生成基准主要关注情节质量和流畅性，而很大程度上未探索一致性错误。为了解决这一差距，我们提出了 ConStory-Bench，这是一个旨在评估长篇故事生成中叙事一致性的基准。它包含跨越 4 个任务场景的 2,000 个提示，并定义了 5 个错误类别和 19 个细粒度子类型的分类法。我们还开发了 ConStory-Checker，这是一种自动管道，可以检测矛盾并以明确的文本证据为基础做出每个判断。通过五个研究问题评估一系列法学硕士，我们发现一致性错误表现出明显的趋势：它们在事实和时间维度上最常见，往往出现在叙述的中间，出现在具有较高标记级熵的文本片段中，并且某些错误类型往往同时出现。这些发现可以为未来提高长篇叙事生成一致性的努力提供信息。我们的项目页面可通过此 https URL 获取。

Title: Building an Ensemble LLM Semantic Tagger for UN Security Council Resolutions

• Authors: Hussein Ghaly
• Subjects: cs.CL
• Abstract URL: https://arxiv.org/abs/2603.05895
• Pdf URL: https://arxiv.org/pdf/2603.05895
• Copy Paste: [[2603.05895]] Building an Ensemble LLM Semantic Tagger for UN Security Council Resolutions(https://arxiv.org/abs/2603.05895)
• Keywords: gpt, llm, hallucination
• Abstract: This paper introduces a new methodology for using LLM-based systems for accurate and efficient semantic tagging of UN Security Council resolutions. The main goal is to leverage LLM performance variability to build ensemble systems for data cleaning and semantic tagging tasks. We introduce two evaluation metrics: Content Preservation Ratio (CPR) and Tag Well-Formedness (TWF), in order to avoid hallucinations and unnecessary additions or omissions to the input text beyond the task requirement. These metrics allow the selection of the best output from multiple runs of several GPT models. GPT-4.1 achieved the highest metrics for both tasks (Cleaning: CPR 84.9% - Semantic Tagging: CPR 99.99% and TWF 99.92%). In terms of cost, smaller models, such as GPT-4.1-mini, achieved comparable performance to the best model in each task at only 20% of the cost. These metrics ultimately allowed the ensemble to select the optimal output (both cleaned and tagged content) for all the LLM models involved, across multiple runs. With this ensemble design and the use of metrics, we create a reliable LLM system for performing semantic tagging on challenging texts.
• 摘要：本文介绍了一种使用基于法学硕士的系统对联合国安理会决议进行准确有效的语义标记的新方法。主要目标是利用 LLM 性能的可变性来构建用于数据清理和语义标记任务的集成系统。我们引入了两个评估指标：内容保留率（CPR）和标签格式正确性（TWF），以避免出现幻觉以及超出任务要求对输入文本进行不必要的添加或省略。这些指标允许从多个 GPT 模型的多次运行中选择最佳输出。 GPT-4.1 在两项任务上均取得了最高指标（清洁：CPR 84.9% - 语义标记：CPR 99.99% 和 TWF 99.92%）。在成本方面，较小的模型，例如 GPT-4.1-mini，在每项任务中以 20% 的成本实现了与最佳模型相当的性能。这些指标最终使团队能够在多次运行中为所有涉及的 LLM 模型选择最佳输出（包括清理内容和标记内容）。通过这种整体设计和指标的使用，我们创建了一个可靠的法学硕士系统，用于对具有挑战性的文本执行语义标记。

Title: InfoGatherer: Principled Information Seeking via Evidence Retrieval and Strategic Questioning

• Authors: Maksym Taranukhin, Shuyue Stella Li, Evangelos Milios, Geoff Pleiss, Yulia Tsvetkov, Vered Shwartz
• Subjects: cs.CL
• Abstract URL: https://arxiv.org/abs/2603.05909
• Pdf URL: https://arxiv.org/pdf/2603.05909
• Copy Paste: [[2603.05909]] InfoGatherer: Principled Information Seeking via Evidence Retrieval and Strategic Questioning(https://arxiv.org/abs/2603.05909)
• Keywords: llm
• Abstract: LLMs are increasingly deployed in high-stakes domains such as medical triage and legal assistance, often as document-grounded QA systems in which a user provides a description, relevant sources are retrieved, and an LLM generates a prediction. In practice, initial user queries are often underspecified, and a single retrieval pass is insufficient for reliable decision-making, leading to incorrect and overly confident answers. While follow-up questioning can elicit missing information, existing methods typically depend on implicit, unstructured confidence signals from the LLM, making it difficult to determine what remains unknown, what information matters most, and when to stop asking questions. We propose InfoGatherer, a framework that gathers missing information from two complementary sources: retrieved domain documents and targeted follow-up questions to the user. InfoGatherer models uncertainty using Dempster-Shafer belief assignments over a structured evidential network, enabling principled fusion of incomplete and potentially contradictory evidence from both sources without prematurely collapsing to a definitive answer. Across legal and medical tasks, InfoGatherer outperforms strong baselines while requiring fewer turns. By grounding uncertainty in formal evidential theory rather than heuristic LLM signals, InfoGatherer moves towards trustworthy, interpretable decision support in domains where reliability is critical.
• 摘要：法学硕士越来越多地部署在医疗分诊和法律援助等高风险领域，通常作为基于文档的质量保证系统，用户在其中提供描述，检索相关来源，然后法学硕士生成预测。在实践中，初始用户查询通常不明确，并且单个检索过程不足以做出可靠的决策，从而导致错误且过于自信的答案。虽然后续提问可能会引出缺失的信息，但现有方法通常依赖于法学硕士的隐式、非结构化置信信号，因此很难确定哪些信息仍然未知、哪些信息最重要以及何时停止提问。我们提出了 InfoGatherer，这是一个从两个互补来源收集缺失信息的框架：检索到的领域文档和针对用户的有针对性的后续问题。 InfoGatherer 使用 Dempster-Shafer 信念分配在结构化证据网络上对不确定性进行建模，从而能够原则性地融合来自两个来源的不完整且可能相互矛盾的证据，而不会过早地崩溃为明确的答案。在法律和医疗任务中，InfoGatherer 的性能优于强大的基线，同时需要更少的轮次。通过将不确定性植根于正式的证据理论而不是启发式的法学硕士信号中，InfoGatherer 在可靠性至关重要的领域向值得信赖、可解释的决策支持迈进。

Title: Learning Next Action Predictors from Human-Computer Interaction

• Authors: Omar Shaikh, Valentin Teutschbein, Kanishk Gandhi, Yikun Chi, Nick Haber, Thomas Robinson, Nilam Ram, Byron Reeves, Sherry Yang, Michael S. Bernstein, Diyi Yang
• Subjects: cs.CL, cs.HC
• Abstract URL: https://arxiv.org/abs/2603.05923
• Pdf URL: https://arxiv.org/pdf/2603.05923
• Copy Paste: [[2603.05923]] Learning Next Action Predictors from Human-Computer Interaction(https://arxiv.org/abs/2603.05923)
• Keywords: language model, llm, prompt
• Abstract: Truly proactive AI systems must anticipate what we will do next. This foresight demands far richer information than the sparse signals we type into our prompts -- it demands reasoning over the entire context of what we see and do. We formalize this as next action prediction (NAP): given a sequence of a user's multimodal interactions with a computer (screenshots, clicks, sensor data), predict that user's next action. Progress on this task requires both new data and modeling approaches. To scale data, we annotate longitudinal, naturalistic computer use with vision-language models. We release an open-source pipeline for performing this labeling on private infrastructure, and label over 360K actions across one month of continuous phone usage from 20 users, amounting to 1,800 hours of screen time. We then introduce LongNAP, a user model that combines parametric and in-context learning to reason over long interaction histories. LongNAP is trained via policy gradient methods to generate user-specific reasoning traces given some context; retrieve relevant traces from a library of past traces; and then apply retrieved traces in-context to predict future actions. Using an LLM-as-judge evaluation metric (0-1 similarity to ground truth), LongNAP significantly outperforms supervised finetuning and prompted baselines on held-out data (by 79% and 39% respectively). Additionally, LongNAP generalizes to held out users when trained across individuals. The space of next actions a user might take at any moment is unbounded, spanning thousands of possible outcomes. Despite this, 17.1% of LongNAP's predicted trajectories are well-aligned with what a user does next (LLM-judge score $\geq$ 0.5). This rises to 26% when we filter to highly confident predictions. In sum, we argue that learning from the full context of user behavior to anticipate user needs is now a viable task with substantial opportunity.
• 摘要：真正主动的人工智能系统必须预测我们下一步将做什么。这种远见需要比我们在提示中输入的稀疏信号更丰富的信息——它需要对我们所看到和所做的整个上下文进行推理。我们将其形式化为下一步行动预测（NAP）：给定用户与计算机的多模式交互序列（屏幕截图、点击、传感器数据），预测用户的下一步行动。这项任务的进展需要新的数据和建模方法。为了扩展数据，我们使用视觉语言模型来注释纵向、自然的计算机使用。我们发布了一个开源管道，用于在私有基础设施上执行此标记，并标记 20 个用户一个月连续使用手机的超过 36 万个操作，总计 1,800 小时的屏幕时间。然后，我们介绍 LongNAP，这是一种用户模型，它将参数化学习和上下文学习相结合，对长期交互历史进行推理。 LongNAP 通过策略梯度方法进行训练，以在给定某些上下文的情况下生成特定于用户的推理轨迹；从过去痕迹库中检索相关痕迹；然后在上下文中应用检索到的跟踪来预测未来的操作。使用 LLM 作为法官的评估指标（与真实情况的 0-1 相似度），LongNAP 显着优于监督微调，并提示保留数据的基线（分别提高了 79% 和 39%）。此外，LongNAP 在跨个人训练时可以推广到支持用户。用户在任何时刻可能采取的下一步行动的空间是无限的，涵盖数千种可能的结果。尽管如此，LongNAP 的预测轨迹中有 17.1% 与用户下一步的行为非常一致（法学硕士评审分数 $\geq$ 0.5）。当我们筛选出高度可信的预测时，这一比例会上升至 26%。总而言之，我们认为从用户行为的完整背景中学习来预测用户需求现在是一项具有大量机会的可行任务。

Title: Addressing the Ecological Fallacy in Larger LMs with Human Context

• Authors: Nikita Soni, Dhruv Vijay Kunjadiya, Pratham Piyush Shah, Dikshya Mohanty, H. Andrew Schwartz, Niranjan Balasubramanian
• Subjects: cs.CL, cs.AI, cs.HC, cs.LG
• Abstract URL: https://arxiv.org/abs/2603.05928
• Pdf URL: https://arxiv.org/pdf/2603.05928
• Copy Paste: [[2603.05928]] Addressing the Ecological Fallacy in Larger LMs with Human Context(https://arxiv.org/abs/2603.05928)
• Keywords: language model, gpt
• Abstract: Language model training and inference ignore a fundamental linguistic fact -- there is a dependence between multiple sequences of text written by the same person. Prior work has shown that addressing this form of \textit{ecological fallacy} can greatly improve the performance of multiple smaller (~124M) GPT-based models. In this work, we ask if addressing the ecological fallacy by modeling the author's language context with a specific LM task (called HuLM) can provide similar benefits for a larger-scale model, an 8B Llama model. To this end, we explore variants that process an author's language in the context of their other temporally ordered texts. We study the effect of pre-training with this author context using the HuLM objective, as well as using it during fine-tuning with author context (\textit{HuFT:Human-aware Fine-Tuning}). Empirical comparisons show that addressing the ecological fallacy during fine-tuning alone using QLoRA improves the performance of the larger 8B model over standard fine-tuning. Additionally, QLoRA-based continued HuLM pre-training results in a human-aware model generalizable for improved performance over eight downstream tasks with linear task classifier training alone. These results indicate the utility and importance of modeling language in the context of its original generators, the authors.
• 摘要：语言模型训练和推理忽略了一个基本的语言事实——同一个人编写的多个文本序列之间存在依赖关系。先前的工作表明，解决这种形式的 \textit{生态谬误} 可以极大地提高多个较小（~124M）基于 GPT 的模型的性能。在这项工作中，我们询问通过使用特定的 LM 任务（称为 HuLM）对作者的语言上下文进行建模来解决生态谬误是否可以为更大规模的模型（8B Llama 模型）提供类似的好处。为此，我们探索在其他时间顺序文本的上下文中处理作者语言的变体。我们使用 HuLM 目标研究了使用该作者上下文进行预训练的效果，以及在使用作者上下文进行微调时使用它（\textit{HuFT:Human-aware Fine-Tuning}）。经验比较表明，与标准微调相比，仅使用 QLoRA 解决微调过程中的生态谬误可以提高更大 8B 模型的性能。此外，基于 QLoRA 的持续 HuLM 预训练产生了一个人类感知模型，该模型可推广到仅通过线性任务分类器训练即可提高八个下游任务的性能。这些结果表明了建模语言在其原始生成器（即作者）的背景下的实用性和重要性。

Title: Implicit Style Conditioning: A Structured Style-Rewrite Framework for Low-Resource Character Modeling

• Authors: Chanhui Zhu
• Subjects: cs.CL, cs.LG
• Abstract URL: https://arxiv.org/abs/2603.05933
• Pdf URL: https://arxiv.org/pdf/2603.05933
• Copy Paste: [[2603.05933]] Implicit Style Conditioning: A Structured Style-Rewrite Framework for Low-Resource Character Modeling(https://arxiv.org/abs/2603.05933)
• Keywords: language model, llm, chain-of-thought
• Abstract: Large Language Models (LLMs) have demonstrated impressive capabilities in role-playing (RP); however, small Language Models (SLMs) with highly stylized personas remains a challenge due to data scarcity and the complexity of style disentanglement. Standard Supervised Fine-Tuning (SFT) often captures surface-level semantics while failing to reproduce the intricate syntactic and pragmatic nuances of a character, leading to "Out-Of-Character" (OOC) generation. To address this, we propose a Structured Style-Rewrite Framework that explicitly disentangles style into three interpretable dimensions: lexical signatures (via PMI), syntactic patterns (grounded in PCFG rules), and pragmatic style. Furthermore, we introduce an implicit style conditioning strategy via Chain-of-Thought (CoT) distillation. By leveraging explicit reasoning traces during training as a strong inductive bias, our approach aligns the model's latent representations with structured style features, enabling high-fidelity stylized generation without requiring explicit reasoning tokens during inference. Extensive experiments on a specific high-stylization domain (anime characters) demonstrate that our method enables a Qwen-1.7B model to outperform significantly larger baselines (e.g., 4B Vanilla SFT) in style consistency and semantic fidelity. Our approach offers a data-efficient paradigm for democratizing inference and deployment on consumer hardware.
• 摘要：大型语言模型 (LLM) 在角色扮演 (RP) 方面表现出了令人印象深刻的能力；然而，由于数据稀缺和风格分解的复杂性，具有高度风格化角色的小型语言模型（SLM）仍然是一个挑战。标准监督微调 (SFT) 通常会捕获表面级别的语义，但无法重现字符复杂的句法和语用细微差别，从而导致“不符合字符”(OOC) 的生成。为了解决这个问题，我们提出了一个结构化风格重写框架，该框架将风格明确地分解为三个可解释的维度：词汇签名（通过 PMI）、句法模式（基于 PCFG 规则）和实用风格。此外，我们通过思想链（CoT）蒸馏引入了隐式风格调节策略。通过在训练期间利用显式推理轨迹作为强归纳偏差，我们的方法将模型的潜在表示与结构化风格特征相结合，从而实现高保真风格化生成，而无需在推理期间使用显式推理标记。对特定高风格化领域（动漫角色）的大量实验表明，我们的方法使 Qwen-1.7B 模型在风格一致性和语义保真度方面优于更大的基线（例如 4B Vanilla SFT）。我们的方法提供了一种数据高效的范例，使消费者硬件上的推理和部署民主化。

Title: Who We Are, Where We Are: Mental Health at the Intersection of Person, Situation, and Large Language Models

• Authors: Nikita Soni, August Håkan Nilsson, Syeda Mahwish, Vasudha Varadarajan, H. Andrew Schwartz, Ryan L. Boyd
• Subjects: cs.CL, cs.AI, cs.HC, cs.LG
• Abstract URL: https://arxiv.org/abs/2603.05953
• Pdf URL: https://arxiv.org/pdf/2603.05953
• Copy Paste: [[2603.05953]] Who We Are, Where We Are: Mental Health at the Intersection of Person, Situation, and Large Language Models(https://arxiv.org/abs/2603.05953)
• Keywords: language model
• Abstract: Mental health is not a fixed trait but a dynamic process shaped by the interplay between individual dispositions and situational contexts. Building on interactionist and constructionist psychological theories, we develop interpretable models to predict well-being and identify adaptive and maladaptive self-states in longitudinal social media data. Our approach integrates person-level psychological traits (e.g., resilience, cognitive distortions, implicit motives) with language-inferred situational features derived from the Situational 8 DIAMONDS framework. We compare these theory-grounded features to embeddings from a psychometrically-informed language model that captures temporal and individual-specific patterns. Results show that our principled, theory-driven features provide competitive performance while offering greater interpretability. Qualitative analyses further highlight the psychological coherence of features most predictive of well-being. These findings underscore the value of integrating computational modeling with psychological theory to assess dynamic mental states in contextually sensitive and human-understandable ways.
• 摘要：心理健康不是一个固定的特征，而是一个由个人性格和情境之间相互作用形成的动态过程。基于互动主义和建构主义心理学理论，我们开发了可解释的模型来预测幸福感并识别纵向社交媒体数据中的适应性和适应不良的自我状态。我们的方法将个人心理特征（例如，复原力、认知扭曲、隐性动机）与源自情景 8 DIAMONDS 框架的语言推断情景特征相结合。我们将这些基于理论的特征与来自心理测量信息语言模型的嵌入进行比较，该模型捕获时间和个人特定的模式。结果表明，我们原则性的、理论驱动的功能提供了具有竞争力的性能，同时提供了更大的可解释性。定性分析进一步强调了最能预测幸福感的特征的心理一致性。这些发现强调了将计算模型与心理学理论相结合，以上下文敏感和人类可理解的方式评估动态心理状态的价值。

Title: Track-SQL: Enhancing Generative Language Models with Dual-Extractive Modules for Schema and Context Tracking in Multi-turn Text-to-SQL

• Authors: Bingfeng Chen, Shaobin Shi, Yongqi Luo, Boyan Xu, Ruichu Cai, Zhifeng Hao
• Subjects: cs.CL
• Abstract URL: https://arxiv.org/abs/2603.05996
• Pdf URL: https://arxiv.org/pdf/2603.05996
• Copy Paste: [[2603.05996]] Track-SQL: Enhancing Generative Language Models with Dual-Extractive Modules for Schema and Context Tracking in Multi-turn Text-to-SQL(https://arxiv.org/abs/2603.05996)
• Keywords: language model
• Abstract: Generative language models have shown significant potential in single-turn Text-to-SQL. However, their performance does not extend equivalently to multi-turn Text-to-SQL. This is primarily due to generative language models' inadequacy in handling the complexities of context information and dynamic schema linking in multi-turn interactions. In this paper, we propose a framework named Track-SQL, which enhances generative language models with dual-extractive modules designed to track schema and contextual changes in multi-turn Text-to-SQL. Specifically, Track-SQL incorporates a \emph{Semantic-enhanced Schema Extractor} and a \emph{Schema-aware Context Extractor}. Experimental results demonstrate that Track-SQL achieves state-of-the-art performance on the SparC and CoSQL datasets. Furthermore, detailed ablation studies reveal that Track-SQL significantly improves execution accuracy in multi-turn interactions by 7.1\% and 9.55\% on these datasets, respectively. Our implementation will be open-sourced at this https URL.
• 摘要：生成语言模型在单轮文本到 SQL 方面显示出了巨大的潜力。然而，它们的性能并不等同于多轮文本到 SQL。这主要是由于生成语言模型在处理多轮交互中的上下文信息和动态模式链接的复杂性方面的不足。在本文中，我们提出了一个名为 Track-SQL 的框架，它通过双提取模块增强了生成语言模型，该模块旨在跟踪多轮文本到 SQL 中的模式和上下文变化。具体来说，Track-SQL 包含一个 \emph{语义增强模式提取器} 和一个 \emph{模式感知上下文提取器}。实验结果表明，Track-SQL 在 SparC 和 CoSQL 数据集上实现了最先进的性能。此外，详细的消融研究表明，Track-SQL 在这些数据集上分别显着提高了多轮交互的执行准确性，分别提高了 7.1% 和 9.55%。我们的实现将在此 https URL 上开源。

Title: MASFactory: A Graph-centric Framework for Orchestrating LLM-Based Multi-Agent Systems with Vibe Graphing

• Authors: Yang Liu, Jinxuan Cai, Yishen Li, Qi Meng, Zedi Liu, Xin Li, Chen Qian, Chuan Shi, Cheng Yang
• Subjects: cs.CL, cs.AI, cs.MA
• Abstract URL: https://arxiv.org/abs/2603.06007
• Pdf URL: https://arxiv.org/pdf/2603.06007
• Copy Paste: [[2603.06007]] MASFactory: A Graph-centric Framework for Orchestrating LLM-Based Multi-Agent Systems with Vibe Graphing(https://arxiv.org/abs/2603.06007)
• Keywords: language model, llm, agent
• Abstract: Large language model-based (LLM-based) multi-agent systems (MAS) are increasingly used to extend agentic problem solving via role specialization and collaboration. MAS workflows can be naturally modeled as directed computation graphs, where nodes execute agents/sub-workflows and edges encode dependencies and message passing. However, implementing complex graph workflows in current frameworks still requires substantial manual effort, offers limited reuse, and makes it difficult to integrate heterogeneous external context sources. To overcome these limitations, we present MASFactory, a graph-centric framework for orchestrating LLM-based MAS. It introduces Vibe Graphing, a human-in-the-loop approach that compiles natural-language intent into an editable workflow specification and then into an executable graph. In addition, the framework provides reusable components and pluggable context integration, as well as a visualizer for topology preview, runtime tracing, and human-in-the-loop interaction. We evaluate MASFactory on seven public benchmarks, validating both reproduction consistency for representative MAS methods and the effectiveness of Vibe Graphing. Our code (this https URL) and video (this https URL) are publicly available.
• 摘要：基于大型语言模型（基于 LLM）的多代理系统（MAS）越来越多地用于通过角色专业化和协作来扩展代理问题解决。 MAS 工作流可以自然地建模为有向计算图，其中节点执行代理/子工作流，边对依赖关系和消息传递进行编码。然而，在当前框架中实现复杂的图形工作流程仍然需要大量的手动工作，提供的重用性有限，并且很难集成异构外部上下文源。为了克服这些限制，我们提出了 MASFactory，一个以图为中心的框架，用于编排基于 LLM 的 MAS。它引入了 Vibe Graphing，这是一种人机交互方法，可将自然语言意图编译为可编辑的工作流程规范，然后编译为可执行图形。此外，该框架还提供可重用组件和可插入上下文集成，以及用于拓扑预览、运行时跟踪和人机交互交互的可视化工具。我们根据七个公共基准评估 MASFactory，验证代表性 MAS 方法的再现一致性和 Vibe Graphing 的有效性。我们的代码（此 https URL）和视频（此 https URL）是公开可用的。

Title: ViewFusion: Structured Spatial Thinking Chains for Multi-View Reasoning

• Authors: Xingjian Tao, Yiwei Wang, Yujun Cai, Yifan Song, Jing Tang
• Subjects: cs.CL, cs.CV
• Abstract URL: https://arxiv.org/abs/2603.06024
• Pdf URL: https://arxiv.org/pdf/2603.06024
• Copy Paste: [[2603.06024]] ViewFusion: Structured Spatial Thinking Chains for Multi-View Reasoning(https://arxiv.org/abs/2603.06024)
• Keywords: language model
• Abstract: Multi-view spatial reasoning remains difficult for current vision-language models. Even when multiple viewpoints are available, models often underutilize cross-view relations and instead rely on single-image shortcuts, leading to fragile performance on viewpoint transformation and occlusion-sensitive cases. We present ViewFusion, a two-stage framework that explicitly separates cross-view spatial pre-alignment from question answering. In the first stage, the model performs deliberate spatial pre-thinking to infer viewpoint relations and spatial transformations across views, forming an intermediate workspace that goes beyond a simple re-description. In the second stage, the model conducts question-driven reasoning conditioned on this workspace to produce the final prediction. We train ViewFusion with synthetic reasoning supervision followed by reinforcement learning using GRPO, which improves answer correctness while stabilizing the intended two-stage generation behavior. On MMSI-Bench, ViewFusion improves accuracy by 5.3\% over Qwen3-VL-4B-Instruct, with the largest gains on examples that require genuine cross-view alignment.
• 摘要：对于当前的视觉语言模型来说，多视图空间推理仍然很困难。即使有多个视点可用，模型通常也没有充分利用跨视图关系，而是依赖于单图像快捷方式，导致视点转换和遮挡敏感情况下的性能脆弱。我们提出了 ViewFusion，一个两阶段的框架，它明确地将跨视图空间预对齐与问题回答分开。在第一阶段，模型执行深思熟虑的空间预先思考，以推断视点关系和视图之间的空间变换，形成一个超越简单重新描述的中间工作空间。在第二阶段，模型在此工作空间上进行问题驱动推理以产生最终预测。我们通过综合推理监督训练 ViewFusion，然后使用 GRPO 进行强化学习，这提高了答案的正确性，同时稳定了预期的两阶段生成行为。在 MMSI-Bench 上，ViewFusion 比 Qwen3-VL-4B-Instruct 的准确度提高了 5.3%，在需要真正跨视图对齐的示例中获得最大收益。

Title: Evaluating Austrian A-Level German Essays with Large Language Models for Automated Essay Scoring

• Authors: Jonas Kubesch, Lena Huber, Clemens Havas
• Subjects: cs.CL, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.06066
• Pdf URL: https://arxiv.org/pdf/2603.06066
• Copy Paste: [[2603.06066]] Evaluating Austrian A-Level German Essays with Large Language Models for Automated Essay Scoring(https://arxiv.org/abs/2603.06066)
• Keywords: language model, llm, prompt
• Abstract: Automated Essay Scoring (AES) has been explored for decades with the goal to support teachers by reducing grading workload and mitigating subjective biases. While early systems relied on handcrafted features and statistical models, recent advances in Large Language Models (LLMs) have made it possible to evaluate student writing with unprecedented flexibility. This paper investigates the application of state-of-the-art open-weight LLMs for the grading of Austrian A-level German texts, with a particular focus on rubric-based evaluation. A dataset of 101 anonymised student exams across three text types was processed and evaluated. Four LLMs, DeepSeek-R1 32b, Qwen3 30b, Mixtral 8x7b and LLama3.3 70b, were evaluated with different contexts and prompting strategies. The LLMs were able to reach a maximum of 40.6% agreement with the human rater in the rubric-provided sub-dimensions, and only 32.8% of final grades matched the ones given by a human expert. The results indicate that even though smaller models are able to use standardised rubrics for German essay grading, they are not accurate enough to be used in a real-world grading environment.
• 摘要：论文自动评分 (AES) 已经被探索了数十年，其目标是通过减少评分工作量和减轻主观偏见来支持教师。虽然早期的系统依赖于手工制作的特征和统计模型，但大型语言模型 (LLM) 的最新进展使得以前所未有的灵活性评估学生写作成为可能。本文研究了最先进的开放权重法学硕士在奥地利 A-level 德语文本评分中的应用，特别关注基于评分标准的评估。对涵盖三种文本类型的 101 份匿名学生考试数据集进行了处理和评估。四个法学硕士（DeepSeek-R1 32b、Qwen3 30b、Mixtral 8x7b 和 LLama3.3 70b）在不同的背景和提示策略下进行了评估。法学硕士能够在评分细则提供的子维度上与人类评分者达成最多 40.6% 的一致性，并且只有 32.8% 的最终评分与人类专家给出的评分相匹配。结果表明，尽管较小的模型能够使用标准化的评分标准进行德语论文评分，但它们不够准确，无法在现实世界的评分环境中使用。

Title: Experiences Build Characters: The Linguistic Origins and Functional Impact of LLM Personality

• Authors: Xi Wang, Mengdie Zhuang, Jiqun Liu
• Subjects: cs.CL, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.06088
• Pdf URL: https://arxiv.org/pdf/2603.06088
• Copy Paste: [[2603.06088]] Experiences Build Characters: The Linguistic Origins and Functional Impact of LLM Personality(https://arxiv.org/abs/2603.06088)
• Keywords: language model, llm
• Abstract: Human problem-solving is enriched by a diversity of styles and personality traits, yet the development of Large Language Models (LLMs) has largely prioritized uniform performance benchmarks that favour specific behavioural tendencies such as assertiveness. To investigate how diverse experiences shape machine personality and influence problem-solving, this study employs continued pre-training to expose models to domain-specific texts in an unsupervised manner, simulating the accumulation of experience. By adapting the Big Five framework via the Machine Personality Inventory (MPI), we quantify the personality traits of these model variants and analyse their relationship to linguistic style and reasoning behaviour. The findings reveal that model competence is bimodal, peaking at "Expressive Generalists" and "Suppressed Specialists," while identifying a "Suppression Advantage" where reduced social traits enhance complex reasoning performance. This study further establishes a causal link between training data linguistics, such as imperative frequency, and lexical diversity, providing a roadmap for "Personality Engineering".
• 摘要：人类解决问题的能力因风格和个性特征的多样性而丰富，但大型语言模型（LLM）的发展在很大程度上优先考虑了统一的绩效基准，这些基准有利于特定的行为倾向，例如自信。为了研究不同的经历如何塑造机器个性并影响问题解决，本研究采用持续的预训练，以无监督的方式将模型暴露于特定领域的文本，模拟经验的积累。通过机器个性量表（MPI）调整大五框架，我们量化了这些模型变体的个性特征，并分析了它们与语言风格和推理行为的关系。研究结果表明，模型能力是双峰的，在“表达通才”和“抑制专家”方面达到顶峰，同时确定了“抑制优势”，即减少的社会特征增强了复杂的推理能力。这项研究进一步建立了训练数据语言学（例如命令频率）和词汇多样性之间的因果联系，为“人格工程”提供了路线图。

Title: Making Implicit Premises Explicit in Logical Understanding of Enthymemes

• Authors: Xuyao Feng, Anthony Hunter
• Subjects: cs.CL, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.06114
• Pdf URL: https://arxiv.org/pdf/2603.06114
• Copy Paste: [[2603.06114]] Making Implicit Premises Explicit in Logical Understanding of Enthymemes(https://arxiv.org/abs/2603.06114)
• Keywords: language model, llm
• Abstract: Real-world arguments in text and dialogues are normally enthymemes (i.e. some of their premises and/or claims are implicit). Natural language processing (NLP) methods for handling enthymemes can potentially identify enthymemes in text but they do not decode their underlying logic, whereas logic-based approaches for handling them assume a knowledgebase with sufficient formulae that can be used to decode them via abduction. There is therefore a lack of a systematic method for translating textual components of an enthymeme into a logical argument and generating the logical formulae required for their decoding, and thereby showing logical entailment. To address this, we propose a pipeline that integrates: (1) a large language model (LLM) to generate intermediate implicit premises based on the explicit premise and claim; (2) another LLM to translate the natural language into logical formulas; and (3) a neuro-symbolic reasoner based on a SAT solver to determine entailment. We evaluate our pipeline on two enthymeme datasets, demonstrating promising performance in selecting the correct implicit premise, as measured by precision, recall, F1-score, and accuracy.
• 摘要：文本和对话中的现实世界论证通常是推理原素（即它们的一些前提和/或主张是隐含的）。用于处理 enthymeme 的自然语言处理 (NLP) 方法可以潜在地识别文本中的 enthymeme，但它们不会解码其底层逻辑，而处理它们的基于逻辑的方法则假设知识库具有足够的公式，可用于通过溯因解码它们。因此，缺乏一种系统的方法来将推理素的文本成分翻译成逻辑论证并生成解码所需的逻辑公式，从而显示逻辑蕴涵。为了解决这个问题，我们提出了一个集成的管道：（1）一个大型语言模型（LLM），用于根据显式前提和声明生成中间隐式前提； （2）另一个法学硕士将自然语言翻译成逻辑公式； (3) 基于 SAT 求解器的神经符号推理器来确定蕴涵。我们在两个 enthymeme 数据集上评估了我们的流程，通过精确度、召回率、F1 分数和准确度来衡量，在选择正确的隐式前提方面展示了良好的性能。

Title: Diffusion Language Models Are Natively Length-Aware

• Authors: Vittorio Rossi, Giacomo Cirò, Davide Beltrame, Luca Gandolfi, Paul Röttger, Dirk Hovy
• Subjects: cs.CL, cs.LG
• Abstract URL: https://arxiv.org/abs/2603.06123
• Pdf URL: https://arxiv.org/pdf/2603.06123
• Copy Paste: [[2603.06123]] Diffusion Language Models Are Natively Length-Aware(https://arxiv.org/abs/2603.06123)
• Keywords: language model, prompt, chat
• Abstract: Unlike autoregressive language models, which terminate variable-length generation upon predicting an End-of-Sequence (EoS) token, Diffusion Language Models (DLMs) operate over a fixed maximum-length context window for a predetermined number of denoising steps. However, this process is independent of the required response length, resulting in computational waste for the majority of short responses common in reasoning and chat tasks. To address this problem, we conjecture that the latent prompt representation contains sufficient information to estimate the required output length. We provide empirical evidence for this phenomenon and propose a zero-shot mechanism to dynamically crop the context window before generation begins, leading to fewer diffusion steps and substantial computational savings. We evaluate our approach on four benchmarks with diverse tasks -- GSM8K (reasoning), HumanEval (code generation), IfEval (instruction following), and LongFormQA (question answering) -- revealing massive efficiency gains at minimal performance impact. We report significant reductions in FLOPs across all tasks, with no statistically significant performance degradation, and significant performance improvements in 2 out of 4 tasks.
• 摘要：与在预测序列结束 (EoS) 标记时终止可变长度生成的自回归语言模型不同，扩散语言模型 (DLM) 在固定的最大长度上下文窗口上运行预定数量的去噪步骤。然而，这个过程与所需的响应长度无关，导致推理和聊天任务中常见的大多数短响应产生计算浪费。为了解决这个问题，我们推测潜在提示表示包含足够的信息来估计所需的输出长度。我们为这种现象提供了经验证据，并提出了一种零样本机制，可以在生成开始之前动态裁剪上下文窗口，从而减少扩散步骤并节省大量计算量。我们在具有不同任务的四个基准上评估我们的方法 - GSM8K（推理）、HumanEval（代码生成）、IfEval（指令跟踪）和 LongFormQA（问答） - 揭示了以最小的性能影响实现了巨大的效率提升。我们报告称，所有任务的 FLOP 均显着减少，且没有统计上显着的性能下降，并且四分之二的任务的性能显着提高。

Title: CRIMSON: A Clinically-Grounded LLM-Based Metric for Generative Radiology Report Evaluation

• Authors: Mohammed Baharoon, Thibault Heintz, Siavash Raissi, Mahmoud Alabbad, Mona Alhammad, Hassan AlOmaish, Sung Eun Kim, Oishi Banerjee, Pranav Rajpurkar
• Subjects: cs.CL, cs.AI, cs.CV
• Abstract URL: https://arxiv.org/abs/2603.06183
• Pdf URL: https://arxiv.org/pdf/2603.06183
• Copy Paste: [[2603.06183]] CRIMSON: A Clinically-Grounded LLM-Based Metric for Generative Radiology Report Evaluation(https://arxiv.org/abs/2603.06183)
• Keywords: llm
• Abstract: We introduce CRIMSON, a clinically grounded evaluation framework for chest X-ray report generation that assesses reports based on diagnostic correctness, contextual relevance, and patient safety. Unlike prior metrics, CRIMSON incorporates full clinical context, including patient age, indication, and guideline-based decision rules, and prevents normal or clinically insignificant findings from exerting disproportionate influence on the overall score. The framework categorizes errors into a comprehensive taxonomy covering false findings, missing findings, and eight attribute-level errors (e.g., location, severity, measurement, and diagnostic overinterpretation). Each finding is assigned a clinical significance level (urgent, actionable non-urgent, non-actionable, or expected/benign), based on a guideline developed in collaboration with attending cardiothoracic radiologists, enabling severity-aware weighting that prioritizes clinically consequential mistakes over benign discrepancies. CRIMSON is validated through strong alignment with clinically significant error counts annotated by six board-certified radiologists in ReXVal (Kendalls tau = 0.61-0.71; Pearsons r = 0.71-0.84), and through two additional benchmarks that we introduce. In RadJudge, a targeted suite of clinically challenging pass-fail scenarios, CRIMSON shows consistent agreement with expert judgment. In RadPref, a larger radiologist preference benchmark of over 100 pairwise cases with structured error categorization, severity modeling, and 1-5 overall quality ratings from three cardiothoracic radiologists, CRIMSON achieves the strongest alignment with radiologist preferences. We release the metric, the evaluation benchmarks, RadJudge and RadPref, and a fine-tuned MedGemma model to enable reproducible evaluation of report generation, all available at this https URL.
• 摘要：我们推出了 CRIMSON，这是一种基于临床的胸部 X 射线报告生成评估框架，可根据诊断正确性、背景相关性和患者安全来评估报告。与之前的指标不同，CRIMSON 结合了完整的临床背景，包括患者年龄、适应症和基于指南的决策规则，并防止正常或临床上无关紧要的发现对总体评分产生不成比例的影响。该框架将错误分类为涵盖错误发现、缺失发现和八个属性级错误（例如位置、严重性、测量和诊断过度解释）的综合分类法。根据与主治心胸放射科医生合作制定的指南，每个发现都被分配一个临床显着性级别（紧急、可操作的非紧急、不可操作或预期/良性），从而实现严重性意识加权，优先考虑临床上严重的错误而不是良性差异。 CRIMSON 通过与 ReXVal 六名委员会认证放射科医生注释的临床显着错误计数（Kendalls tau = 0.61-0.71；Pearsons r = 0.71-0.84）的严格一致性以及我们引入的两个额外基准进行验证。在 RadJudge（一组有针对性的临床挑战性通过/失败场景）中，CRIMSON 与专家判断表现出一致的一致性。 RadPref 是一个更大的放射科医生偏好基准，包含 100 多个配对病例，具有结构化错误分类、严重性建模以及三位心胸放射科医生的 1-5 整体质量评级，CRIMSON 与放射科医生偏好实现了最强的一致性。我们发布了指标、评估基准、RadJudge 和 RadPref 以及经过微调的 MedGemma 模型，以实现对报告生成的可重复评估，所有这些都可以在此 https URL 上获得。

Title: Wisdom of the AI Crowd (AI-CROWD) for Ground Truth Approximation in Content Analysis: A Research Protocol & Validation Using Eleven Large Language Models

• Authors: Luis de-Marcos, Manuel Goyanes, Adrián Domínguez-Díaz
• Subjects: cs.CL
• Abstract URL: https://arxiv.org/abs/2603.06197
• Pdf URL: https://arxiv.org/pdf/2603.06197
• Copy Paste: [[2603.06197]] Wisdom of the AI Crowd (AI-CROWD) for Ground Truth Approximation in Content Analysis: A Research Protocol & Validation Using Eleven Large Language Models(https://arxiv.org/abs/2603.06197)
• Keywords: language model, llm
• Abstract: Large-scale content analysis is increasingly limited by the absence of observable ground truth or gold-standard labels, as creating such benchmarks through extensive human coding becomes impractical for massive datasets due to high time, cost, and consistency challenges. To overcome this barrier, we introduce the AI-CROWD protocol, which approximates ground truth by leveraging the collective outputs of an ensemble of large language models (LLMs). Rather than asserting that the resulting labels are true ground truth, the protocol generates a consensus-based approximation derived from convergent and divergent inferences across multiple models. By aggregating outputs via majority voting and interrogating agreement/disagreement patterns with diagnostic metrics, AI-CROWD identifies high-confidence classifications while flagging potential ambiguity or model-specific biases.
• 摘要：由于缺乏可观察的事实真相或黄金标准标签，大规模内容分析越来越受到限制，因为由于时间、成本和一致性方面的挑战，通过广泛的人工编码创建此类基准对于大规模数据集来说变得不切实际。为了克服这一障碍，我们引入了 AI-CROWD 协议，该协议通过利用大型语言模型 (LLM) 集合的集体输出来近似地面事实。该协议不是断言生成的标签是真实的事实，而是从多个模型的收敛和发散推论中生成基于共识的近似值。通过多数投票聚合输出并使用诊断指标询问同意/不同意模式，AI-CROWD 可以识别高置信度分类，同时标记潜在的模糊性或特定于模型的偏差。

Title: LIT-RAGBench: Benchmarking Generator Capabilities of Large Language Models in Retrieval-Augmented Generation

• Authors: Koki Itai, Shunichi Hasegawa, Yuta Yamamoto, Gouki Minegishi, Masaki Otsuki
• Subjects: cs.CL
• Abstract URL: https://arxiv.org/abs/2603.06198
• Pdf URL: https://arxiv.org/pdf/2603.06198
• Copy Paste: [[2603.06198]] LIT-RAGBench: Benchmarking Generator Capabilities of Large Language Models in Retrieval-Augmented Generation(https://arxiv.org/abs/2603.06198)
• Keywords: language model, llm, long context, retrieval-augmented generation
• Abstract: Retrieval-Augmented Generation (RAG) is a framework in which a Generator, such as a Large Language Model (LLM), produces answers by retrieving documents from an external collection using a Retriever. In practice, Generators must integrate evidence from long contexts, perform multi-step reasoning, interpret tables, and abstain when evidence is missing. However, existing benchmarks for Generators provide limited coverage, with none enabling simultaneous evaluation of multiple capabilities under unified conditions. To bridge the gap between existing evaluations and practical use, we introduce LIT-RAGBench (the Logic, Integration, Table, Reasoning, and Abstention RAG Generator Benchmark), which defines five categories: Integration, Reasoning, Logic, Table, and Abstention, each further divided into practical evaluation aspects. LIT-RAGBench systematically covers patterns combining multiple aspects across categories. By using fictional entities and scenarios, LIT-RAGBench evaluates answers grounded in the provided external documents. The dataset consists of 114 human-constructed Japanese questions and an English version generated by machine translation with human curation. We use LLM-as-a-Judge for scoring and report category-wise and overall accuracy. Across API-based and open-weight models, no model exceeds 90% overall accuracy. By making strengths and weaknesses measurable within each category, LIT-RAGBench serves as a valuable metric for model selection in practical RAG deployments and for building RAG-specialized models. We release LIT-RAGBench, including the dataset and evaluation code, at this https URL.
• 摘要：检索增强生成 (RAG) 是一个框架，其中生成器（例如大型语言模型 (LLM)）通过使用检索器从外部集合检索文档来生成答案。在实践中，生成器必须整合来自长上下文的证据，执行多步骤推理，解释表格，并在证据缺失时放弃。然而，现有的生成器基准测试覆盖范围有限，无法在统一条件下同时评估多种功能。为了弥合现有评估与实际使用之间的差距，我们引入了 LIT-RAGBench（逻辑、集成、表格、推理和放弃 RAG 生成器基准），它定义了五个类别：集成、推理、逻辑、表格和放弃，每个类别进一步分为实际评估方面。 LIT-RAGBench 系统地涵盖了跨类别的多个方面相结合的模式。通过使用虚构的实体和场景，LIT-RAGBench 评估基于所提供的外部文档的答案。该数据集由 114 个人工构建的日语问题和由机器翻译和人工管理生成的英语版本组成。我们使用法学硕士作为法官进行评分并报告类别和整体准确性。在基于 API 的模型和开放权重模型中，没有模型的总体准确率超过 90%。通过在每个类别中衡量优点和缺点，LIT-RAGBench 可以作为实际 RAG 部署中模型选择和构建 RAG 专用模型的宝贵指标。我们在此 https URL 发布了 LIT-RAGBench，包括数据集和评估代码。

Title: FlashPrefill: Instantaneous Pattern Discovery and Thresholding for Ultra-Fast Long-Context Prefilling

• Authors: Qihang Fan, Huaibo Huang, Zhiying Wu, Juqiu Wang, Bingning Wang, Ran He
• Subjects: cs.CL, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.06199
• Pdf URL: https://arxiv.org/pdf/2603.06199
• Copy Paste: [[2603.06199]] FlashPrefill: Instantaneous Pattern Discovery and Thresholding for Ultra-Fast Long-Context Prefilling(https://arxiv.org/abs/2603.06199)
• Keywords: language model
• Abstract: Long-context modeling is a pivotal capability for Large Language Models, yet the quadratic complexity of attention remains a critical bottleneck, particularly during the compute-intensive prefilling phase. While various sparse attention mechanisms have been explored, they typically suffer from either significant search latency or insufficient sparsity. In this paper, we propose FlashPrefill, a framework enabling ultra-fast prefilling via instantaneous pattern discovery and thresholding. FlashPrefill leverages a fast block-searching technique to simultaneously locate dynamic vertical, slash, and block-sparse attention patterns. Crucially, it introduces a dynamic thresholding mechanism that bypasses the prohibitive overhead of sorting or accumulating attention scores while effectively eliminating the long-tail distribution to enhance sparsity. Extensive evaluations demonstrate that FlashPrefill achieves a substantial leap in efficiency, delivering an unprecedented 27.78x speedup on 256K sequences. Notably, unlike existing methods that incur efficiency degradation on shorter contexts, FlashPrefill maintains a 1.71x speedup even at a 4K context length, demonstrating its robustness and practical utility across varying sequence scales.
• 摘要：长上下文建模是大型语言模型的关键功能，但注意力的二次复杂性仍然是一个关键瓶颈，特别是在计算密集型预填充阶段。虽然人们已经探索了各种稀疏注意力机制，但它们通常会遇到显着的搜索延迟或稀疏性不足的问题。在本文中，我们提出了 FlashPrefill，这是一个通过即时模式发现和阈值处理实现超快速预填充的框架。 FlashPrefill 利用快速块搜索技术来同时定位动态垂直、斜线和块稀疏注意模式。至关重要的是，它引入了一种动态阈值机制，可以绕过排序或累积注意力分数的高昂开销，同时有效消除长尾分布以增强稀疏性。广泛的评估表明，FlashPrefill 实现了效率的大幅飞跃，在 256K 序列上实现了前所未有的 27.78 倍加速。值得注意的是，与在较短上下文上导致效率下降的现有方法不同，FlashPrefill 即使在 4K 上下文长度下也能保持 1.71 倍的加速，证明了其在不同序列尺度上的鲁棒性和实用性。

Title: SPOT: Span-level Pause-of-Thought for Efficient and Interpretable Latent Reasoning in Large Language Models

• Authors: Yunlong Chu, Minglai Shao, Yuhang Liu, Bing Hao, Yumeng Lin, Jialu Wang, Ruijie Wang
• Subjects: cs.CL
• Abstract URL: https://arxiv.org/abs/2603.06222
• Pdf URL: https://arxiv.org/pdf/2603.06222
• Copy Paste: [[2603.06222]] SPOT: Span-level Pause-of-Thought for Efficient and Interpretable Latent Reasoning in Large Language Models(https://arxiv.org/abs/2603.06222)
• Keywords: language model, prompt, chain-of-thought
• Abstract: Explicit Chain-of-Thought improves the reasoning performance of large language models but often incurs high inference cost due to verbose token-level traces. While recent approaches reduce this overhead via concise prompting or step pruning, they largely truncate what the model says rather than internalize what the model thinks. Latent reasoning offers a promising alternative by performing computation in the hidden space, yet prior methods face two critical challenges. Many existing approaches rely on rigid point-to-point alignment, forcing a latent token to approximate the final representation of a reasoning step, which can be insufficient to capture the dense, variable-length semantics of an entire reasoning segment. Furthermore, these methods often suffer from a lack of interpretability: latent states are commonly produced by unconstrained optimization or embedding mixing, yielding vectors that are difficult to decode or audit under the pretrained language head. We propose SPOT, a flexible framework that compresses explicit CoT into compact latent pause tokens without enforcing a fixed response template. At the core of SPOT is Span-level Semantic Alignment, a Sinkhorn optimal-transport objective that softly matches each pause token to the semantics of an entire reasoning segment, overcoming the rigidity of step-end alignment. To further improve interpretability, SPOT introduces a Frozen-Head Decoding Constraint that keeps latent states directly decodable as token distributions under the frozen pretrained LM head, enabling readable keyword interpretations of latent thoughts. Experiments on reasoning benchmarks demonstrate that SPOT improves accuracy by 2.3 points on average while reducing generated tokens by 37.5% and provides faithful semantic interpretations of the latent reasoning process.
• 摘要：显式思维链提高了大型语言模型的推理性能，但由于详细的标记级跟踪，通常会产生较高的推理成本。虽然最近的方法通过简洁的提示或步骤修剪来减少这种开销，但它们很大程度上截断了模型所说的内容，而不是内化了模型的想法。潜在推理通过在隐藏空间中执行计算提供了一种有前途的替代方案，但现有方法面临两个关键挑战。许多现有方法依赖于严格的点对点对齐，迫使潜在标记近似推理步骤的最终表示，这可能不足以捕获整个推理段的密集、可变长度语义。此外，这些方法通常缺乏可解释性：潜在状态通常是通过无约束优化或嵌入混合产生的，产生的向量在预训练语言头下难以解码或审核。我们提出了 SPOT，这是一种灵活的框架，可将显式 CoT 压缩为紧凑的潜在暂停令牌，而无需强制执行固定的响应模板。 SPOT 的核心是跨度级语义对齐，这是一个 Sinkhorn 最佳传输目标，它将每个暂停标记与整个推理段的语义进行软匹配，克服了步骤结束对齐的僵化性。为了进一步提高可解释性，SPOT 引入了冻结头解码约束，使潜在状态可以直接解码为冻结预训练 LM 头下的令牌分布，从而实现潜在想法的可读关键字解释。推理基准实验表明，SPOT 的准确度平均提高了 2.3 个百分点，同时将生成的 token 减少了 37.5%，并为潜在推理过程提供了忠实的语义解释。

Title: Mind the Gap: Pitfalls of LLM Alignment with Asian Public Opinion

• Authors: Hari Shankar, Vedanta S P, Sriharini Margapuri, Debjani Mazumder, Ponnurangam Kumaraguru, Abhijnan Chakraborty
• Subjects: cs.CL, cs.CY
• Abstract URL: https://arxiv.org/abs/2603.06264
• Pdf URL: https://arxiv.org/pdf/2603.06264
• Copy Paste: [[2603.06264]] Mind the Gap: Pitfalls of LLM Alignment with Asian Public Opinion(https://arxiv.org/abs/2603.06264)
• Keywords: language model, gpt, llm, prompt
• Abstract: Large Language Models (LLMs) are increasingly being deployed in multilingual, multicultural settings, yet their reliance on predominantly English-centric training data risks misalignment with the diverse cultural values of different societies. In this paper, we present a comprehensive, multilingual audit of the cultural alignment of contemporary LLMs including GPT-4o-Mini, Gemini-2.5-Flash, Llama 3.2, Mistral and Gemma 3 across India, East Asia and Southeast Asia. Our study specifically focuses on the sensitive domain of religion as the prism for broader alignment. To facilitate this, we conduct a multi-faceted analysis of every LLM's internal representations, using log-probs/logits, to compare the model's opinion distributions against ground-truth public attitudes. We find that while the popular models generally align with public opinion on broad social issues, they consistently fail to accurately represent religious viewpoints, especially those of minority groups, often amplifying negative stereotypes. Lightweight interventions, such as demographic priming and native language prompting, partially mitigate but do not eliminate these cultural gaps. We further show that downstream evaluations on bias benchmarks (such as CrowS-Pairs, IndiBias, ThaiCLI, KoBBQ) reveal persistent harms and under-representation in sensitive contexts. Our findings underscore the urgent need for systematic, regionally grounded audits to ensure equitable global deployment of LLMs.
• 摘要：大型语言模型（LLM）越来越多地被部署在多语言、多文化环境中，但它们对主要以英语为中心的训练数据的依赖可能会与不同社会的不同文化价值观不一致。在本文中，我们对印度、东亚和东南亚的当代法学硕士（包括 GPT-4o-Mini、Gemini-2.5-Flash、Llama 3.2、Mistral 和 Gemma 3）的文化一致性进行了全面的多语言审核。我们的研究特别关注宗教的敏感领域，将其作为更广泛联盟的棱镜。为了促进这一点，我们使用对数概率/逻辑对每个法学硕士的内部表征进行多方面的分析，以将模型的意见分布与真实的公众态度进行比较。我们发现，虽然流行模式在广泛的社会问题上通常与公众舆论一致，但它们始终无法准确代表宗教观点，尤其是少数群体的观点，往往会放大负面刻板印象。人口统计启动和母语提示等轻量级干预措施可以部分缓解但不能消除这些文化差距。我们进一步表明，对偏见基准（例如 CrowS-Pairs、IndiBias、ThaiCLI、KoBBQ）的下游评估揭示了敏感环境中的持续危害和代表性不足。我们的调查结果强调迫切需要进行系统的、基于区域的审计，以确保法学硕士在全球的公平部署。

Title: The Art That Poses Back: Assessing AI Pastiches after Contemporary Artworks

• Authors: Anca Dinu, Andreiana Mihail, Andra-Maria Florescu, Claudiu Creanga
• Subjects: cs.CL, cs.CV
• Abstract URL: https://arxiv.org/abs/2603.06324
• Pdf URL: https://arxiv.org/pdf/2603.06324
• Copy Paste: [[2603.06324]] The Art That Poses Back: Assessing AI Pastiches after Contemporary Artworks(https://arxiv.org/abs/2603.06324)
• Keywords: gpt, chat
• Abstract: This study explores artificial visual creativity, focusing on ChatGPT's ability to generate new images intentionally pastiching original artworks such as paintings, drawings, sculptures and installations. The process involved twelve artists from Romania, Bulgaria, France, Austria, and the United Kingdom, each invited to contribute with three of their artworks and to grade and comment on the AI-generated versions. The analysis combines human evaluation with computational methods aimed at detecting visual and stylistic similarities or divergences between the original works and their AI-produced renditions. The results point to a significant gap between color and texture-based similarity and compositional, conceptual, and perceptual one. Consequently, we advocate for the use of a "style transfer dashboard" of complementary metrics to evaluate the similarity between pastiches and originals, rather than using a single style metric. The artists' comments revealed limitations of ChatGPT's pastiches after contemporary artworks, which were perceived by the authors of the originals as lacking dimensionality, context, and intentional sense, and seeming more of a paraphrase or an approximate quotation rather than as a valuable, emotion-evoking artwork.
• 摘要：这项研究探讨了人工视觉创造力，重点关注 ChatGPT 生成有意模仿绘画、素描、雕塑和装置等原创艺术品的新图像的能力。该过程涉及来自罗马尼亚、保加利亚、法国、奥地利和英国的 12 名艺术家，每人受邀贡献自己的三件艺术作品，并对人工智能生成的版本进行评分和评论。该分析将人类评估与计算方法相结合，旨在检测原始作品与其人工智能制作的演绎之间视觉和风格上的相似性或差异。结果表明，基于颜色和纹理的相似性与构图、概念和感知之间存在显着差距。因此，我们主张使用补充指标的“风格转移仪表板”来评估仿制品和原作之间的相似性，而不是使用单一的风格指标。艺术家们的评论揭示了 ChatGPT 模仿当代艺术作品的局限性，原作作者认为这些作品缺乏维度、语境和意图感，看起来更像是释义或近似引用，而不是一件有价值的、唤起情感的艺术品。

Title: Transparent AI for Mathematics: Transformer-Based Large Language Models for Mathematical Entity Relationship Extraction with XAI

• Authors: Tanjim Taharat Aurpa
• Subjects: cs.CL
• Abstract URL: https://arxiv.org/abs/2603.06348
• Pdf URL: https://arxiv.org/pdf/2603.06348
• Copy Paste: [[2603.06348]] Transparent AI for Mathematics: Transformer-Based Large Language Models for Mathematical Entity Relationship Extraction with XAI(https://arxiv.org/abs/2603.06348)
• Keywords: language model
• Abstract: Mathematical text understanding is a challenging task due to the presence of specialized entities and complex relationships between them. This study formulates mathematical problem interpretation as a Mathematical Entity Relation Extraction (MERE) task, where operands are treated as entities and operators as their relationships. Transformer-based models are applied to automatically extract these relations from mathematical text, with Bidirectional Encoder Representations from Transformers (BERT) achieving the best performance, reaching an accuracy of 99.39%. To enhance transparency and trust in the model's predictions, Explainable Artificial Intelligence (XAI) is incorporated using Shapley Additive Explanations (SHAP). The explainability analysis reveals how specific textual and mathematical features influence relation prediction, providing insights into feature importance and model behavior. By combining transformer-based learning, a task-specific dataset, and explainable modeling, this work offers an effective and interpretable framework for MERE, supporting future applications in automated problem solving, knowledge graph construction, and intelligent educational systems.
• 摘要：由于专门实体的存在以及它们之间复杂的关系，数学文本理解是一项具有挑战性的任务。本研究将数学问题解释制定为数学实体关系提取（MERE）任务，其中操作数被视为实体，运算符被视为它们的关系。基于 Transformer 的模型被用来从数学文本中自动提取这些关系，其中来自 Transformers 的双向编码器表示 (BERT) 实现了最佳性能，达到了 99.39% 的准确率。为了增强模型预测的透明度和可信度，使用 Shapley 附加解释 (SHAP) 合并了可解释人工智能 (XAI)。可解释性分析揭示了特定的文本和数学特征如何影响关系预测，提供对特征重要性和模型行为的见解。通过结合基于 Transformer 的学习、特定于任务的数据集和可解释的建模，这项工作为 MERE 提供了一个有效且可解释的框架，支持未来在自动化问题解决、知识图谱构建和智能教育系统中的应用。

Title: Evaluation of Deontic Conditional Reasoning in Large Language Models: The Case of Wason's Selection Task

• Authors: Hirohiko Abe, Kentaro Ozeki, Risako Ando, Takanobu Morishita, Koji Mineshima, Mitsuhiro Okada
• Subjects: cs.CL
• Abstract URL: https://arxiv.org/abs/2603.06416
• Pdf URL: https://arxiv.org/pdf/2603.06416
• Copy Paste: [[2603.06416]] Evaluation of Deontic Conditional Reasoning in Large Language Models: The Case of Wason's Selection Task(https://arxiv.org/abs/2603.06416)
• Keywords: language model, llm
• Abstract: As large language models (LLMs) advance in linguistic competence, their reasoning abilities are gaining increasing attention. In humans, reasoning often performs well in domain specific settings, particularly in normative rather than purely formal contexts. Although prior studies have compared LLM and human reasoning, the domain specificity of LLM reasoning remains underexplored. In this study, we introduce a new Wason Selection Task dataset that explicitly encodes deontic modality to systematically distinguish deontic from descriptive conditionals, and use it to examine LLMs' conditional reasoning under deontic rules. We further analyze whether observed error patterns are better explained by confirmation bias (a tendency to seek rule-supporting evidence) or by matching bias (a tendency to ignore negation and select items that lexically match elements of the rule). Results show that, like humans, LLMs reason better with deontic rules and display matching-bias-like errors. Together, these findings suggest that the performance of LLMs varies systematically across rule types and that their error patterns can parallel well-known human biases in this paradigm.
• 摘要：随着大型语言模型（LLM）在语言能力方面的进步，它们的推理能力越来越受到关注。对于人类来说，推理通常在特定领域的环境中表现良好，特别是在规范而非纯粹形式的环境中。尽管之前的研究已经比较了法学硕士和人类推理，但法学硕士推理的领域特异性仍未得到充分探索。在本研究中，我们引入了一个新的 Wason 选择任务数据集，该数据集显式编码道义模态，以系统地区分道义条件和描述性条件，并用它来检查法学硕士在道义规则下的条件推理。我们进一步分析观察到的错误模式是否可以通过确认偏差（寻求规则支持证据的倾向）或匹配偏差（忽略否定并选择在词汇上与规则元素匹配的项目的倾向）来更好地解释。结果表明，与人类一样，法学硕士可以更好地利用道义规则进行推理，并显示出类似匹配偏差的错误。总之，这些发现表明，法学硕士的表现在不同规则类型之间存在系统性差异，并且它们的错误模式可以与该范式中众所周知的人类偏见相似。

Title: From Prompting to Preference Optimization: A Comparative Study of LLM-based Automated Essay Scoring

• Authors: Minh Hoang Nguyen, Vu Hoang Pham, Xuan Thanh Huynh, Phuc Hong Mai, Vinh The Nguyen, Quang Nhut Huynh, Huy Tien Nguyen, Tung Le
• Subjects: cs.CL
• Abstract URL: https://arxiv.org/abs/2603.06424
• Pdf URL: https://arxiv.org/pdf/2603.06424
• Copy Paste: [[2603.06424]] From Prompting to Preference Optimization: A Comparative Study of LLM-based Automated Essay Scoring(https://arxiv.org/abs/2603.06424)
• Keywords: language model, llm, prompt, retrieval-augmented generation
• Abstract: Large language models (LLMs) have recently reshaped Automated Essay Scoring (AES), yet prior studies typically examine individual techniques in isolation, limiting understanding of their relative merits for English as a Second Language (L2) writing. To bridge this gap, we presents a comprehensive comparison of major LLM-based AES paradigms on IELTS Writing Task~2. On this unified benchmark, we evaluate four approaches: (i) encoder-based classification fine-tuning, (ii) zero- and few-shot prompting, (iii) instruction tuning and Retrieval-Augmented Generation (RAG), and (iv) Supervised Fine-Tuning combined with Direct Preference Optimization (DPO) and RAG. Our results reveal clear accuracy-cost-robustness trade-offs across methods, the best configuration, integrating k-SFT and RAG, achieves the strongest overall results with F1-Score 93%. This study offers the first unified empirical comparison of modern LLM-based AES strategies for English L2, promising potential in auto-grading writing tasks. Code is public at this https URL
• 摘要：大型语言模型 (LLM) 最近重塑了自动作文评分 (AES)，但之前的研究通常会孤立地考察个别技术，限制了对其对于英语作为第二语言 (L2) 写作的相对优点的理解。为了弥补这一差距，我们在雅思写作任务 ~2 中对主要的基于法学硕士的 AES 范式进行了全面比较。在这个统一的基准上，我们评估了四种方法：（i）基于编码器的分类微调，（ii）零和几次提示，（iii）指令调整和检索增强生成（RAG），以及（iv）与直接偏好优化（DPO）和RAG相结合的监督微调。我们的结果揭示了不同方法之间清晰的准确性-成本-鲁棒性权衡，集成 k-SFT 和 RAG 的最佳配置实现了最强的总体结果，F1-Score 为 93%。这项研究首次对现代基于 LLM 的 AES 英语 L2 策略进行了统一的实证比较，在自动评分写作任务中具有广阔的前景。代码在此 https URL 公开

Title: Abductive Reasoning with Syllogistic Forms in Large Language Models

• Authors: Hirohiko Abe, Risako Ando, Takanobu Morishita Kentaro Ozeki, Koji Mineshima, Mitsuhiro Okada
• Subjects: cs.CL, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.06428
• Pdf URL: https://arxiv.org/pdf/2603.06428
• Copy Paste: [[2603.06428]] Abductive Reasoning with Syllogistic Forms in Large Language Models(https://arxiv.org/abs/2603.06428)
• Keywords: language model, llm
• Abstract: Research in AI using Large-Language Models (LLMs) is rapidly evolving, and the comparison of their performance with human reasoning has become a key concern. Prior studies have indicated that LLMs and humans share similar biases, such as dismissing logically valid inferences that contradict common beliefs. However, criticizing LLMs for these biases might be unfair, considering our reasoning not only involves formal deduction but also abduction, which draws tentative conclusions from limited information. Abduction can be regarded as the inverse form of syllogism in its basic structure, that is, a process of drawing a minor premise from a major premise and conclusion. This paper explores the accuracy of LLMs in abductive reasoning by converting a syllogistic dataset into one suitable for abduction. It aims to investigate whether the state-of-the-art LLMs exhibit biases in abduction and to identify potential areas for improvement, emphasizing the importance of contextualized reasoning beyond formal deduction. This investigation is vital for advancing the understanding and application of LLMs in complex reasoning tasks, offering insights into bridging the gap between machine and human cognition.
• 摘要：使用大语言模型 (LLM) 的人工智能研究正在迅速发展，其性能与人类推理的比较已成为一个关键问题。先前的研究表明，法学硕士和人类有相似的偏见，例如驳回与共同信念相矛盾的逻辑上有效的推论。然而，批评法学硕士的这些偏见可能是不公平的，因为我们的推理不仅涉及形式演绎，还涉及溯因，即从有限的信息中得出初步结论。溯因法在其基本结构上可视为三段论的逆形式，即由大前提和结论推导出小前提的过程。本文通过将三段论数据集转换为适合溯因的数据集，探讨了法学硕士在溯因推理中的准确性。它旨在调查最先进的法学硕士是否在溯因方面表现出偏见，并确定潜在的改进领域，强调超越正式演绎的情境推理的重要性。这项研究对于推进法学硕士在复杂推理任务中的理解和应用至关重要，为弥合机器和人类认知之间的差距提供见解。

Title: PONTE: Personalized Orchestration for Natural Language Trustworthy Explanations

• Authors: Vittoria Vineis, Matteo Silvestri, Lorenzo Antonelli, Filippo Betello, Gabriele Tolomei
• Subjects: cs.CL, cs.AI
• Abstract URL: https://arxiv.org/abs/2603.06485
• Pdf URL: https://arxiv.org/pdf/2603.06485
• Copy Paste: [[2603.06485]] PONTE: Personalized Orchestration for Natural Language Trustworthy Explanations(https://arxiv.org/abs/2603.06485)
• Keywords: language model, hallucination, prompt
• Abstract: Explainable Artificial Intelligence (XAI) seeks to enhance the transparency and accountability of machine learning systems, yet most methods follow a one-size-fits-all paradigm that neglects user differences in expertise, goals, and cognitive needs. Although Large Language Models can translate technical explanations into natural language, they introduce challenges related to faithfulness and hallucinations. To address these challenges, we present PONTE (Personalized Orchestration for Natural language Trustworthy Explanations), a human-in-the-loop framework for adaptive and reliable XAI narratives. PONTE models personalization as a closed-loop validation and adaptation process rather than prompt engineering. It combines: (i) a low-dimensional preference model capturing stylistic requirements; (ii) a preference-conditioned generator grounded in structured XAI artifacts; and (iii) verification modules enforcing numerical faithfulness, informational completeness, and stylistic alignment, optionally supported by retrieval-grounded argumentation. User feedback iteratively updates the preference state, enabling quick personalization. Automatic and human evaluations across healthcare and finance domains show that the verification-refinement loop substantially improves completeness and stylistic alignment over validation-free generation. Human studies further confirm strong agreement between intended preference vectors and perceived style, robustness to generation stochasticity, and consistently positive quality assessments.
• 摘要：可解释人工智能 (XAI) 旨在提高机器学习系统的透明度和问责制，但大多数方法都遵循一刀切的范式，忽略了用户在专业知识、目标和认知需求方面的差异。尽管大型语言模型可以将技术解释翻译成自然语言，但它们引入了与忠实性和幻觉相关的挑战。为了应对这些挑战，我们提出了 PONTE（自然语言可信解释的个性化编排），这是一个用于自适应且可靠的 XAI 叙述的人机循环框架。 PONTE 将个性化建模为闭环验证和适应过程，而不是即时工程。它结合了：（i）捕捉风格要求的低维偏好模型； (ii) 基于结构化 XAI 工件的偏好调节生成器； (iii) 验证模块，强制执行数字真实性、信息完整性和文体一致性，可选地由基于检索的论证支持。用户反馈迭代地更新偏好状态，从而实现快速个性化。跨医疗保健和金融领域的自动和人工评估表明，与免验证生成相比，验证细化循环大大提高了完整性和风格一致性。人类研究进一步证实了预期偏好向量和感知风格、对生成随机性的鲁棒性以及一致的积极质量评估之间的强烈一致性。

Title: Beyond Rows to Reasoning: Agentic Retrieval for Multimodal Spreadsheet Understanding and Editing

• Authors: Anmol Gulati, Sahil Sen, Waqar Sarguroh, Kevin Paul
• Subjects: cs.CL
• Abstract URL: https://arxiv.org/abs/2603.06503
• Pdf URL: https://arxiv.org/pdf/2603.06503
• Copy Paste: [[2603.06503]] Beyond Rows to Reasoning: Agentic Retrieval for Multimodal Spreadsheet Understanding and Editing(https://arxiv.org/abs/2603.06503)
• Keywords: language model, gpt, llm, retrieval-augmented generation, agent
• Abstract: Recent advances in multimodal Retrieval-Augmented Generation (RAG) enable Large Language Models (LLMs) to analyze enterprise spreadsheet workbooks containing millions of cells, cross-sheet dependencies, and embedded visual artifacts. However, state-of-the-art approaches exclude critical context through single-pass retrieval, lose data resolution through compression, and exceed LLM context windows through naive full-context injection, preventing reliable multi-step reasoning over complex enterprise workbooks. We introduce Beyond Rows to Reasoning (BRTR), a multimodal agentic framework for spreadsheet understanding that replaces single-pass retrieval with an iterative tool-calling loop, supporting end-to-end Excel workflows from complex analysis to structured editing. Supported by over 200 hours of expert human evaluation, BRTR achieves state-of-the-art performance across three frontier spreadsheet understanding benchmarks, surpassing prior methods by 25 percentage points on FRTR-Bench, 7 points on SpreadsheetLLM, and 32 points on FINCH. We evaluate five multimodal embedding models, identifying NVIDIA NeMo Retriever 1B as the top performer for mixed tabular and visual data, and vary nine LLMs. Ablation experiments confirm that the planner, retrieval, and iterative reasoning each contribute substantially, and cost analysis shows GPT-5.2 achieves the best efficiency-accuracy trade-off. Throughout all evaluations, BRTR maintains full auditability through explicit tool-call traces.
• 摘要：多模式检索增强生成 (RAG) 的最新进展使大型语言模型 (LLM) 能够分析包含数百万个单元格、跨工作表依赖性和嵌入式视觉工件的企业电子表格工作簿。然而，最先进的方法通过单遍检索排除关键上下文，通过压缩丢失数据分辨率，并通过简单的完整上下文注入超出LLM上下文窗口，从而阻止对复杂企业工作簿进行可靠的多步骤推理。我们引入 Beyond Rows to Reasoning (BRTR)，这是一种用于电子表格理解的多模式代理框架，它用迭代工具调用循环取代单遍检索，支持从复杂分析到结构化编辑的端到端 Excel 工作流程。在超过 200 小时的专家人工评估的支持下，BRTR 在三个前沿电子表格理解基准上实现了最先进的性能，在 FRTR-Bench 上超越了先前的方法 25 个百分点，在 SpreadsheetLLM 上超越了 7 个百分点，在 FINCH 上超越了 32 个百分点。我们评估了五个多模态嵌入模型，将 NVIDIA NeMo Retriever 1B 确定为混合表格和视觉数据的最佳表现者，并改变了九个法学硕士。消融实验证实，规划器、检索和迭代推理各自做出了很大贡献，成本分析表明 GPT-5.2 实现了最佳的效率与准确性权衡。在所有评估过程中，BRTR 通过显式的工具调用跟踪保持完全的可审计性。

Title: Speak in Context: Multilingual ASR with Speech Context Alignment via Contrastive Learning

• Authors: Yuchen Zhang, Haralambos Mouratidis, Ravi Shekhar
• Subjects: cs.CL
• Abstract URL: https://arxiv.org/abs/2603.06505
• Pdf URL: https://arxiv.org/pdf/2603.06505
• Copy Paste: [[2603.06505]] Speak in Context: Multilingual ASR with Speech Context Alignment via Contrastive Learning(https://arxiv.org/abs/2603.06505)
• Keywords: language model, prompt
• Abstract: Automatic speech recognition (ASR) has benefited from advances in pretrained speech and language models, yet most systems remain constrained to monolingual settings and short, isolated utterances. While recent efforts in context-aware ASR show promise, two key challenges persist: limited multilingual support and the absence of principled alignment between speech and contextual representations. In this paper, we introduce a context-aware multilingual ASR framework that supports diverse languages and accents while preserving the modularity of pretrained models. Our approach combines a frozen speech encoder and a decoder-only language model via a lightweight projection module, allowing structured context prompts, including dialogue history and biasing words, to guide transcription. To improve interaction between speech and context, we employ a contrastive learning objective that aligns their representations in a shared embedding space. Evaluations on over 1,500 hours of real-world conversational speech across 11 languages and 5 English dialects show that contextual input consistently improves recognition quality. Contrastive alignment provides additional gains when applied to different context types, with an overall performance gain of over 5%. These results highlight the importance of both contextual modeling and cross-modal alignment in multilingual ASR.
• 摘要：Automatic speech recognition (ASR) has benefited from advances in pretrained speech and language models, yet most systems remain constrained to monolingual settings and short, isolated utterances.虽然最近在上下文感知 ASR 方面的努力显示出希望，但仍然存在两个关键挑战：有限的多语言支持以及语音和上下文表示之间缺乏原则上的一致性。在本文中，我们介绍了一种上下文感知的多语言 ASR 框架，该框架支持多种语言和口音，同时保留预训练模型的模块化性。我们的方法通过轻量级投影模块将冻结语音编码器和仅解码器的语言模型结合起来，允许结构化上下文提示（包括对话历史记录和偏差词）来指导转录。为了改善语音和上下文之间的交互，我们采用对比学习目标，将它们的表示在共享嵌入空间中对齐。对 1,500 多个小时的 11 种语言和 5 种英语方言的真实对话语音进行的评估表明，上下文输入持续提高了识别质量。当应用于不同的上下文类型时，对比对齐可提供额外的增益，总体性能增益超过 5%。这些结果凸显了上下文建模和跨模式对齐在多语言 ASR 中的重要性。

Title: KCLarity at SemEval-2026 Task 6: Encoder and Zero-Shot Approaches to Political Evasion Detection

• Authors: Archie Sage, Salvatore Greco
• Subjects: cs.CL
• Abstract URL: https://arxiv.org/abs/2603.06552
• Pdf URL: https://arxiv.org/pdf/2603.06552
• Copy Paste: [[2603.06552]] KCLarity at SemEval-2026 Task 6: Encoder and Zero-Shot Approaches to Political Evasion Detection(https://arxiv.org/abs/2603.06552)
• Keywords: gpt
• Abstract: This paper describes the KCLarity team's participation in CLARITY, a shared task at SemEval 2026 on classifying ambiguity and evasion techniques in political discourse. We investigate two modelling formulations: (i) directly predicting the clarity label, and (ii) predicting the evasion label and deriving clarity through the task taxonomy hierarchy. We further explore several auxiliary training variants and evaluate decoder-only models in a zero-shot setting under the evasion-first formulation. Overall, the two formulations yield comparable performance. Among encoder-based models, RoBERTa-large achieves the strongest results on the public test set, while zero-shot GPT-5.2 generalises better on the hidden evaluation set.
• 摘要：本文介绍了 KCLarity 团队参与 CLARITY 的情况，CLA​​RITY 是 SemEval 2026 上的一项共享任务，旨在对政治话语中的歧义和回避技术进行分类。我们研究了两种建模公式：（i）直接预测清晰度标签，以及（ii）预测逃避标签并通过任务分类层次结构推导清晰度。我们进一步探索了几种辅助训练变体，并在规避优先公式下的零样本设置中评估仅解码器模型。总体而言，两种配方的性能相当。在基于编码器的模型中，RoBERTa-large 在公共测试集上取得了最强的结果，而零样本 GPT-5.2 在隐藏评估集上具有更好的泛化能力。