AI Research & Papers
整理大Models、智能体、多模态、机器学习与生成式 AI 的Research、基准和研究进展。
Category articles2148
当前页34 / 54
UpdatesPermanent archive
Category articles
按发布Time从新到旧 · 每页 40 stories
ResearchOrdinary
Harness Learning Enables Generalizable Test-Time Adaptation
A language-model agent is jointly defined by its model and its harness, the executable program that organizes model calls, tool use, and information flow. Because different tasks call for different ways of organizing these operations, the …
Source: arXiv
ResearchOrdinary
Failure-Transparent Agents: Benchmarking Post-Failure Reporting in Tool-Using Language Models
Tool-using agents can fail twice: a required tool can fail, and the agent can then report success without the evidence needed to justify it. Existing benchmarks often entangle this reporting failure with tool selection, recovery, and envir…
Source: arXiv
ResearchOrdinary
X-Reset: Scaling Object-Centric Reinforcement Learning via Cross-Embodiment Resets
Reinforcement learning (RL) in simulation can train dexterous manipulation policies without robot demonstrations, but training a single generalist policy with task-agnostic rewards faces a severe exploration problem: approaching, grasping,…
Source: arXiv
ResearchOrdinary
Steering Language Model Goals with Value Transplant
Reasoning models often act as if they pursue goals, but their efforts are not always directed toward what users intend, sometimes leading them to pursue unintended outcomes. Previous work has examined how models may internally track their …
Source: arXiv · GPT / Qwen
ResearchOrdinary
PReCache: Efficient KV Cache Sharing for Multi-LoRA Agents via Low-Rank Precomputation and Neutral Reconstruction
Multi-LoRA agent systems enable efficient role specialization by sharing a common backbone model. However, each agent repeatedly processes the growing shared trajectory and constructs its own KV cache, introducing substantial memory and co…
Source: arXiv
ResearchOrdinary
The Statistical Cost of Causal Discovery with Feedback
What determines the unavoidable sample cost of learning cyclic causal structure? For cyclic linear non-Gaussian models, we study exact condensation recovery from observational data: identifying the strongly connected component (SCC) partit…
Source: arXiv
ResearchOrdinary
Thinking Outside the Box: Retention and Transmission of Information in Sliding-Window KV Inference
Sliding-window KV inference refers to processing a sequence incrementally while retaining only a fixed-size cache of recent key and value states. It can be applied to pretrained causal transformers at inference time without additional trai…
Source: arXiv · Qwen / Llama / Mistral
ResearchOrdinary
ARCH-B: Architectural Representation, Comprehension and Hierarchy Benchmark
Multimodal models increasingly interpret visual environments, but their ability to recognize the same building across photographs, floor plans, elevations, sections, and renderings remains poorly characterized. We introduce ARCH-B, a bench…
Source: arXiv
ResearchOrdinary
Kafila: Serving Large Language Models on a Trusted Set of Heterogeneous Commodity Machines
Between them, the members of a research group or a circle of friends own several consumer computers, none large enough to run a capable large language model. Existing systems pool such capacity across open swarms anyone may join, which a g…
Source: arXiv
ResearchOrdinary
Singularities of Non-negative Matrix Factorization and their application to Bayesian inference
Non-negative matrix factorization (NMF) is a singular statistical model whose Bayesian asymptotics are governed by the real log canonical threshold (RLCT). We study the local geometry of the factorization map and derive an upper bound for …
Source: arXiv
ResearchOrdinary
Vision--Language Signals in Constrained RL: Safety Gains Without Anticipation
Safe reinforcement learning seeks policies that maximise task performance while satisfying safety constraints. In driving benchmarks, however, collision costs typically appear only at the time of collision, providing no advance warning of …
Source: arXiv
ResearchOrdinary
Large Language Models for Structured Clinical Data Analysis: Dual-Agent Grounding and Validation
Objective: To develop and characterize CLEAR-Med, a dual-agent framework for natural-language analysis of structured clinical data that separates SQL-based invocation from independent validation. Methods: CLEAR-Med uses one agent to transl…
Source: arXiv · ChatGPT
ResearchOrdinary
UOPD: Uncertainty-Aware Intervention for On-Policy Distillation of Multi-Turn Agents
On-policy distillation (OPD) trains a student on its own rollouts using dense supervision from a teacher. In multi-turn environments, a mistake at a critical decision step can redirect the subsequent rollout toward poor outcomes. We use lo…
Source: arXiv
ResearchOrdinary
3D Point Tracking with State Space Models
Tracking any point of a dynamic scene in metric 3D - in absolute meters, not up to an unknown scale - underpins 3D and 4D reconstruction, robot navigation, and autonomous driving, where decisions are made in meters, not pixels. Our objecti…
Source: arXiv
ResearchOrdinary
ADPTNet: Adaptive with Prescriptive Timescales Non-Linear SSM for Sequence Modelling
A central aim of neuromorphic computing is to provide a viable alternative to highly energy-intensive Transformer-based AI. However, efficient alternatives struggle to capture the set of qualities that have secured the Transformer's status…
Source: arXiv
ResearchOrdinary
Faithful Activation Verbalization: Reducing Hallucinations in LLM Representation Interpretation
Activation verbalization methods such as Activation Oracle and Natural Language Autoencoders decode hidden representations of large language models into human-readable natural language. However, existing methods can produce incomplete or h…
Source: arXiv
ResearchOrdinary
Posterior Regimes and Latent Deception: Variational Bayesian Inference in Hidden Markov Models for Sequential Fraud Detection in Financial Transactions
We present a three-tier progression of Hidden Markov Models: maximum-likelihood (Baum-Welch), variational Bayesian (VBEM), and a neural variational extension (Neural VBEM), that model each customer's transaction history as a trajectory thr…
Source: arXiv
ResearchOrdinary
Uncovering shortcut learning in audio classifiers by discovering recurring concepts in temporal explanations
Correlations between events in machine learning datasets may result in shortcut learning, where models learn to predict the target event based on the presence of a correlated event. When these correlations are spurious -- arising from data…
Source: arXiv
ResearchOrdinary
Structure-Adaptive Tree Field Integrators
We present a new class of near-linear algorithms for efficiently integrating general tensor fields defined on trees with distance dependent kernels, the Structure-Adaptive Tree Field Integrators (STAD-TFIs). STAD-TFIs exploit the tree's un…
Source: arXiv
ResearchOrdinary
Jev in Medicine: A Benchmark Evaluation. Preliminary Results
Jev is a non-generative "System One" model that assigns probabilities to predefined answer options and cannot answer outside them. Its accuracy and calibration on medical question-answering and case-based diagnostic-reasoning tasks are unk…
Source: arXiv · GPT
ResearchOrdinary
SR4-Fit: A Unified Interpretable Rule-Based Machine Learning Framework for Informative and Trustworthy Decision-Making
In many high-stakes applications, machine learning is dominated by black-box models that require post hoc explanations to justify their predictions. These explanations are often unreliable because they do not reflect the model's actual com…
Source: arXiv
ResearchOrdinary
Estimate, Don't Imitate: Reusing Differentiable State-Based Policies for Visuomotor Control
Simulation-trained manipulation policies can exploit privileged state information to learn effective contact-rich behaviours, but deployment requires acting from partial observations such as noisy camera images. A common solution is teache…
Source: arXiv
ResearchOrdinary
Maat: Independent Deterministic Contract-Based Governance for Multi-Agent LLM Workflows
Large-language-model multi-agent systems (LLM-MAS) introduce a characteristic reliability problem: an error produced by one agent can be accepted as context by downstream agents and propagate across the workflow. Many proposed safeguards r…
Source: arXiv
ResearchOrdinary
Transfer Learning for Edge Classification on Dynamic Text-Attributed Graphs
Learning transferable representations for dynamic text-attributed graphs (DyTAGs) requires models to capture underlying interaction dynamics that persist across domains. However, existing methods tend to overfit to domain-specific structur…
Source: arXiv
ResearchOrdinary
Sliced Orlicz-Wasserstein
We propose sliced Orlicz-Wasserstein (SOW) distance which is a generalization of sliced Wasserstein (SW) distance. SOW replaces the $L^p$ norm in SW with a Luxemburg norm cost induced by an Orlicz function $φ$. First, we prove that SOW dis…
Source: arXiv
ResearchOrdinary
SynCo: Learning Cross-Modal Synergy by Contrasting Interaction Residuals
Multimodal contrastive learning is a dominant paradigm for learning transferable representations from unlabeled data, but standard objectives primarily capture information that is redundant between modalities. Partial Information Decomposi…
Source: arXiv
ResearchOrdinary
VCRE-Fib: View-Conditioned Regional Evidence for Fine-Grained Ultrasound Grading of Schistosoma japonicum-Associated Liver Fibrosis
Accurate assessment of Schistosoma japonicum-associated liver fibrosis is essential for disease management and long-term follow-up in endemic regions. Ultrasound provides non-invasive imaging, but complex local echogenic patterns and anato…
Source: arXiv
ResearchOrdinary
Mend the Measurement Gap: Latent User Preference Modeling for Short-Form Video Recommendation
Recommender systems rely heavily on heterogeneous behavioral feedback to infer user preference. Although abundant, these signals are imperfect measurements: the same observed behavior can arise from different underlying states, such as gen…
Source: arXiv
ResearchOrdinary
HamiFormer: Dual-Expert Diffusion Fields with Affine Symplectic Maps
Predicting smooth dynamics and collisions requires modeling continuous evolution and abrupt state changes. We introduce HamiFormer, a dual-expert diffusion field combining whole-window denoising with residual-corrected Hamiltonian propagat…
Source: arXiv
ResearchOrdinary
Scanning While Imagining: A Scene-Graph World Model for Robotic Ultrasound Navigation
Ultrasound (US) acquisition depends on the operator's ability to interpret anatomy and anticipate how the view will change with probe motion. Many robotic US navigation methods select actions without explicitly predicting these anatomical …
Source: arXiv
ResearchOrdinary
Radiomap Blind Prediction under Incomplete Observation: Error Characterization and Correctable Propagation-Prior Learning
Radiomap blind prediction aims to infer radiomaps from observable representations of the propagation environment and base station configuration without field measurements. In practice, the observable representations are inherently incomple…
Source: arXiv
ResearchOrdinary
FinancialAuditBench: Benchmark Construction under Differential Privacy Using Real-World Priors
As AI agents are becoming widely adopted in the financial services industry, careful measurement is essential to understand where they can be reliably deployed and where oversight and professional review remain necessary. Such measurement,…
Source: arXiv
ResearchOrdinary
Permutation-Equivariant Flow Matching for Alignment-Free Neural Weight Generation
A trained neural network can be represented by a parameter vector in high dimensions. Learning distributions over these vectors enables the generation of new models across various tasks and architectures. A central challenge is permutation…
Source: arXiv
ResearchOrdinary
Over-the-Air Federated Learning in Heterogeneous Mobile Wireless Networks
Over-the-air computation has emerged as a scalable and efficient solution for deploying federated learning algorithms in wireless networks by exploiting waveform superposition for simultaneous model aggregation. Most existing work struggle…
Source: arXiv
ResearchOrdinary
UniCache: Task- and Type-Aware KV Cache Compression for Unified Multimodal Models
Unified multimodal models combine understanding, generation, and editing within a single network, offering a promising foundation for versatile multimodal applications. However, growing multimodal contexts make KV cache storage and access …
Source: arXiv
ResearchOrdinary
Retimed Bellman Flows: Escaping the Impossible Triangle of Velocity Bootstrapping
Flow critics learn return distributions by transporting Gaussian noise to Bellman endpoints via continuous velocity fields. While velocity bootstrapping stabilizes training by querying a successor teacher, existing methods face a structura…
Source: arXiv
ResearchOrdinary
Improving LLM Collaboration via Multi-Agent Preference Learning
Several works have explored multi-agent reinforcement learning (MARL) in LLM collaboration. However, constructing reliable rewards is difficult in practice, as complete and accurate metrics are often unavailable and hard to aggregate. Pref…
Source: arXiv
ResearchOrdinary
The Decomposition Tax: LLM Pipelines Lose Up to 40 Accuracy Points at Their Own Interfaces
A four-stage LLM pipeline gives up as much as 40.5 accuracy points at its own interfaces (gemma-3-12B on MATH-500, Holm-corrected p = 1.66e-19; the largest tax in the primary family). We hold model, problem, stages, stage prompts and compl…
Source: arXiv
ResearchOrdinary
Routing Drift Alone Does Not Diagnose Failure in Merged MoE LLMs
Model merging efficiently combines specialized large language models (LLMs) without joint retraining, but can substantially alter expert routing in Mixture-of-Experts (MoE) models. Such \emph{routing drift} is often interpreted as routing …
Source: arXiv · Qwen
ResearchOrdinary
Learning Shuffle Ideals with Membership Queries and Contrastive Examples
This paper studies learning of shuffle ideals with membership queries as well as with contrastive queries---a form of membership query that reveals not only whether a selected word $w$ is in the target language or not, but also provides a …
Source: arXiv