AI Research & Papers
整理大Models、智能体、多模态、机器学习与生成式 AI 的Research、基准和研究进展。
Category articles2148
当前页48 / 54
UpdatesPermanent archive
Category articles
按发布Time从新到旧 · 每页 40 stories
ResearchOrdinary
When Does Scale-Invariant Optimization Become Unstable? An Exact Schedule Law with Weight Decay
Normalization renders large parts of neural networks effectively scale invariant, inducing a hidden feedback loop in which learning-rate schedules and weight decay interact through the parameter norm to control the effective step taken by …
Source: arXiv · GPT
ResearchOrdinary
MeClear: Cooperative Game-Theoretic Attribution and Risk-Aware Memory Clearance for Long-Horizon LLM Agents
Long horizon Large Language Model (LLM) agents rely on external memory systems to preserve user preferences and task knowledge across extended interactions. Conventional retrieval mechanisms optimize semantic compatibility rather than down…
Source: arXiv
ResearchOrdinary
SAEScientist-Bench: Can AI Agents Conduct Autonomous SAE Interpretability Research?
While research on recursive self-improvement (RSI) has predominantly automated model training pipelines, reliable autonomous development demands a missing pillar: post-hoc monitoring and auditing to understand what models learn and ensure …
Source: arXiv
ResearchOrdinary
Curriculum Learning as Transport: Understanding Curricula with Wasserstein Geodesics
Curriculum learning is governed by several coupled design choices---how difficulty is defined, how examples are ordered, how much exposure each level receives, and how quickly training moves across levels---making it hard to isolate what a…
Source: arXiv
ResearchOrdinary
The Surprising Effectiveness of Approximate Value Iteration in Self-Play
Combining search with function approximation has driven major advances in game-playing programs, making self-play algorithms more competitive than ever. Still, the computational overhead of the most popular methods, based on Monte Carlo Tr…
Source: arXiv
ResearchOrdinary
Measuring LLM Sycophancy under Sustained Multi-Turn Pressure
Large language models (LLMs) may abandon correct positions when users push back, exhibiting a failure mode known as sycophancy. Existing evaluations typically use short, pre-specified conversations and may therefore miss failures that emer…
Source: arXiv
ResearchOrdinary
It's Not RoPE that Creates Sinks: The Role of Self-Concentration and Value-Non-Mixing in Attention
Large Language Models (LLMs) often exhibit "Attention Sink" (AS) and the accompanying "Massive Activations" (MAs) at the initial position of a sequence. These phenomena frequently co-occur, and MAs can pose challenges for low-bit quantizat…
Source: arXiv
ResearchOrdinary
GoDeep: Annotation-Free Open-Vocabulary 3D Scene Understanding via Language-Space Lifting
Open vocabulary 3D semantic segmentation methods typically lift CLIP features into 3D. This embeds points in a joint vision-language space known to behave like a bag-of-words on compositional tasks. Furthermore, even annotation free varian…
Source: arXiv
ResearchOrdinary
Everything in Moderation: Per-Domain Coverage Optima and Alignment-Resistant Domain Gaps in Multi-Domain Mid-Training
Mid-training, the stage between pre-training and alignment, is where a model's per-domain data composition is typically set by data availability rather than principled design. We ask what that decision buys, and whether a later alignment p…
Source: arXiv · Qwen
ResearchOrdinary
ActReview: Rebuttal-Guided Training Data and Rubric Rewards for Actionable Peer Review Generation
As LLMs are increasingly used for pre-submission self-review, there is growing demand for feedback that not only identifies weaknesses but also guides authors toward concrete revisions. We study this as Actionable Peer-review Generation an…
Source: arXiv · Qwen
ResearchOrdinary
ThinkPrior: Zero-Rollout Difficulty Priors for Cold-Start Prompt Selection in RLVR
In reinforcement learning with verifiable rewards (RLVR) trained with group relative policy optimization (GRPO), the KL-free reward-advantage term studied here depends on within-group reward variation. If all rollouts in a group are correc…
Source: arXiv · Qwen
ResearchOrdinary
ToolLoop: Closed-Loop Tool-Use Data Synthesis via Decomposed Generation and Dynamic Self-Feedback
High-quality tool-use data is critical for training language models to interact effectively with external tools. However, existing synthetic approaches typically follow a generate-then-filter paradigm with static post-hoc verification, oft…
Source: arXiv
ResearchOrdinary
Performance of Clinical AI System and Physicians and Frontier Language Models in primary care diagnostics
Clinical AI evaluation should encompass diagnosis and management after adaptive information gathering. We compared Doctorina, eight physicians and four standalone frontier language models in 150 synthetic Polish-language primary-care consu…
Source: arXiv · Claude / Kimi
ResearchOrdinary
Multi-Task Learning for Sparsely-Labeled Time Series: A Case Study on Cold-Hardiness Modeling
We present a real-world case study of multi-task learning (MTL) for temporal process modeling from limited data with temporally sparse labels. Specifically, we investigate multi-task learning for the important agricultural problem of predi…
Source: arXiv
ResearchOrdinary
PlayTrain: An Efficient Reinforcement Learning Framework for LLM-Generated Adaptable JavaScript Games
While many video-game environments (VGEs) have played crucial roles in advancing reinforcement learning (RL), developing novel VGEs or modifying existing ones to support new features, has been a laborious process requiring extensive hand-c…
Source: arXiv
ResearchOrdinary
Time-Varying Data as Sheaves: an Invitation to Narratives
Modern science and engineering increasingly rely on time-varying data, yet the mathematical tools used to model temporal phenomena are often developed within separate disciplines, obscuring common principles and limiting the transfer of id…
Source: arXiv
ResearchOrdinary
Training-Free Task Vectors for LLM Behavioral Control
Task vectors enable post-training model editing by identifying semantically meaningful directions in weight space, typically computed as the difference between a fine-tuned model and its pretrained initialization. However, this reliance on…
Source: arXiv
ResearchOrdinary
The Audit Decides the Verdict: Instrument Effects Rival Demographic Bias in LLM Decision Audits
Whether a language model looks demographically biased can depend on how the audit asks its question. A charitable-aid benchmark reports that the same models favor minority applicants when rating requests one at a time and penalize some whe…
Source: arXiv
ResearchOrdinary
Do Reasoning Representations Help Humans Evaluate LLM Outputs?
Reasoning representations are increasingly used as explanations for large language model outputs. Yet they are typically evaluated with model-centric criteria, such as answer accuracy and faithfulness, leaving it unclear whether they help …
Source: arXiv
ResearchOrdinary
Answer-Distribution Trajectories: A Stochastic-Dynamics View of LLM Reasoning
Chain-of-thought reasoning provides a structured computation between a model's input and final answer. Yet it is often evaluated through endpoint accuracy, which ignores the path taken to reach that answer. An emerging line of work address…
Source: arXiv
ResearchOrdinary
It Is Not My Code Anymore
AI-assisted programming raises distinct questions about who produces code, who feels ownership of it, and who is responsible when it fails. This research note examines these distinctions through a hypothetical enrollment failure and a sele…
Source: arXiv
ResearchOrdinary
Closed-Form of the Local Galactic Potential and Stellar Distribution Function from Gaia DR3
The local dark matter density determines the strength of the signal expected in direct-detection experiments, yet published estimates from stellar motions disagree by more than their errors, and the most recent machine-learning analysis of…
Source: arXiv
ResearchOrdinary
Let It Go or Learn to Self-Correct: Continuous Diffusion for Constrained Discrete Tasks
Denoising Diffusion Probabilistic Models (DDPMs) generate samples by starting from noise and repeatedly denoising while keeping each update close to the current noisy state. This behavior is effective in many continuous domains, but its ro…
Source: arXiv
ResearchOrdinary
Banger paper from Tencent on environment evolution. Environment supply is becoming the main limit o…
Source: X:Elvis Saravia (@omarsar0, DAIR.AI)
ResearchOrdinary
UniMate: One Unified Model to Animate Diverse Skeletons
Recent advances in automatic rigging now deliver animation-ready 3D assets at scale, yet generating the motion to drive them remains a bottleneck. Existing learned animators are topology-constrained: they rely on category-specific template…
Source: arXiv
ResearchOrdinary
WearableQA: A Benchmark for Health Reasoning over Real-World Wearable Data
Recent advances in wearable sensing enable continuous monitoring of physiological and behavioral signals, yet existing benchmarks rarely evaluate whether AI systems can reason over a real user's longitudinal wearable record. We introduce W…
Source: arXiv
ResearchOrdinary
Diffusion TV: Experiencing Diffusion Models through Tangible, Embodied Interaction
Diffusion TV is an interactive AI art installation that offers a tangible and embodied experience of diffusion models through a modified CRT TV. By physically manipulating the TV's antenna, audiences control the clarity of AI-generated ima…
Source: arXiv
ResearchOrdinary
RegionFed: Federated Learning for Personalized Query Understanding in Heterogeneous Retail Environments
Retail search systems serve diverse geographic regions with distinct query patterns, vocabularies, and product preferences, creating significant data heterogeneity that challenges both privacy-preserving training and model personalization.…
Source: arXiv
ResearchOrdinary
Same Trajectory, Contradictory Rewards (ROBORMBENCH): Paraphrase Fragility in Vision Language Reward Models
Vision-language models are increasingly used as reward functions for robotic learning, but this role requires paraphrase invariance: the same trajectory should receive the same reward under semantically equivalent goal descriptions. We sho…
Source: arXiv
ResearchOrdinary
A Deep Generative Model for Synthesizing Labeled Wireless Signals
Wireless signals with position-related labels are pivotal for both performance evaluation and model training in the realm of wireless sensing. However, acquiring real-world datasets is often challenged by significant measurement and labeli…
Source: arXiv
ResearchOrdinary
Multi-Step Tool-Calling over Korean Open Public APIs: A Benchmark and a Data-Synthesis Recipe
Data-sovereignty regulations increasingly require public institutions to deploy open-source, on-premise LLM agents that chain multiple tool-calls across live government APIs. However, open-source models consistently underperform in this mu…
Source: arXiv
ResearchOrdinary
Necessary or Sufficient? Evaluating LLM Explanations With Behavioural Evidence
LLM decision components that can operate within agent workflows often produce action-relevant recommendations or judgements together with explanations. Operators may use the named factors to monitor a system, diagnose errors, or decide whe…
Source: arXiv · GPT / Claude / Gemini
ResearchOrdinary
Reflection-aware Generative Novel View Synthesis
We propose Ref-GeNVS, a training-free, reflection-aware method for generative novel view synthesis (NVS) in mirror scenes. Existing multi-view diffusion models often fail to recognize the mirror in the scene and cannot exploit reflected co…
Source: arXiv
ResearchOrdinary
Molecular Déjà Vu: Digit-Level Retrieval of Published Values in Frontier Language Models
Large language models (LLMs) are increasingly evaluated on molecular property benchmarks, but accuracy cannot distinguish a model that predicts a property from one that retrieves a published number. We audit 22 frontier models on 12 regres…
Source: arXiv
ResearchOrdinary
What Matters, When? Diagnosing and Improving Conditional Visual Grounding in Visuomotor Imitation Policies
Visuomotor imitation policies can achieve high performance under in-distribution visual conditions yet fail when visually similar objects or receptacles are introduced. We study this behavior as a problem of conditional visual grounding: t…
Source: arXiv
ResearchOrdinary
CUA-Universe: A Scalable and Dynamic Environment for Hybrid GUI+CLI Agents
Computer-use agents have advanced on benchmarks like OSWorld and AndroidWorld, but still act mostly through the GUI, often producing inefficient trajectories. Real-world computer work is hybrid, combining visual-state inspection with preci…
Source: arXiv
ResearchOrdinary
When LLM Decompilers Recompile More and Preserve Less
Decompilation recovers high-level source from compiled machine code and serves as a foundation for security tasks such as vulnerability detection and malware analysis. Traditional decompilers like Ghidra and Hex-Rays expose whatever they c…
Source: arXiv
ResearchOrdinary
Design Docs Are All You Need: An AI-native Machine-Learning Performance Tool
Machine-learning performance modeling is a uniquely hostile terrain for long-lived software: the assumptions baked into today's abstractions are invalidated by tomorrow's models and systems, forcing perpetual refactoring of performance-mod…
Source: arXiv · DeepSeek
ResearchOrdinary
Distill Globally, Adapt Locally: Reasoning Distillation and Product-Type Test-Time Training for Scalable Trade-Up Recommendation
Trade-up recommendation identifies higher-quality alternatives that preserve a customer's purchase intent while offering upgraded benefits. Large language models (LLMs) can reason about such distinctions, but applying them directly to hund…
Source: arXiv
ResearchOrdinary
Who Should Grade My Work? Student Perspectives on Transparent AI-Assisted Writing Assessment in Higher Education
The integration of GenAI tools into higher education assessment raises important questions about how students understand, interpret, and respond to AI-mediated evaluation. As instructors increasingly explore AI tools for providing feedback…
Source: arXiv · ChatGPT