New Machine Learning (cs.LG) papers, Monday 19 October 2026
224 papers announced on arXiv. Get them ranked for you, free →
Property Estimation in Geotechnical Databases Using Labeled Random Finite Sets
The sufficiency of accurate data is a core element in data-centric geotechnics. However, geotechnical datasets are essentially uncertain, whereupon engineers have difficulty with obtaining precise information for making decisions. This challenge is more apparent when the…
CausalEvo: Causal Skill Self-Evolution for Health LLM Agents
Large language model (LLM) agents for health can accumulate reusable textual skills from task feedback, such as calculation criteria, measurement time points, and formula units. Deciding which skills to retain is consequential: useful rules improve later answers, while faulty…
How language model agents reshape price competition
Repeated Bertrand competition is a stringent benchmark for algorithmic pricing: in homogeneous-goods markets, standard learning procedures typically select the stage-game Nash outcome with prices near marginal cost. We show that LLM pricing agents can escape this benchmark,…
Encoded but Exposed: Language Embeddings can Reveal More Than They Should in Recommender Systems
Language embeddings are increasingly used in recommenders to represent item content, but their privacy risks remain poorly understood. We study whether item embeddings can reveal item identities when an adversary has access to auxiliary item text from external sources. We show…
Causal Integrated Gradients: Scalable Feature Attribution Along Causal Paths
Existing feature attribution methods that account for feature dependencies do not scale to high dimensions. We propose causal integrated gradients (CIG) and causal expected gradients (CEG), which extend integrated gradients to incorporate prior causal structure among input…
Physics-Transfer Learning: A Physics-Constrained Theory for Zero-Shot Generalization Along the Ladder of Complexity
Reliable out-of-distribution generalization remains a central challenge in machine learning, particularly when models are deployed in data-scarce high-fidelity domains. Existing approaches often rely on statistical distribution alignment, or invariance assumptions that can fail…
Memory Bandwidth, Not FLOPs: Profiling and Accelerating Query-Based Segmentation Decoders on Edge GPUs
AI summaryThe paper shows query‑based segmentation decoders are memory‑bandwidth‑bound on edge GPUs, not FLOPs, and introduces CompactInst, a parameter‑free spatial pooling scheme that cuts decoder traffic by 4×, yielding 2–5× speedups with minimal accuracy loss.
When is a large language model a good calibration agent? Physics-labeled prompting for budgeted engineering simulator calibration
AI summaryLLMs guided by physics‑labeled prompts produce superior early parameter updates for expensive simulator calibration, reducing error 21.9× faster than physics‑free methods in the first five evaluations. A hybrid LLM‑warm‑start followed by conventional optimization reaches target accuracy in just nine runs.
Trust but Verify: Designing Region-Inhomogeneous Forward Dynamics for Discrete Diffusion
AI summaryThe paper proposes a region‑inhomogeneous forward diffusion where missing tokens use absorbing dynamics while context undergoes low‑rate random substitution, allowing the model to learn to detect and correct corrupted context. Fine‑tuning on a 170 M masked diffusion improves infill F1 by 3.8–6.4 points at 10–20% corruption while keeping clean performance intact.
Binding-Specific Relearning Savings for Test-Time Continual Learning
AI summaryThe study shows that learning a specific factual binding in a language model yields a measurable relearning advantage at test time, speeding recovery by ~18% over controls and reducing updates needed, indicating current accuracy metrics underestimate lasting experience effects.
Deep Learning for Forest Plantation Mapping in Godavari Districts of Andhra Pradesh, India
Small-area forest plantations play a vital role in the socioeconomic well-being of farmers in Southeast Asia. Most plantations are established on former agricultural land, often on land less suitable for agriculture. Plantations that are converted from natural forest have…
CGDT-CESN: Correlation-Guided and Dynamics-Trained Clustered Echo State Network for Multivariate Time-Series Prediction
AI summaryCGDT‑CESN trains a clustered Echo State Network where each cluster specializes in one variable and inter‑cluster links are guided by empirical correlations, then fine‑tunes those links. This yields up to 15‑20 % better multivariate forecasts on Twitter cascades and solar wind data, even with limited training data.
GPU-Accelerated Robust MA--RIS Pre-Optimization for Communication and Target Illumination
AI summaryGPU-accelerated RAMP pre-optimizes MA geometry and RIS phases for ISAC, yielding a reusable Pareto set that balances expected worst-user data rate and transmit-side worst-target illumination across channel regimes. It achieves competitive robust Pareto quality without online re‑optimization.
An Adaptive-Horizon Graph Neural Operator for coupled surrogate morphodynamic modelling
AI summaryAdaptive-Horizon Graph Neural Operator (AH‑GNO) learns bed‑elevation changes from recent hydrodynamic and topographic states on unstructured meshes, allowing the history length and update interval to vary with flow. It matches Telemac2D/GAIA predictions while accelerating bed‑update from 12–1204 s to 0.08–3.34 s, a 150–360× speed‑up.
BOLT: Multi-Bottleneck Bound-Guided Learning for Flexible Job-Shop Scheduling with Time Lags and Resource-Coupled Transport
AI summaryBOLT constructs a tight lower bound from chain, capacity, and fleet relaxations for transport‑coupled job‑shop scheduling and uses its stepwise increase as a reward, guaranteeing a provable makespan floor. It outperforms penalty and dispatching‑rule baselines on large construction instances, achieving up to 13 % makespan savings and sub‑hour re‑planning time.
TRACE: Transformer Residual Activation Codebook Encoding for Communication-efficient Distributed Edge Inference
AI summaryTRACE replaces post‑attention residuals with a vector quantizer, sending only codebook indices between edge devices so receivers can look up keys/values directly, eliminating downstream computation. This reduces communication by up to 22,624× and boosts ViT/ViViT inference speed by 1.27× with <1.9% accuracy loss.
Generative adversarial networks with Monte Carlo dropout uncertainty quantification for structural health monitoring: Fibre Bragg grating data augmentation comparison in Hawk T1A aircraft
AI summaryGenerative adversarial networks with Monte‑Carlo dropout produce realistic structural response signals and quantify uncertainty. On a Hawk T1A aircraft dataset, the synthetic data match experimental measurements and improve damage‑classification performance, providing a useful digital‑twin for safety‑critical monitoring.
CF-NODE: Counterfactual Spatial Node Intervention for Test-Time Adaptation Under Domain Shift, Evaluated Across Five Diabetic Retinopathy Datasets
AI summaryCF‑NODE adapts a frozen DR grading model to each test image by counterfactually attenuating the most influential spatial nodes and calibrating the grade distribution based on the stability of the response. It achieves higher AUC and macro‑F1 than TENT, EATA, SAR, and T3A across five external datasets.
Rank Measures of Fine-Tuning Updates Need a Noise Baseline
AI summaryThe paper shows that fine‑tuning weight updates have ranks only slightly below random noise, unlike previously thought. It demonstrates that rank‑based metrics lack meaningful baselines, and alignment claims need controls against non‑alignment data.
Sparse Autoencoders Can Induce Local Geometry for Mitigating Catastrophic Forgetting
AI summarySAGA uses a Sparse Autoencoder to create local low‑rank constraints on representation drift at each task boundary, guiding replayed examples and penalizing leading Jacobian directions. It outperforms ER, DER++, ER‑ACE, and SGD, improving Class‑IL accuracy by 12.15–4.79–3.22 points on CIFAR‑100, CUB‑200, and ImageNet‑R.
Null Controls Are Necessary but Not Sufficient: Evaluating Acceptance Guards for Scientific Discovery and Interpretability
AI summaryThe paper introduces four operations to modify physical models and evaluates acceptance tests (NAR, PAR, CAR). It shows that null models can pass descriptive tests yet fail consequence checks, highlighting gaps that must be addressed for reliable automated scientific discovery.
Learnable Splines for Unstructured Neural Operators
AI summaryLearnable spline neural operator that maps irregular meshes to a latent Cartesian grid via a sparse B‑spline transfer; achieves high accuracy on 3‑D engineering benchmarks with lower memory, supports zero‑shot super‑resolution, and provides rigorous error bounds via Bernstein hulls.
Lean4AgenticRL: Advancing Agentic RL with Verifiable Multi-level Process Rewards
AI summaryLean4AgenticRL introduces multi‑level process rewards grounded in Lean4 formalization, enabling verification of low‑level toolcalls, mid‑level workflow stages, and high‑level outcomes. Its GRPO algorithm trains LAR‑27B, achieving 77.3% on TerminalBench‑2.1 and surpassing similar‑sized baselines by ~10%.
Where Prefill Expert Reduction Hurts MoE Models: A Few Prompt Tokens Carry Most of the Short-Answer F1 Loss
AI summaryReducing the number of routed experts during prompt prefill mainly hurts short‑answer QA because early prompt tokens become sensitive; at half the experts, F1 drops by roughly one‑third of the loss when only the first few prompt tokens are routed. Restoring full‑routing only for those few tokens recovers most of the F1 loss.
Progressive Misalignment Can Emerge from Benign Recursive Self-Distillation
AI summaryThis paper demonstrates that recursively training models on their own safe generations using benign auxiliary cues causes progressive misalignment, leading to increased vulnerability to harmful queries across multiple model families.
Has GPT-6-Astra Achieved Embodied Intelligence?
AI summaryGPT‑6‑Astra shows unprecedented performance on 12 embodied robotics benchmarks, achieving high success rates with in‑context learning and a System 2/1 control loop. However, it still struggles with costly demonstration collection, real‑time constraints, and long‑horizon robustness, limiting practical embodied intelligence.
Upper bounds on the number of causal pieces in spiking neural networks
AI summaryThe paper upper‑bounds the number of causal pieces a feedforward single‑spike neural network can generate. It shows a general poly‑Bernoulli combinatorial bound and tighter hyperplane‑based bounds for various integrate‑and‑fire and ReLU‑type neuron models.
Generative Value Classifier
AI summaryThis paper introduces the Generative Value Classifier, which reformulates Q-learning by predicting action likelihoods given returns rather than just predicting returns from state-action pairs. This approach improves performance on both online and offline reinforcement learning tasks compared to standard discriminative methods.
Predicting Privileged Information Effectiveness for On-Policy Self-Distillation
AI summaryThis paper evaluates privileged information configurations for on-policy self-distillation in LLM agents and introduces KL-based metrics to predict their training utility. The proposed metrics reliably select effective privileged information, improving downstream agent performance over random selection and standard baselines.
Towards Reconstructing Geographically Diverse Architecture with 3D Foundation Models
AI summaryThe authors introduce ArchWorld, a benchmark of geographically diverse architectural landmarks, to analyze performance disparities in 3D foundation models. They find that model errors stem from region-specific architectural features and propose an intervention scheme that improves overall accuracy while reducing geographic performance gaps.
Source-Aware Dynamic Pricing with Strategic Buyers
AI summaryThis paper introduces a source-aware dynamic pricing framework that handles both verified and strategically manipulated self-reported buyer features. The proposed SALE policy achieves a sublinear expected regret bound by combining localized exploration with strategic correction.
Learning smooth dynamics via Kinematic Interpolants
AI summaryThe paper introduces Kinematic Interpolants, a framework leveraging position and velocity measurements to infer nonlinear dynamics. It achieves superior reconstruction of dynamical systems while requiring a fraction of the training time compared to existing baselines.
Learning the Shared Latent Structure of Cryo-EM Inverse Problems
AI summaryThis paper introduces EMber, a family of vision transformers pre-trained on millions of cryo-EM images using complementary global and masked patch objectives. EMber improves conformational and compositional discrimination by over 14 percentage points and enables reference-quality reconstructions in fewer epochs.
Don't Retrain, Remix: Adaptation of Web Agents using Mixture Hypernetworks
AI summaryWebMix uses a mixture hypernetwork that composes pre‑trained low‑rank adapters via a scouting run to adapt web agents to unseen interfaces without retraining. It outperforms in‑context learning and LoRA baselines, improving TimeWarp domain transfer by ~8 % and matching specialist performance.
HeRE: A Novel Benchmark for Hebrew Relation Extraction via LLM-Guided Denoising of Knowledge Graph Alignments
AI summaryHeRE builds a 1.5‑million‑instance Hebrew relation‑extraction benchmark by denoising noisy knowledge‑graph alignments with LLM‑guided NLI. Gemma‑4‑31B‑it scores F1 = 0.915, matching GPT‑5.4, and the dataset enables scalable, language‑agnostic RE evaluation.
On the SPOT: Enhancing Speculative Decoding for Diffusion Language Models via Commit-Order Prediction
AI summarySpeculative Decoding for Diffusion Language Models (SPOT) predicts the order of token generation from prior model outputs, enabling a tree of candidate continuations that the target verifies in a single pass. This reduces target passes by up to 6.8× and boosts throughput by 3.2× over standard decoding.
When Plans Change, Remember: Replanning-Guided Visual Memory for Vision-Language-Action Models
AI summaryThis paper introduces RePlanMem-VLA, a memory management method for vision-language-action models that uses policy plan revisions to selectively store task-relevant visual observations. The resulting system successfully preserves critical information while eliminating redundancy across long-horizon robotic tasks.
Deterministic Bounds on Accuracy and Stability of Metric-Space Regression and Classification
AI summaryThe paper proposes a geometric framework that uses the average kernel size to give deterministic, non‑asymptotic bounds on empirical error and accuracy for regression and classification, independent of the model class, and demonstrates these bounds on tabular and image datasets.
Coverage Cliffs in Off-Policy Quantile Certification
AI summaryTailCert certifies a policy’s upper-tail quantile from logged bandit data, providing a PAC‑Bayes lower‑confidence envelope over thresholds; it guarantees sample complexity linear in overlap W, logarithmic in policy‑search, and quadratic in the inverse safety margin, matching lower bounds.
Structure-Aware Spatial Kernels for Gaussian Process Distributed Port-Hamiltonian Systems
AI summaryStructure‑aware spatial kernels for Gaussian‑process distributed port‑Hamiltonian systems decouple state and spatial dependencies, removing irrelevant coordinates and allowing a modular spatial kernel choice. Experiments on a nonlinear string show that this decoupling improves reconstruction, and matching the spatial kernel to stiffness profiles yields large accuracy gains.
Embodiment-Classifier Guidance: Transferring Frozen VLAs Across Robot Dynamics without Demonstrations
AI summaryThis paper introduces embodiment-classifier guidance to adapt frozen flow-based vision-language-action policies to new robot bodies without demonstrations or parameter updates. Using gradients from a lightweight classifier trained on a few calibration tasks, the method improves average target success from 72% to 80% on simulation benchmarks.
Noise-Robust Forced Alignment for Spontaneous Speech
AI summaryImproves forced alignment on spontaneous noisy speech by replacing MFCCs with upsampled WavLM features, adding explicit filler/non‑lexical phone units, and a discriminative projection trained on clean/noisy pairs. Achieves 20.6 ms (Buckeye) and 76.9 ms (FluencyBank) MAE, 19–17 % better than 10 baselines.
Initiating Removal from Operational Symptoms in Federated Vehicular Networks
AI summaryThe paper introduces \method{}, a federated unlearning method that neutralizes operational symptoms in vehicular FL by projecting errors into a subspace of recent increments and backward‑scoring contributions. It reduces residual harm by 43–61% versus baselines while keeping utility within 0.36 points of full retraining.
Flat Loss, Evolving Features: Grokking in Modular Addition
AI summaryReLU networks on modular addition can maintain 100 % training accuracy while training cross‑entropy stays flat above zero, and test accuracy rises above 90 %; this is provable for one‑hidden‑layer networks and observed empirically in deeper nets and transformers.
Diagnosing GNN Failure Modes with Layer-Wise Probe Entropy
AI summaryThey propose freezing a trained GNN, fitting linear probes per layer, and tracking probe accuracy with normalized entropy. The entropy curves reveal when smoothing is helpful, neutral, or harmful, distinguishing heterophily mismatch early and oversmoothing in deep models.
Can LLMs predict the outcomes of machine learning experiments?
AI summaryLarge language models can predict the performance of their own proposed ML experiments better than chance but explain only ~50 % of outcome variance; they systematically underestimate effect sizes, show task‑dependent accuracy, and are largely indifferent to the coding harness used.
Rarity of Singletons Matters & Supplementary Materials
AI summaryThe paper introduces a fragility‑aware framework that measures the instability of singleton counts and adaptively regularizes missing‑mass and unseen‑species estimators. It achieves closed‑form, concave solutions that outperform classical methods like Good–Turing and Good–Toulmin in small‑sample, long‑tailed settings.
Shift-Reliance Alignment: Ranking Vision-Language Models by the Cues They Trust
AI summaryShift-Reliance Alignment measures how much a VLM relies on cues like context or text by editing source images, then uses that reliance scaled by the shift (proportion of target questions misled) to rank models. SRA picks models that reduce error on misleading target sets, achieving up to 18.8% error versus 30.4% with source-only ranking.
Noise-shaped Sampling and Annealing for Scalable On-the-edge Training of Binary and Ternary AI Models
AI summaryThe paper introduces $\Sigma\Delta$-Sampler, an optimizer that embeds stochastic sampling and annealing within a noise‑shaping loop to align Ising solvers with generalization‑oriented training. It achieves near full‑precision accuracy on large ternary models while cutting training memory use by 50% and speeding training by an order of magnitude.
Understanding Stability of Outer Nesterov Momentum on Stochastic Pseudo-Gradients
AI summaryThe paper analyzes how outer Nesterov momentum, local steps, and worker averaging affect stability of distributed training with pseudo-gradients. It derives a mean‑square stability criterion for random quadratics, showing inner batch size and worker count trade‑offs, and validates the theory on neural networks.
Network-Wide Freeway Speed Nowcasting and Forecasting from Sparse Fixed Sensors with a Probe-Supervised Graph Convolutional Recurrent Network
AI summaryA graph‑convolutional recurrent network called GCRN+ predicts hourly freeway speeds on all 4,127 links of the Dallas–Fort Worth network using only sparse fixed sensor data and probe‑vehicle supervision, achieving RMSEs of 2.21 mph (nowcasting) and 2.39 mph (next‑hour) on unsensed links.
Alert-List Concordance for Evaluating Imputation Strategies in ICU Sepsis Prediction
AI summaryThe study introduces alert‑list concordance, measuring Jaccard similarity of top‑risk patient lists across imputation methods. It finds that many methods have similar AUROC yet differ significantly in patient selection, with ForwardFill showing the lowest overlap.
The Ephemeral Cost of Switching Optimizers Across LLM Training Stages
AI summaryThe study trains 1.2B Llama‑3 models with varying mixes of AdamW and Muon optimizers, finding no significant penalty for switching optimizers between pretraining and fine‑tuning. Muon remains competitive on downstream benchmarks even when the model was pretrained with AdamW.
Is a Linear Probe Evidence of a Linear Representation?
AI summaryLinear probes can be misleading: they succeed on any rich feature map, even random kernels, because they only capture a linear subspace. The paper introduces reverse predictivity, spectral concentration, and OOD tests to show pretrained transformers encode more complex, curved structures, not a purely linear representation.
Edit Discovery in Human-AI Interactions
AI summaryThe paper defines Edit Discovery Optimization (EDO) to decide when a costly editor should inspect AI responses, formulating a cost-adjusted threshold policy. Its EDIT algorithm learns online, respects an editor budget, and outperforms batch LLM selection on QA benchmarks.
AlphaBet: Reinforcement Learning for LLM Event Forecasting Agents
AI summaryAlphaBet is a reinforcement learning framework that trains LLM agents to iteratively search for evidence and forecast outcomes across multiple dates. By supervising models with proper scoring rules over resolved events, it significantly reduces forecasting error on benchmark datasets.
Quantum-Classical Neural Networks for Solving Lindblad Master Equations
AI summaryThis paper introduces a hybrid quantum-classical neural network to solve Lindblad master equations while naturally preserving density matrix properties. The authors prove that the classical component enlarges the hypothesis class and improves trainability compared to purely quantum models.
Optimal approximation of smooth functions by ReLU neural networks
AI summaryThis paper establishes optimal ReLU network constructions for uniformly approximating Hölder functions across all dimensions and smoothness levels. The resulting architectures achieve the information-theoretic optimal approximation error and minimax regression rates without extraneous logarithmic factors.
Chance-Constrained Personalized LLM Routing with Online Preference Learning
AI summaryThis paper introduces a constrained contextual bandit algorithm for personalized LLM routing that minimizes inference cost while guaranteeing response quality based on online preference feedback. The method achieves sublinear cost regret and high-probability satisfaction guarantees compared to an optimal oracle.
Data Provenance Aggregation and Structural Descriptors for Query-Template Identification
AI summaryThis paper uses aggregated data provenance to build query‑level profiles and compact Provenance Structural Descriptors (PSD). Experiments on 12,500 TPC‑DS queries show that these provenance footprints accurately identify query templates, with PSD achieving high accuracy even with limited training.
Normalizing Flow Maps
AI summaryNormalizing Flow Maps learn invertible dynamical system integrators that give exact likelihoods. On CIFAR‑10, ImageNet‑64 and Boltzmann‑generator benchmarks they match or beat state‑of‑the‑art normalizing flows in sample quality while enabling tractable likelihood evaluation.
Spectral Limits of Polynomial Graph Filters on the Long-Range Ising Model Benchmark
AI summaryPolynomial‑adjacency filters hit an irreducible error floor on the Long‑Range Ising benchmark, independent of degree; a 50‑coefficient strided filter trained on labels reduces test error 52× below prior state‑of‑the‑art, while a dilated convolution surpasses published results at 256 and 1024 nodes and sets new in‑domain benchmarks for larger lattices.
CoLU: Confidence-Weighted Layerwise Unlearning for Large Language Models
AI summaryCoLU applies confidence‑weighted forgetting and retain regularization to a single transformer layer, and uses Brief Layer Screening with a normalized forgetting‑retention score to select layers, achieving 60–80% faster runtime and superior forgetting and retention on TOFU, MUSE Books, and News while saving 77–80% GPU memory.
The LLM-Attacker: A Unified Red-Team Framework for Privacy Evaluation of Split and Distributed LLM Systems
AI summaryThis paper introduces LLM-Attacker, a unified framework for standardizing privacy evaluations and text reconstruction attacks in split and distributed language model systems. Experiments using the framework demonstrate that granting attackers access to training gradients significantly increases both token and exact-document recovery rates.
OrderFlowDiT: Transport-Regularized Diffusion Transformer for Probabilistic Limit-Order Supply Forecasting
AI summaryOrderFlowDiT trains a diffusion transformer on bid/ask volume fields using an unbalanced optimal‑transport loss, improving joint price–volume prediction. Across 30 U.S. equities, UOT reduces transport cost by 45.8 % and energy score by 26.1 % over MSE‑only training.
Reading the News Without Hindsight: NoLBERT Topics and the Cross-Section of Stock Returns
AI summaryThe authors introduce NoLBERT, a financial news encoder trained strictly on historical text to prevent hindsight bias. They find that while NoLBERT yields stable topics, text-based models ultimately fail to outperform price-only benchmarks in out-of-sample stock return forecasting.
Native Geometry vs. Linear Recoverability: How Alignment Changes Platonic Scaling
AI summaryThis paper investigates how model scale affects representation similarity across different datasets and architectures. The main result is that larger models improve linear recoverability of representations much more clearly than they establish convergence toward a shared native geometry.
Refusal Is Not Robustness: Measuring Harmful Reachability in Autoregressive Language Models
AI summaryThis paper introduces bounded continuation analysis to measure the probability that an autoregressive language model reaches harmful generations despite outputting a safe response. The method reveals substantial hidden risk in models that appear robust under standard attack success rate evaluations.
Shape-Aware Neural Time Fields for Rigid-Body Motion and Manipulation Planning
AI summaryThis paper introduces Shape-Aware Neural Time Fields, a physics-informed neural framework that learns reusable cost-to-go representations for rigid-body motion planning. The method achieves higher success rates and inference efficiency than existing neural baselines while matching classical planner performance at significantly lower computation times.
Acquisition Function-Guided Generation for Bayesian Optimization over Discrete Spaces
AI summaryThis paper introduces acquisition function-guided generation for discrete Bayesian optimization, using a diffusion bridge to enable gradient-based sampling from a pretrained generative model. The proposed method outperforms or matches state-of-the-art baselines across various molecular design benchmarks.
One Communicator, Three Vendors: Extending the MoA Predictive Theory to a Real NVIDIA+AMD+CPU MPI Ensemble
AI summaryThis paper extends Mixture-of-Agents predictive theory to a multi-vendor MPI ensemble uniting NVIDIA, AMD, and CPU ranks. The authors demonstrate successful cross-architecture communication and validate launch-geometry models, revealing significant performance and timing discrepancies across hardware vendors.
Unit-level aggregation breaks coverage in causal foundation models
AI summaryCausal foundation models struggle with group-level uncertainty quantification because they assume unit-level errors are independent, ignoring correlations from posterior uncertainty over the data-generating process. Jointly predictive neural process models fix this failure and restore correct coverage.
Reusing Calibration Gains across Model Representations
AI summaryThis paper shows that calibration updates learned for one model representation can be directly transferred to other representations of the same pretrained model without retraining. The method retains up to 99% of the text-loss improvements while preserving native quantization formats and storage layouts.
Anytime Contracts for AI Services
AI summaryThe paper adapts contract theory to AI services that can be terminated anytime, showing that optimal payment contracts must be proportional to anytime-valid hypothesis tests using e-values. It presents an efficient algorithm for computing such contracts and demonstrates its effectiveness on synthetic and real LLM data.
Next Token or Vector? Learning How Far to Decode
AI summaryCADENCE learns both how many tokens to draft and what to draft, using Gaussian latent vectors and a router that adapts span length to context; it achieves up to 1.3× higher throughput than greedy decoding while maintaining high draft acceptance.
Ori: Drift-Aware Streaming $k$-PCA for Very Low-Rank LLM Training
AI summaryThis paper introduces Ori, a low-rank LLM optimizer that uses streaming PCA to track slow gradient subspace drift in real time. Ori significantly reduces the performance gap between low-rank and full-rank training across various language model tasks.
Reasoning Reranking with Semantic IDs as the Sole Item Representation
AI summaryThis paper introduces ReRankID to evaluate reasoning rerankers using only compact Semantic IDs instead of text. Results show that targeted post-training enables SID-only models to match text-based LLMs with much shorter prompts, despite producing less faithful item descriptions.
Replay Pruning and Few-Bit Integer Inference for Hardware-Efficient Speed-Sign Recognition
AI summaryChannel replay pruning removes 60–70% of YOLOv5/8 parameters without accuracy loss and outperforms other methods; a 5‑layer 18k‑parameter reader with 4‑bit weights/8‑bit activations matches FP32 accuracy, yielding 95.2% sign detection at 94 fps on an automotive SoC.
Causal Edit Serialization
AI summaryCausal Edit Serialization lets language models express revisions (insert, delete, replace, move) in a single causal stream using pointer tokens with source addresses. CES models match autoregressive quality while performing complete edits and improving downstream prediction.
Partial-Revelation Panel Forecasting: Predictive Information Gain, Allocation, and Coarsening-Consistent Operators
AI summaryPartial-revelation panel forecasting predicts full count distributions for the next dialogue turn from only a subset of annotator votes, using coarsening-consistent Dirichlet-multinomial operators. It achieves modest NLL improvements (≈0.4 nats on IEMOCAP) and shows that cross‑turn and same‑item gains are distinct.
Benchmarking and Enhancing Agentic Causal Discovery
AI summaryResearchers benchmark LLM agents on causal discovery, showing that agents can improve results beyond standard algorithms by inspecting data. GPT‑6.1 Sol outperforms the best algorithm on all six synthetic families, raising adjacency F1 by up to 14 % on the hardest datasets.
ToPA: Block-wise Toeplitz Adaptation for Expressive and Efficient Fine-Tuning
AI summaryToPA fine‑tunes large models by inserting block‑wise Toeplitz matrices into weight updates, allowing shorter, stable multiplicative chains that approximate arbitrary matrices and outperform low‑rank or sparse PEFTs across 21 NLP and CV benchmarks.
Learning to Be Guided: Shaping Latent Geometry for Classifier-Free Guidance
AI summaryThey analyze how the arrangement of discrete class embeddings in latent space—“class geometry”—affects classifier‑free guidance, and propose Prototype Regularization, a lightweight cosine‑prototype classifier that improves guided image generation, lowering guided gFID on ImageNet from 3.31 to 2.28.
Batched Contextual Reinforcement II: Does RLVR Need Long Rollout Windows?
AI summaryBatched Contextual Reinforcement explores concurrent verifiable problems to avoid long rollout windows in RLVR. CCR trains models with a shared budget, cutting training tokens by ~80% while maintaining accuracy, enabling efficient short‑window reinforcement learning.
What Accuracy Hides In Learned Transformer Programs
AI summaryTransformer Programs expose learned logic as readable code, revealing that token‑level accuracy can mask wrong outputs. Program inspection guided data augmentation, improving sequence accuracy and uncovering hidden failures that standard metrics missed.
Competence-Based Evaluation of Logical Reasoning in Large Language Models
AI summaryThe paper proposes a competence‑based evaluation for logical reasoning in LLMs, using parameterized generators and answer‑preserving variations to test generalization. It finds that even strong GPT and Qwen models fail to consistently apply the same reasoning competence across problem families.
When to Forget: Risk-Controlled Context Adaptation for Long-Horizon Agents
AI summaryReCAP decides when a long-horizon agent should keep, compress, or discard past failures. It outperforms full-history KEEP, reducing prompt cost by 2.13% while preserving 91.9% of continuation success across five backbones.
A Feature Selection Layer Approach for Multi-Class Classification on Neural Networks
AI summaryThe paper extends the Feature Selection Layer to embed label‑specific relevance learning in neural networks. Experiments show it matches existing methods for global feature importance and outperforms them in identifying how each feature influences individual class predictions.
FederatedBytes: Tokenizer-Free, Byte-Level Small Language Models for Efficient Multimodal Federated Learning
AI summaryFederatedBytes trains a byte‑level language model with a linear attention mechanism for federated learning of NLP and multimodal tasks. It achieves higher accuracy than ByT5 and LSTM on multilingual sentiment and ScienceQA datasets while cutting memory and communication costs.
Where's the Indirect Evidence? Investigating Grammatical Generalization with Influence Functions
AI summaryUsing influence functions, the paper identifies 60,000 “indirect evidence” sentences that significantly affect grammatical generalization in language models, showing they improve held‑out accuracy by about 12 points more than random subsets, and revealing linguistic category structure.
Scalable Levenberg-Marquardt Training Framework for Deep Learning
AI summaryLeMA rederives LMA to avoid a parameter‑sized Jacobian, shards the Jacobian across GPUs, and enables exact second‑order steps for billion‑parameter networks. On 8 GPUs it attains 7.97× speedup and 99.7% scaling for a 1B‑parameter CNN.
Conformal Policy Selection: When to Deploy AI Decisions for Targeted Intervention
AI summaryConformal Policy Selection tests each individual’s predicted outcome against a threshold and selects those exceeding it while controlling false discovery rate. It guarantees finite‑sample FDR control and is doubly robust, offering a safety gate for deploying AI policies in high‑stakes settings.
Many Biases, One Circuit: Post-Training Tunes a Pretrained Cue-Routing Mechanism
AI summaryThe paper identifies a shared cue‑routing circuit in transformer attention heads that drives multiple-choice biases. Post‑training fine‑tuning and RL strengthen these heads, suggesting that mitigation can target this specific circuit.
Aligning Language Models Towards Counterfactual Invariance
AI summaryThe paper shows that reinforcement learning alignment increases counterfactual bias in language models. It proposes a policy‑gradient method with group‑level rewards on matched counterfactual prompts, reducing demographic differences while maintaining overall response quality.
Large Diffusion Models Need More Than EMA
AI summaryLarge diffusion models benefit from learning‑rate decay and Schedule‑Free optimization rather than constant LR with EMA alone. The study shows decay+EMA improves baselines but is timing‑sensitive, while Schedule‑Free consistently reduces parameter variability and yields better objectives and generation quality.
On the tradeoff between robustness and geometric accuracy in adversarial training
AI summaryShows that for high-complexity non‑parametric classifiers, robustness to an adversary of size ε only reduces geometric accuracy by at most O(√ε) (or O(ε) with stronger regularity). This gives a tight trade‑off between robustness and accuracy for any norm.
What Shapes Brain Alignment of Large Language Models during Dialogue? Insights from Language Production and Comprehension
AI summaryThe study compares fMRI-based brain alignment of LLMs during dialogue, finding distinct patterns for production versus comprehension that correlate with the models’ intrinsic dimension in relevant brain areas, and shows that linguistic and communicative feature contributions differ by processing mode, layer, and region.
Towards Hyperparameter Transfer for Differentially Private Optimization
AI summaryDP‑µP extends maximal update parametrization to differentially private training, deriving a signal‑to‑noise ratio condition for layer‑wise learning‑rate scaling. It yields practical scaling rules for DP‑SGD, DP‑Adam, and DP‑Muon that transfer learning rates across widths, matching or surpassing tuned baselines.
How Murky Before a VLM Knows It Cannot See? Accuracy, Confidence and Abstention on a Physical Visibility Axis
AI summaryThe study measures VLM accuracy, internal, verbalized confidence, and abstention on a physical visibility axis (fog and underwater) for 1000 COCO scenes. Accuracy drops to chance at 12–16 m fog, yet high confidence remains, revealing a blind‑spot width of at least 6× visibility.
PersonaCUABench: Benchmarking Computer-Use Agents Serving Diverse Personas
AI summaryPersonaCUABench evaluates computer‑use agents by letting 44 personas rephrase tasks and pose constraints, revealing a 36% drop in completion and lower satisfaction. The study shows agents often misinterpret or ignore user‑specified requirements.
TALLOP: Joint Optimization of Local Training and Communication Compression for Time-Constrained Federated Learning
AI summaryTALLOP jointly optimizes local training workloads and communication compression under per-round time constraints in federated learning. By predicting training progress and compression degradation, it minimizes post-compression loss to achieve faster time-to-accuracy in heterogeneous environments.
A Label Noise Robust Algorithm for Graph Data using Neighborhood Label Distribution
AI summaryThis paper proposes LENS, an end-to-end graph neural network framework that identifies and corrects noisy labels by measuring changes in neighborhood entropy. LENS achieves state-of-the-art node classification accuracy while running significantly faster than existing robust methods.
Controlling the Diversity-Quality Trade-Off of LLMs by Merging Models Before and After Alignment
AI summaryThis paper introduces a training-free layer-wise model merging technique that combines aligned and base LLMs to control the diversity-quality trade-off. By mixing lower and higher layers, the merged models achieve superior semantic and lexical diversity compared to standard alignment without sacrificing quality.
A Minimal ReLU Classifier on Non-Linearly Separable Data: Convergence and Implicit Bias at and beyond the Edge of Stability
AI summaryThis paper analyzes a two-neuron ReLU network trained on non-linearly separable data with large learning rates. It proves that gradient descent converges to a max-margin solution in the edge-of-stability regime and introduces an adaptive schedule achieving a faster loss decay rate.
"Deep lifts": Neural networks can generalize even with the dumbest optimizer
AI summaryThis paper proves that randomly sampled interpolating neural networks generalize well despite using no standard optimizer, achieving a rate dependent on the true underlying network size rather than the overparameterized architecture. This occurs because simpler networks witness an exponentially larger volume of interpolating parameters in the overparameterized space.
Distinguishability and Recovery for a Doubly Sparse Spiked Wigner Model
AI summaryThe paper shows that a leave‑one‑out quadratic thresholding method recovers the support of a sparse rank‑one signal in a spiked Wigner model with independent sparse noise, and sign synchronization or spectral refinement yields exact or strong recovery, giving sparsity‑SNR tradeoffs.
Towards Looped Models Done Right, Part I: Topology, Input Injection, Recurrent-State Design
AI summaryThe paper studies looped Transformer designs, isolating recurrence placement, input injection, and state layout. It shows that the Huginn-style prelude‑recurrent‑coda architecture outperforms the Ouro architecture and feedforward MoE baselines, achieving better accuracy with fewer resident parameters.
GR-OPD: Group-Relative Sequence Credit for On-Policy Distillation
AI summaryGR-OPD introduces a group-relative sequence credit method for on-policy distillation that decouples teacher feedback from credit assignment. It outperforms vanilla OPD across six mathematical reasoning benchmarks and maintains stability under mismatched thinking patterns.
DIFFLET: A Fast Inference Engine for Diffusion Transformer Models on AWS Trainium
AI summaryDifflet compiles diffusion transformer pipelines on AWS Trainium2 into a shared backend, splits attention heads across cores, and uses host‑controlled caching to skip redundant denoiser runs. It achieves 1.2–4.3× speedups over PyTorch/XLA and 1.5–3.4× faster resident serving.
Unifying Embodied Foundation Models via a Model-to-Policy Formulation
AI summaryUnifies VLA and WAM robot learning by modeling them as stochastic kernels with conditional output distributions and action‑realization kernels that produce task‑conditioned policies. Demonstrates the framework on OpenVLA and DreamZero, handling both autoregressive action tokens and joint video‑action generation.
Path to Prior-Data Fitted Relational Models via Learned Latent Multi-table Representations
AI summaryPretrains a graph‑based relational model, Griffin, on synthetic databases with curriculum learning, then freezes the encoder and feeds its representations into a frozen in‑context predictor. On 16 real relational tasks, curriculum‑pretrained encoders outperform real‑data pretraining and baselines.
Where Latents Belong and How They Flow: Joint Identification of Structural Roles
Latent factors in dynamical systems can play different roles across observations and time. For example, an idea in a group meeting may be expressed by only some participants, inherit information from earlier discussions, and shape what is said next. We formalize this notion as…
Towards a GraphNARX model for structural dynamics
AI summaryGraphNARX is a graph‑based NARX model that uses nodal attributes of a structure’s graph to predict next‑step displacements, enabling system identification and virtual sensing. It generalises across different geometries and outperforms baselines on diverse structural sizes.
Domain-specific language alignment of multimodal embeddings towards explainable predictions
AI summaryAligns any multimodal embedding to language using captioning of auxiliary data, a soft contrastive loss, and concept retrieval. Applied to Earth observation embeddings, it outperforms prior models on species‑distribution metrics and yields interpretable habitat associations.
LED: Improving Masked Diffusion Language Models by Lookahead Editing
AI summaryLED adds a rewritable proposal state to masked diffusion, allowing iterative lookahead updates before committing tokens, improving expressivity while keeping simple masks. Fine‑tuned Qwen models achieve +11.4/+7.7 points over standard MDM SFT and beat LLaDA2.1‑16B on benchmarks.
Information-Geometric Blind Spots of Conformal Test Martingales
Conformal test martingales (CTMs) are e-processes for sequentially testing exchangeability via p-values produced by a conformity function $A$. However, any distribution shift that preserves the push-forward $P\circ A^{-1}$ leaves the p-value distribution invariant, rendering it…
MetaCurate: Evolving Curation Filters for High-Quality Agentic Coding Data
AI summaryMetaCurate autonomously evolves executable curation filters for agentic coding data using pairwise LLM judgments, eliminating hand‑written rules. It achieves the best downstream coding performance on the Nemotron v3 SWE dataset, outperforming random, hand‑authored, and training‑loop baselines with lower search cost.
Local proxies for memory-efficient training
AI summaryLocal proxy networks per transformer block predict global outputs, allowing gradients to be computed locally and reducing memory. On CIFAR‑100 and LLM fine‑tuning, this method achieves higher accuracy than other memory‑efficient local algorithms while using comparable memory.
Grounded Credit Assignment in Reinforcement Learning for Multi-Turn Search Agents
AI summaryGrounded Credit Assignment assigns separate rewards for evidence retrieval and answer correctness, correcting bias from GRPO. It boosts EM by 5.7–6.3 points and raises evidence-supported correct answers from 76.9% to 93.4% on QA benchmarks.
CIIR - Class-Indexed Interface Representation Learning
AI summaryCIIR learns a shared 128‑dimensional address space linking heterogeneous datasets without paired samples. It attains 94.7% address realization accuracy and enables cross‑dataset transfer (e.g., 90.2% MNIST→SVHN) and arithmetic coding for 100 CIFAR‑100 classes.
Nearly Linear Private Learning of Littlestone Classes
AI summaryThis paper establishes a nearly linear upper bound of $O(d \log d)$ on the differentially private sample complexity for learning binary concept classes with Littlestone dimension $d$. This improves significantly over prior polynomial bounds and yields a tight linear dependence for learning subspace indicators.
Explaining Chess and Go in Natural Language
AI summaryThe paper introduces BinProp, a training‑free method that lets language models learn reusable chess concepts to generate natural‑language move explanations. BinProp nearly triples explainability scores over direct prompting and generalizes to Go, draughts, and shogi.
Structural Affinity: An Algorithm for Coherent Cage-Based Shape Design
AI summaryStructural Affinity precomputes an affinity matrix linking a fine inner cage to a coarse outer cage, directly coupling handle motions and reducing cage self‑intersections and mesh distortion. Experiments on co‑design, neural transfer, and aerodynamic wings show smoother deformations and lower distortion metrics.
Tree-Aware Posterior Distillation for Long-Horizon Agentic Reinforcement Learning
AI summaryTreeOPSD is a critic‑free, tree‑aware posterior self‑distillation method that back‑ups terminal rewards through alternative continuations, producing a bounded teacher distribution. It reduces policy drift and sparsity, boosting long‑horizon agentic RL performance (e.g., +4.97 on Deep Research).
A Stronger Teacher Within: Strengthening MoE Models via On-Policy Bidirectional Distillation
AI summaryMoEvolve expands MoE activation budgets to create a stronger internal teacher, then distills its gains back to a low‑budget model. The method boosts performance by up to 22.2 domain‑average points, exceeding same‑budget RLVR baselines by 6.5 points.
LangNCO: Compiling Natural-Language Constraints into Inference-Time Interventions for Neural Combinatorial Optimization
AI summaryLangNCO compiles natural‑language constraints into structured inference‑time masks for a frozen neural combinatorial optimizer. It achieves 97–100 % feasibility on CVRP with various constraints and 1.6–3.3 % mean gap, enabling post‑training adaptation without retraining.
Proportionality in Ranking Compression
Motivated by applications in reinforcement learning from human feedback, we consider a setting where a given collection of rankings needs to be compressed into a smaller collection of rankings. This can also be seen as a combination of two fundamental social choice frameworks:…
Non-Parametric Optimization for Scalable Learning in Stochastic Decision Problems
AI summaryDevelops a Malliavin‑calculus–based stochastic variational framework for time‑varying stochastic optimization, yielding non‑parametric optimality conditions and a dimension‑robust deep‑learning algorithm (Stochastic Path Follower) that outperforms current methods on drifting least‑squares and logistic regression problems.
Process Reward Modeling with Reliability- and Conservatism-Aware Bayesian Belief
AI summaryBayesianPRM models process rewards as random variables, updating a belief over a reward ensemble to handle PRM uncertainty (via reliability‑aware updates) and policy uncertainty (via conservatism‑aware calibration). It improves reward accuracy and test‑time scaling on multimodal reasoning tasks.
Characterising and Analysing Retrieval-Augmented Generation Techniques
AI summaryThe paper proposes a conceptual framework with dimensions and sub‑dimensions for categorising and evaluating Retrieval‑Augmented Generation methods, enabling researchers to filter suitable RAG techniques for specific tasks before costly empirical benchmarking.
Response-Informed Value Estimation for Cost-Aware Multi-Turn LLM Routing
AI summaryRIVET uses logged responses to train two value estimators: a deployable pre‑call routing value and a training‑only response‑informed value. It reduces estimation error and achieves 74.7% lower cost while solving more MINT benchmark tasks than previous baselines.
Anisotropic Representation Dynamics in Transformers
AI summaryThe paper introduces a Mixture‑Gated Theory of Anisotropic Representation Dynamics, decomposing attention into value transport, query gating, and key gating. It provides a spectral criterion that predicts when attention routing causes representation differences to contract or expand, and validates the theory on several Transformers.
Think More or Read More? A Token-Budget Theory of Reasoning with Shared Context
AI summaryThe paper formalizes a token‑budget trade‑off for reasoning systems that share a fixed context window: each token spent reading others reduces the reasoning budget. It provides a closed‑form prediction for the optimal group size in multi‑agent debate, which matches empirical results and shows self‑refinement performs similarly, especially under tight token limits.
Can the Parts Fool the Test? Counterfactual Pairing Cycles for Relational OOD
AI summaryThis paper introduces counterfactual pairing cycles, a blocked evaluation and training primitive that holds image and caption parts constant while swapping their pairings to eliminate superficial shortcuts. This approach successfully isolates relational out-of-distribution errors and improves vision-language model accuracy on complex pairings.
FLARE: Physics-Grounded Evaluation of Language-Model Agents for Feeder Restoration with Degraded Observations
AI summaryThe paper introduces FLARE, a physics-grounded benchmark for evaluating language-model agents on power grid restoration under degraded observations. Evaluating five models across 800 cases, it finds that while median performance is strong, all models exhibit significant failure tails where external safety checks are essential.
Sample, Mix, or Verify? Allocating Test-Time Compute under Imperfect Verifiers
AI summaryThe authors introduce SPLIT, a method that uses a small pilot to optimally allocate test-time compute across sampling, mixing models, and verification. SPLIT achieves near-optimal performance across diverse benchmarks and imperfect verifiers, outperforming heuristic budgeting rules.
Reasoning Models Can Control Their Chains of Thought When They Tell Themselves To
AI summaryReasoning models struggle to follow chain-of-thought constraints when given in user prompts, but achieve significantly higher controllability when the constraints are placed as self-instructions inside their reasoning process.
ADT: All-Atom Diffusion Tokenizer for 3D Molecular Structures
AI summaryThis paper introduces the All-Atom Diffusion Tokenizer (ADT), which uses compact discrete structural tokens combined with a diffusion-based decoder to represent and reconstruct both small molecules and all-atom protein structures. Experiments show that ADT achieves high-fidelity reconstruction and enables quality autoregressive generation.
Beyond Marginal Influence: Interaction-Aware Memory Selection for LLM Agents
AI summaryThis paper introduces JointCoreBench to study interaction-aware memory selection for LLM agents, and proposes JointCore, a baseline that recovers minimum-cost sufficient memory subsets while significantly reducing evaluations and active memory.
NestedVLA: Learning to Consolidate and Generate Skills for Vision-Language-Action Models
AI summaryNestedVLA learns individual VLA skills separately, then uses a hypernetwork to generate task‑specific action‑expert parameters that compose with a frozen base VLA, avoiding interference and parameter conflicts. Across MetaWorld, ManiSkill, and CALVIN, it beats the best model‑merging baseline by 41 pp on average and matches per‑task fine‑tuning on ManiSkill.
DeDiCa: A Scalable Deconfounding Discrete Causal Generative Model
AI summaryDeDiCa introduces a tensorized causal Bayesian network that uses maximum likelihood to handle hidden confounding in discrete variables. It matches state-of-the-art neural models in treatment effect estimation while enabling exact, millisecond-scale inference and efficient CPU training.
Data-Efficient Classifier Pretraining Through Diffusion Models
AI summaryThe paper introduces DiffPT, a diffusion-based pretraining method for classifier backbones in low-data regimes. The main result shows that DiffPT outperforms self-supervised baselines on medical imaging and time-series tasks with limited training data.
Distributed Performance Boosting through Neural Control for Plug-and-Play Networks
AI summaryDistributed neural controllers are designed by parametrizing local neural operators so that an auxiliary operator satisfies an $\ell_2$‑gain bound, guaranteeing closed‑loop stability during plug‑and‑play subsystem additions/removals. The resulting unconstrained training improves voltage transients in DC‑microgrid experiments.
The Optimal Ranking Tradeoffs Between Two Ranking Scores in Two-Class Classification
AI summaryThe paper shows that many common classification metrics are special cases of a single parameterized ranking score. It derives an exact formula for the optimal tradeoff between any pair of such scores, minimizing Kendall‐distance variance over all possible rankings.
Learning angles for quantum approximate optimization
AI summaryWe train neural models to predict high‑quality QAOA angles from the problem graph, replacing costly per‑instance optimization. The predictions run in milliseconds, match solver quality, generalize to new topologies, and perform equivalently on quantum hardware.
How the elastic axis folds the transonic flutter boundary: shock energy transfer and conformally calibrated active learning
AI summaryMaps the folded transonic flutter boundary of a pitch‑plunge aerofoil with the elastic axis ahead of the leading edge using 193 Euler simulations, a GP surrogate trained by active learning, and conformal calibration. The surrogate predicts stability with <1.6% error, revealing the fold exists only when the axis is >0.4 chord ahead, and explaining its closure via shock‑energy budgets.
Look, Reason, Draw a Region: Recursive Refinement for Spatial Context Prediction
AI summaryThe paper introduces Spatial-TRM, a compact, weight-tied recursive model that uses frozen vision-language features for spatial context prediction. It achieves a 29.51% context accuracy on the RoboSpatial-Home benchmark, significantly outperforming single-step models with the same parameter count.
Untrained CNN and coefficient-space regularization for joint reconstruction in photoacoustic tomography
AI summaryPaper uses fixed wavelet bases and untrained CNN features with Tikhonov regularization to reconstruct pressure, then learns a coefficient‑space prior for sound speed, achieving accurate, noise‑robust results with ~6× less computation than supervised CNN.
The Loss or the Architecture? What Matters in Survival Analysis with Competing Risks
AI summaryThe study independently tests loss functions and backbones for deep competing‑risk survival models across tabular and image data, finding that a cumulative‑incidence loss dominates over architecture choice; the best performance comes from combining a proper loss with a modality‑matched backbone, yielding state‑of‑the‑art Brier scores.
Peak-Memory Schedules You Can Trust: Exact Realization, Certified Optimality, and the Limits of Recomputation for Inference
AI summaryThe paper presents an exact, certifiable memory‑scheduling method for inference that models a compiled program’s memory use, guarantees bit‑exact results, and proves optimality for 94 % of graphs, while also proving selective recomputation NP‑hard and showing modest gains on certain models.
HiPredict: Predicting the missing HiRISE RED4 spectral channel with machine learning
AI summaryHiPredict uses a U‑Net to reconstruct missing HiRISE RED4 channel imagery from IR10, BG12, neighboring red images and metadata, achieving a 1.1% NMAE versus 3.1% for the synthetic SYN4 method, improving colour fidelity and feature detection.
Minimax-optimal Scaling Laws in Ridge Regression via Transfer Learning
AI summaryThe paper analyzes ridge regression transfer learning: a pretrained source model regularized by ridge and a target model regularized by its distance to the source. It derives deterministic risk equivalents, shows minimax‑optimal scaling under power‑law covariance spectra, and confirms the result with experiments.
SETAREH Transform: A Sorting-Assisted Haar-Wavelet Sparsification Method for Approximate Inner-Product Computation
AI summaryThe paper introduces SETAREH, a Haar‑wavelet sparsification that preserves exact inner products before truncation by applying identical permutations and transforms to fixed coefficients and inputs. It shows that far fewer transformed pairs are needed to approximate inner products, reducing storage and communication costs.
How Finite-Rank Bottlenecks Shape the Low-Rank Adaptation Landscape
AI summaryLoRA updates are low rank because, once the backbone is frozen, the loss depends on each adapted matrix only through a finite‑rank linear map induced by frozen activations. Trace‑norm regularization forces the optimizer to choose a matrix whose rank is bounded by this bottleneck rank, not the dataset size.
RTSM: Adapting Recursive Models to Multivariate Time-Series Classification
AI summaryRTSM uses a learned convolutional tokenizer, a single weight‑tied refinement state, and pooled readout for multivariate time‑series classification. It attains 72.81% mean accuracy on UEA datasets, 1.60 points above MambaSL, showing temporal encoding and state design are critical.
Beyond Success Rate: Interventional Evaluation of Memory in Vision-Language-Action Systems
AI summaryThis paper introduces an Interventional Memory Evaluation Protocol (IMEP) for vision‑language‑action systems and shows that providing correct historical facts raises task success from 39.1% to 74.3% on ChainBench, while mere memory changes can alter outcomes by up to 11.9% in cross‑episode tests.
Data-Driven Prediction of Optimal MPI Rank Placement and Node Count for Memory-Bound CFD on AMD EPYC Clusters
AI summaryThis study measures 560 OpenFOAM runs on AMD EPYC to map memory‑bound performance vs. cost. It finds that the nearest‑neighbor mesh predicts optimal MPI placement 75–85% of the time, and two recommended configs catch 85–90% of speed and cost trade‑offs, outperforming ML models.
Sentence-Level Topic Modeling with Lexical and Contextual Evidence
Topic modeling faces a fundamental granularity dilemma: probabilistic topic models assign topics at the word level, whereas transformer-based methods operate at the document level. The latter overlooks that real-world documents typically cover multiple topics, whereas the former…
Forecasting Voltage Time Series under Anomalies Using a WGAN Model With Lipschitz Control and Progressive Kernel Critic Strategy
In time-series forecasting tasks, the use of recursive forecasting on high-dimensional data substantially increases the complexity of the prediction process. The main challenge is that long-term dynamics becomes harder to model, since the sequences show greater temporal…
Contracting with an Agent under Model Mismatch
In the classical principal-agent setting, the principal delegates some task to the agent, who receives a payment conditioned on the outcome of the task, which in turn benefits the principal. To align their objectives, the principal designs a contract that incentivizes the agent…
Information Estimation with Discrete Diffusion
Information-theoretic measures, such as Mutual Information (MI), play a crucial role in understanding non-linear relationships between random variables and are widely used across scientific disciplines. Yet, their use on real-world discrete data remains challenging. Existing…
Flash RNN-T: Memory-Efficient Joint Network and Transducer Loss Computation
AI summaryFlash RNN‑T reduces training memory by combining custom kernels with optional tiled recomputation. On H100 it delivers 24–39 % higher throughput and up to 56 % less memory than baselines, achieving ninefold memory savings on medium workloads while staying within 16 % of peak speed.
Residual Stochastic Concept Bottleneck Models
Concept-based models (CMs) learn human-interpretable intermediate representations that enable users to understand the model's reasoning and steer its predictions through test-time concept interventions. However, in realistic settings, their performance can be limited by concept…
Bridging Compressed Communication and Local Steps via Spectral Method in Federated Learning
AI summaryThis paper introduces a spectral federated learning method that integrates local steps and communication compression. The approach provides rigorous convergence guarantees without requiring bounded data heterogeneity and demonstrates strong empirical performance on image classification benchmarks.
Generative Policy Improvement from Observational Data
We study how to improve decision policies from observational data to generate better actions when actions are complex, structured objects, such as text messages or images. This task is subject to two major challenges: (i) action-level overlap is often too weak for reliable…
RECREG: Recovery-based Shielding for Regular Safety Properties in Reinforcement Learning
AI summaryRecReg uses recovery-based shielding to enforce non-Markovian regular safety properties in RL, offering a unified framework with theoretical safety and convergence guarantees in tabular settings and empirical validation via MASA-Safe-RL.
Regularized free deconvolution for spectral repair of resampling distortion in high-dimensional particle filters
AI summaryReconstructs the true ensemble covariance spectrum after high‑dimensional resampling in particle filters using a regularized free‑deconvolution estimator; achieves order‑of‑magnitude error reduction and recovers 90% of oracle sampling efficiency with proven consistency and explicit error bounds.
Predictable Scaling: Efficient Model Exploration via Scaling-Law Prediction
AI summaryPredictable Scaling predicts full‑scale model performance from small‑scale runs, reducing compute by 79–88%. A Gaussian Process variant yields 15% lower MAE and calibrated uncertainty, enabling accurate ranking of hypotheses across two ranking models.
HydraLLM: Adaptive Width Slicing for Elastic Text and Vision-Language Models
AI summaryHydraLLM introduces an elastic MQA architecture that adjusts the number of active attention heads to scale model width for any hardware. It outperforms nested baselines by 2.2 % TriviaQA accuracy at 75 % head usage, matches Gemma‑3 4B CLIPScore with 50 % heads, and boosts throughput by 75 % at 25 % heads.
Graphlet-based Decentralized Finance Transaction Method Classification
AI summaryGraphlet features of directed DeFi transaction graphs classify 30 common methods better than event logs alone, boosting accuracy. SHAP analysis reveals distinct structural patterns for each method, providing interpretable explanations.
QD-Rec: Open-Ended Evolution of Recommendations via Quality-Diversity
Open-ended search combined with foundation models has produced advances such as faster algorithms, new results on open mathematical problems, and self-improving agents. We extend this paradigm to recommendation for decision-making, focusing on decisions where the set of possible…
Towards optimal selection schedules for online active learning
We consider the problem of online linear classification, where a stream of unlabeled samples is available, and annotation is costly. We investigate the optimal query policy, that prescribes whether and when a sample should be labeled and used for a training step, or instead…
A Topological Signature of Learning under Noisy Labels
How does noisy supervision change the representations learned by a neural network? Training accuracy measures agreement with training labels but provides little information about representation geometry. We use persistent homology to track loop structure across distance…
Adaptive conformal prediction on the Grassmannian
We introduce a conformal prediction framework for regression with Grassmann-valued responses. The proposed method constructs prediction regions in the form of metric balls directly on the Grassmann manifold, using basis-invariant geometric distances as non-conformity measures…
Uncertainty-aware AI-enabled framework for predicting hydrogen dispersion in confined spaces to enhance operator situational awareness
We present a two-stage AI-enabled framework for enhancing operator situational awareness during compressed hydrogen bunkering in maritime confined spaces. In the event of a leak, the framework first estimates the unknown leakage rate from early sensor readings and then forecasts…
Interpreting SSL Representations for Spoof Detection: a WavLM Study
AI summaryWavLM’s layers encode spoof‑relevant cues at different depths: mid‑layers best capture many acoustic features, while late layers encode voice quality metrics. Using five optimally chosen layers gives better spoof detection than pooling all thirteen.
Out of Support, Not Out of Reach: In-Context Learning with Unsupported Instructions and Composed Tasks
In-Context Learning (ICL) enables pretrained LLMs to adapt to downstream tasks from a small set of input-output demonstrations, without parameter updates. Yet existing theory primarily explains ICL as identifying a latent task already represented in pretraining, leaving unclear…
Causal Discovery beyond Conditional Independence: Identifiability, Algorithms, and Statistical Inference for Directed Acyclic and Cyclic Graphs
AI summaryThe paper reviews causal discovery methods that use distributional features beyond conditional independence, separating identification, estimation, and computation, and discusses latent confounding, feedback, and cyclic graphs, offering consistency, uncertainty, and algorithmic insights for diverse data settings.
Beyond Latent Personalization: Integrating HRV-Conditioned Personalization via LLM for Interpretable Stress Detection
Stress detection based on heart rate variability (HRV) has received increasing attention. However, existing personalized approaches integrate personal attributes with HRV through latent representations, limiting the interpretability of their interactions. In this work, we…
Beyond Expected Values: Risk-Sensitive Planning with Distributional Monte-Carlo Tree Search
Monte-Carlo Tree Search (MCTS) typically stores only scalar mean estimates, which makes it poorly suited for tail-risk objectives such as conditional value-at-risk (CVaR). We introduce Categorical Thompson Sampling with Optimism (CATSO) and Particle Thompson Sampling with…
A general recipe for data-adaptive anytime-valid envelopes for iterative algorithms
Most convergence guarantees for iterative stochastic algorithms are stated at a fixed iteration count and do not justify stopping at a data-dependent time. Recent work has constructed anytime-valid envelopes that do, but deterministic envelopes are typically too conservative for…
BMuon: Budgeting Muon's Spectral Geometry for Structured Compressibility
Muon has emerged as a strong optimizer for neural network training and admits an interpretation as steepest descent under a spectral-norm geometry. Yet we find that Muon-trained Transformers can degrade sharply when their MLP hidden channels are pruned after training. To…
Boundary Detection for High-Dimensional Point Clouds
We introduce two new methods for boundary detection in high-dimensional point cloud data, intended to work in situations with non-uniform density, high ambient dimension, and substantial noise. Our first method fits a separating hyperplane on local neighborhoods after doing…
When Magnitude Suffices: Reconstructing Time-Domain-Gated Microwave Signals Without Phase on a Thoracic Phantom
Time-domain gating separates the arrivals that form a microwave S-parameter measurement. It requires the measurement of complex values, so this application almost always uses a vector network analyzer (VNA). We show that, on one calibrated measurement configuration, the gated…
How Many, but How Sure? Class Competition as a Confidence Proxy in Multi-Class Density-Based Counting
Multi-class density estimators can count objects in crowded scenes, but their class-wise outputs offer no indication of how reliably density mass has been allocated. We introduce a training-free confidence proxy based on local competition between the strongest class channels.…
Trajectory-Triggered Sparse Collaborative Decoding
Dense assistance methods such as speculative decoding repeatedly verify draft tokens with a target model, keeping target computation coupled to generation. We study sparse collaborative decoding, where a draft model generates most tokens and a target model is invoked only for…
The Sign Code: The Hidden Binary Nature of Deep Networks
Every neuron in a trained network outputs a number that can be separated into its sign (positive or negative) and its magnitude (absolute size). We call the set of all neuron signs the \textit{sign code}. This raises a key question: does classification depend more on the sign…
ThetreStageAI: Multi-View Retrieval-Augmented Generation for Structured Bengali Theatre Production Planning
AI summaryThetreStageAI builds a multi‑view retrieval‑augmented system for Bengali theatre planning, using separate scene, blocking, and lighting indexes, then Gemini to generate validated JSON plans. It achieves better plan quality than single‑view retrieval, with a 1,500‑document synthetic dataset.
GRAFT-EEG: Gauge-Aware Physical Field Transport for Cross-Dataset Motor-Imagery EEG
Cross-dataset EEG decoding often treats montage, reference, and active-sensor changes as representation shift, although they also alter the observation operator. We study target-statistics-blind transfer: fitting receives no target signal, label, or empirical statistic, and…
Deconstructing Multi-Task Active Learning: The Paradox of Gradient Conflict and Orthogonal Decomposition
Existing multi-task active learning (MTL-AL) methods predominantly rely on linear scalarization of heterogeneous objectives such as uncertainty, diversity, and gradient conflict. We argue that this entangled formulation is fundamentally limited, as linear combination fails to…
Deep LLM layers expose passage-level context in EEG during silent reading
In a previous report we showed that a decoder can recover open-vocabulary word-level information from 19-channel EEG recorded during silent reading, by aligning short EEG windows with hidden-state embeddings of the presented word taken from a large language model (LLM). That…
No-Regret Language Generation
We introduce no-regret generation, which requires a generator to make a sublinear number of mistakes uniformly over all demonstration sequences and compatible target languages. We also formulate an agnostic variant that allows arbitrary demonstrations that may not be compatible…
Scalable long-range machine learning interatomic potentials with electrical response for atomistic material modeling
AI summaryThe paper introduces DPA4C‑LR, a distributed machine‑learning interatomic potential that analytically separates long‑range electrostatics and Born effective charges, enabling scalable atomistic simulations up to millions of atoms. It accurately predicts field‑dependent infrared spectra, polarization hysteresis, ionic conductivity, and interfacial thermal transport.
JAXtari: High-Throughput and Easy-to-Modify Arcade Learning Environment
The Arcade Learning Environment (ALE) has been a cornerstone of Deep Reinforcement Learning research, providing a standardized benchmark for evaluating general agents. However, its lack of native support for object-extraction and environment modification restricts research into…
A Language-Informed Loss for Visual Generation
AI summaryThe paper introduces LILIE, an invertible image encoder trained with a vision‑language model to generate captions from noised features, enabling a language‑informed loss for text‑to‑image generation. Using this loss, JiT models achieve a 14‑point gFD reduction on GPIC.
An Efficient Approach to Beetle Damage Detection of Banana Using Deep Learning
Visible surface damage of banana fruits by Basilepta subcostata (the banana fruit scarring beetle) can reduce their market value. Here, manual inspection of Banana fruits is subjective and difficult to scale. This study presents a lightweight framework based on YOLOv8n deep…
TriRouter: Sparse-to-Dense Electrode-Space Routing for Robust EEG Motor Imagery Decoding
Motor imagery brain-computer interfaces require reliable decoding from multichannel EEG, but practical acquisition often yields sparse or corrupted electrode montages. We propose TriRouter, an electrode-space routing framework with discriminative-preservation, mask-robustness,…
HardEval: An Execution-Verified Benchmark for AI-Driven Security Hardening and Compliance Remediation
AI summaryHardEval evaluates language models by having them generate Bash scripts that harden an RHEL 8 system to pass STIG controls, with live execution and OVAL checks grading success. The study shows significant variation in model performance across security domains and highlights realistic failures.
Expressivity of IQP Feature-Map Quantum Kernels via Reproducing Kernel Hilbert Spaces
AI summaryThe paper derives a Fourier representation of the RKHS for IQP quantum kernels, revealing three bandwidth regimes—localized, multimodal, and periodic—whose expressivity depends on accessible frequencies. Numerical tests show each regime matches data structure, guiding bandwidth choice.
Equivalence testing and run-count design for stochastic machine-learning experiments
Claims that two training methods perform equally well often rest on a non-significant difference between two or three runs per method. We develop a protocol, with its power theory, for certifying practical equivalence in per-run metrics such as the AUROC (area under the receiver…
Blitz: Accelerating the Diffusion Modules of AlphaFold3 and Boltz-2
Diffusion-based protein structure prediction models produce all-atom structures in about 200 denoising steps, and that cost has driven a number of few-step samplers. We present Blitz, a few-step distillation framework that uses a geometric noise schedule to distribute steps more…
Tool Recommendation for Multi-Step Agents: Finding Every Tool a Task Needs
AI summaryTool Recommendation supplies agents with all needed tools via three fixed calls, covering 93% of required tools in Codex sessions. It improves recall over BM25 by 57%, cuts input tokens by 17–40%, and reduces cost by up to 40% without affecting completion.
Neural Expansion: A Unified Mechanism for How Deep Neural Networks Generalize
Deep neural networks demonstrate remarkable generalization despite being highly over-parameterized, challenging traditional statistical learning theories. While several theoretical paradigms such as margin-based bounds, PAC-Bayesian analyses, and neural tangent kernels provide…
ECG-SDI: Single-lead Electrocardiogram Enables Continuous Sleep Depth Index Profiling and Scalable Digital Biomarkers for Sleep Health
AI summaryThe researchers developed a deep learning framework using single-lead electrocardiography for continuous sleep-depth profiling and biomarker extraction. The method accurately tracked sleep stages, identified a high-mortality disturbed sleep phenotype, and successfully monitored therapeutic responses to continuous positive airway pressure.
Escaping Parameter Space: Tight Generalization Bounds via Representation Quality
We derive a tight generalization bound for deterministic neural We derive a tight generalization bound for deterministic neural networks based on their last hidden layer representations. By evaluating representation quality with a parameter-free $k$-nearest-neighbor ($k$-NN)…
Bridging the Language Gap in Scholarly Data II: Enhancing Gender Inference for Chinese Names
Perceived gender inference from names is important for inclusive scientometrics research, yet existing methods perform poorly on non-Western scholars. We address this gap for Chinese names, which appear in two forms, Hanzi and Pinyin, its Romanized form (e.g., Zhang Wei, Li Na).…
LagNet: Lag-Structured Operators for Long-Term Time Series Forecasting
Long-term time series forecasting maps a finite history window to an extended future horizon. Many existing models focus primarily on the design of input representations and model structures, while paying less attention to the structural form of the history-to-future forecasting…
From Flow-Box Invariants to Global Conservation Laws: Machine Learning-Assisted Detection of Singularities and Near-Integrability
AI summaryThis paper introduces an expanding-domain neural network framework to track the transition from local flow-box invariants to global conservation laws in dynamical systems. The method successfully detects the successive breakdown of local invariants as domains expand, revealing proximity to Liouville integrability and isolating singularities.
Universal Semantic Enhancement for Weakly Supervised Anomaly Detection
Weakly supervised anomaly detection on tabular data is an essential task in many label-scarce applications, since tabular data is widely encountered and it is commonly observed in practice that only a limited number of labeled anomalies are available alongside abundant unlabeled…
Logic-Guided Graph Denoising Diffusion Models
Graph diffusion models are competitive approaches for generating complex graph-structured data. However, when such distributions have strict structural constraints, diffusion models may fail to capture them exactly, resulting in the generation of invalid graphs. In this paper,…
Mesoscopic learning dynamics of extensive-width neural networks
Understanding how stochastic gradient descent learns internal representations in wide neural networks trained on rich target functions is a central problem in machine learning. We study this question in two-layer neural networks learning target functions represented by networks…
Sampling the XY model with an attention-based neural network
AI summaryTransformer-based variational autoregressive network samples 2D XY model near BKT transition; it outperforms previous neural samplers, matches MCMC energy, magnetization, helicity modulus, and covers all configurations on lattices up to 96×96.
Parametric Resonance in Primal-Dual Learning for Slowly Non-Stationary Constrained MDPs
Primal-dual methods for constrained Markov decision processes are analyzed under a two-timescale assumption, with non-stationarity entering through two channels. In the additive channel, where the constraint level oscillates, the dual oscillation saturates at a floor set by the…
Task-aware Kernel Stein certificates for Rényi differential privacy
Rènyi differential privacy, based on Rènyi divergence, has become a notion of choice for privacy guarantees. However, outside the Gaussian setting, Rènyi divergence can be difficult to compute. In particular, Rènyi differential privacy guarantees that exploit task-specific…
Explainable Machine Learning Analysis of Temperature Effects on Mechanical Strength of Fiber-Reinforced High-Performance Concrete
Predicting the compressive strength of fiber-reinforced high-performance concrete subjected to temperature exposure is challenging because to the intricate interdependencies of mixture composition, fiber properties, curing conditions, and temperature. A data-driven framework to…
Learning Personalized Memory Gating from Delayed One-Sided Feedback
Long-term memory enables language-model agents to personalize future interactions, but a finite memory bank cannot preserve every extracted fact. Existing memory gating policies are typically shared across users and therefore fail to account for user-specific patterns of future…
CocoRNA: Collective RNA Design with Cooperative Multi-agent Reinforcement Learning
Designing RNA sequences that reliably fold into specific secondary structures is essential for understanding their biological functions but remains a challenging computational problem. We propose CocoRNA, a cooperative multi-agent reinforcement learning framework for RNA inverse…
Learning without relearning physical symmetry: an SO(3)-equivariant convolutional network (CNN) on the sphere
Many of the most important datasets in the physical sciences live natively on the sphere, and these data often carry no preferred position or orientation. Using methods that do not reflect this symmetry leads to far higher simulation requirements, which can be catastrophic for…
ENFR: Evidence Networks with Flow-Matched References for Amortized Simulation-Based Model Inference
The evidence, $\mathcal{Z} = p(x | \mathcal{M})$, of a data-generating model $\mathcal{M}$ is a powerful tool in Bayesian frameworks: it enables model inference, model misspecification tests, and goodness-of-fit assessment as an alternative to standard discrepancy statistics,…
Quality-of-Transmission Estimation in Quantum Networks: Compute, Simulate, or Learn?
AI summaryThe paper presents a framework to estimate end‑to‑end entanglement fidelity in quantum networks by choosing among analytical calculation, simulation, or learned surrogate models. It finds analytical methods work for simple cases, simulations are needed with stochastic memory effects, and learned surrogates can match simulator outputs at lower runtime cost.
Waiting Buys Exactly Two Moments: Endogenous Identification in Prediction-Driven Allocation
A planner with a fixed budget of preventive help must decide whom to help and when. Waiting reveals risk but removes intervention opportunities as higher-risk individuals leave first. We characterize this tradeoff under repeated noisy signals and risk-dependent attrition: in the…
Beyond the Answer: Student-Conditioned Trace Construction for Reasoning Distillation
AI summaryReDiST builds student‑conditioned reasoning traces from the learner’s own attempts, revising them with evidence and answer guidance, then selects the best trace via a frozen reader; the distilled student improves over answer‑only and baseline trace methods on multiple QA benchmarks.
Task-aligned spectral inductive biases in parameterized quantum circuits
AI summaryThe paper shows that a fixed, task-specific spectral query embedded in a data‑reuploading quantum circuit changes its hypothesis class by reshaping how signal frequencies combine, without new sample data. In small spectral and synthetic aperture radar tasks, this query‑alignment improves learning from limited data.
Behavioral Couplings: From Formation to Behavioral Emergence in Language Models
Fine-tuning large language models (LLMs) can induce behaviors beyond those explicitly targeted. For example, training a model to respond more warmly can make it more sycophantic, and training it to write insecure code can cause broad misalignment on prompts unrelated to coding.…