ORCHID-FL: On-Device Relationship-Aware Contextual Handling of Information via Decentralized Federated Learning

Privacy-Aware Adaptive Differential Privacy for Semantic Retrieval: A Pii-Aware Dynamic Budget Allocation Framework

PADP is presented, a sensitivity-aware perturbation framework inspired by differential privacy principles, which provides a plug-and-play, middleware framework that can be easily integrated into enterprise RAG pipelines without requiring costly computations for LLM fine-tuning and reconstruction of vector indices.

SmartRAG: Native Graph-Based RAG for Mobile Device

SmartRAG is presented, a fully on-device framework that organizes an intelligent assistant around four coordinated modules -- Perception, Memory, Focus, and Thinking -- keeping inference costs bounded and at the core of EvoNER, a continually learnable named-entity recognizer that incrementally expands its label inventory through teacher-distilled updates.

P2Skill: Privacy Preserving Skill Distillation for Cloud-Local LLM Inference Systems

Cloud-local LLM inference systems have the potential to use the reasoning capability of large cloud models while protecting sensitive user data on personal devices. Cloud-bound requests must exclude personally identifiable information (PII) to prevent external data leakage. Existing privacy-preserving methods rely on prompt perturbation, entity masking, or model fine-tuning, but these approaches may distort contextual semantics or require additional training. This paper proposes P2Skill, a prompt-based skill distillation method in which a local small language model (SLM) autonomously performs decomposition, PII-aware routing, paraphrasing, and reconstruction by following the skill prompts. Skills are iteratively refined from execution failures by a cloud LLM, enabling the local SLM to generalize beyond memorized PII patterns, and therefore P2Skill requires no privacy-specific fine-tuning or learned auxiliary detectors. Evaluation on a four-domain benchmark shows that P2Skill achieves $1.69\times$ and $3.66\times$ higher privacy-preserved inference quality than previous baselines.

Few-Shot Federated Learning for State-of-Charge Prediction Across Privacy-Isolated Personal Mobile Devices

Accurate state-of-charge (SOC) prediction on personal mobile devices requires a model that can represent heterogeneous discharge mechanisms, transfer knowledge across users, and adapt from scarce target records while raw telemetry remains privacy isolated. This study proposes a module-decomposition-driven SOC prediction model that separates baseline drain, synchronous state response, and asynchronous multi-scale event memory within one discharge-dynamics formulation. The same three semantic coefficient blocks remain aligned through local source learning and round-wise sample-count-weighted federated aggregation. Target-side personalization then adjusts one locally derived personal discharge-rate scalar while preserving the shared temporal response, and forward SOC propagation produces threshold-based time-to-empty (TTE) estimates. A user-held-out evaluation on a public small-sample smartphone-log dataset uses eight target partitions and 447 final evaluation origins. Personalized fine-tuning reduced TTE MAE by 67.07% and RMSE by 71.88%, yielding an R2 of 0.936. The resulting task-specific architecture connects module-structured data processing, federated synthesis, few-shot adaptation, and local TTE inference while raw usage logs remain within user-specific data boundaries.

RegionFed: Federated Learning for Personalized Query Understanding in Heterogeneous Retail Environments

Retail search systems serve diverse geographic regions with distinct query patterns, vocabularies, and product preferences, creating significant data heterogeneity that challenges both privacy-preserving training and model personalization. Federated learning offers a natural solution for privacy, but standard FL methods produce global models that sacrifice regional performance, while existing personalized FL approaches operate at the parameter level and catastrophically collapse on modern transformers (below 10\% accuracy on T5) due to tied embeddings and LayerNorm interactions. We introduce RegionFed, an \textit{architecture-robust} federated learning framework that sidesteps this failure by operating entirely at the gradient level. RegionFed uses the $\ell_2$ conflict between regional and global gradients as a unified signal that (i) diagnoses heterogeneity, (ii) routes each region to the cheapest sufficient personalization strategy, and (iii) adaptively controls personalization strength. Because it treats models as differentiable black boxes, RegionFed deploys on T5-Small, T5-3B, RoBERTa, and CNN with zero code changes, providing large gains on transformers (where parameter-level methods collapse) and consistent improvements on CNNs. Across three public datasets (Amazon ESCI, Amazon Reviews, LEAF-FEMNIST) and four architectures, RegionFed-Meta achieves 92.27\%, closing the gap to the privacy-violating centralized upper bound (Centralized + Regional Weighting: 92.04\%, $\Delta$=0.23pp, within 1$\sigma$) while providing $(\epsilon{\approx}0.60)$-differential privacy and $\mathcal{O}(1/\sqrt{T})$ convergence.

Beyond Client Clustering: Fine-Grained Preference Alignment in Federated RLHF via Self-Evolving Routing