Skip to content
Open access

TRACE-Chem: Symmetry-Aware Counterfactual Reasoning over Typed Evidence Graphs for Verifiable Multimodal Chemical Record Extraction

Aug 2026 · Symmetry · Vol 18, pp. 1437 · 0 citations · 42 references

TL;DR

Examining relational symmetry and asymmetry improves verifiability, calibration, and repair safety in multimodal chemical extraction and improves verifiability, calibration, and repair safety in multimodal chemical extraction.

Abstract

Automatically extracted chemical records can appear complete even when names, depictions, formulas, masses, and spectra disagree. Because databases consume records rather than evidence, such errors propagate silently. TRACE-Chem (Typed Relational Attestation with Counterfactual Editing for Chemistry) is an inference-time framework for verifying and repairing them. It organizes source-linked observations, candidate fields, and verifier outcomes in a Symmetric–Asymmetric Evidence Graph (SAEG) separating symmetric identity checks from directional scientific derivations. Counterfactual Localization and Dependency-Constrained Re-decoding (CLDR) masks candidate fault nodes to identify the view whose removal most restores coherence, then revises only dependency-affected fields. Executable checks and spectral compatibility feed a calibrated accept, repair, or abstain decision. On 124 open-access synthesis papers containing 1852 compound and 638 reaction records, TRACE-Chem achieved 84.3% canonical-record hard-match F1, 9.7 percentage points above the same extractor without verification. Against a single-pass multimodal baseline, invalid structures fell from 10.8% to 0.8%, unsupported fields from 14.3% to 2.4%, and expected calibration error from 0.281 to 0.052. Removing derivation direction lowered fault-localization accuracy from 91.2% to 82.8%; removing dependency discounting raised the unsafe-edit rate from 2.4% to 4.1%. Explicitly modeling relational symmetry and asymmetry therefore improves verifiability, calibration, and repair safety in multimodal chemical extraction.

Read PDF

Similar papers

Jul 2026

Grounded verification of chemical and materials reasoning: detection is the bottleneck

This work shows that deterministic, database-grounded verification catches and repairs errors selectively, and that the binding constraint is detection rather than repair, and that the binding constraint is detection rather than repair.

Can Polat, Mustafa Kurban, E. Serpedin et al. · 0 citations
Jul 2026

PEARL: Auditable Repair for Scientific Reasoning Graph Extraction

Scientific Reasoning Graph Extraction (SRGE) aims to recover explicit links among observations, evidence, intermediate claims, and paper-level conclusions. LLMs can produce graph-like scientific explanations, but their outputs often mix malformed syntax, drifting edge labels, incorrectly oriented roots, and weak source...

Bo-Han Su, Pengze Li, Yuchen Lu et al. · 0 citations
Preprint Aug 2026

Evidence-Carrying Validation for Knowledge Graphs

This work presents an evidence-carrying validation interface: every selected node-shape check returns either a satisfaction trace or failure witness, and shows how programs combine passing and failing evidence to diagnose missing information and guide repair.

Gabe Fierro · 0 citations

Diagnostic Knowledge Graphs: Automated Benchmark Construction and Deterministic Evaluation for Multi-Step Reasoning Agents

It is argued that building reproducible diagnostic benchmarks and building effective diagnostic agents are dual problems solved by the same artifact —a canonical knowledge structure that normalizes evaluation gold-standards and constrains agent hypothesis spaces simultaneously.

Unknown authors · 0 citations
Review Jul 2026

Plato-Bio: verification-first biological novelty screening with temporal rediscovery and structural benchmarks

Plato-Bio is developed, a biology-routed extension of the open Plato/Denario architecture that couples explicit workflow states with provenance records, citation checks, claim-to-evidence links, scoped file writes, and publication gates, and provides reproducible software contracts and auditable screening baselines.

Stefan Creadore · 0 citations
Preprint Aug 2026

SymboUQ: Symbolic Uncertainty Quantification for Spatial Reasoning in LLMs

SymboUQ is a symbolic uncertainty quantification framework that estimates final-answer reliability from reasoning traces by distinguishing symbolizability, whether a claim can be represented in the verifier's formal language, from semantic determinacy, whether its execution yields an entailed or contradicted verdict ra...

Da-Hai Yu, Lin Jiang, Rong-Chao Xu et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.