Core research line

Machine learning on the fingerprint region

The hypothesis: below 1500 cm⁻¹, the coupled skeletal modes encode molecular identity, while above 1500 cm⁻¹ the local modes encode functional class. If true, the fingerprint region — usually treated as too complex to read — is the richest channel for learned compound identification and interaction sensing. Phase 1 tests exactly that, on computed spectra.

The hypothesis, stated testably

  1. H1 — Class from the high region. A model predicting functional groups should do well using only >1500 cm⁻¹.
  2. H2 — Identity from the fingerprint. For nearest-spectrum compound retrieval, the <1500 cm⁻¹ region should outperform the >1500 cm⁻¹ region.
  3. H3 — Discrimination of look-alikes. Among molecules with identical functional-group labels, the fingerprint region should separate them better than the high region.

Phase 1 — proof of concept

ComponentSetup
Dataset146 curated small molecules; GFN2-xTB IR computed on the platform's quantum-chemistry backend (0 failures).
RepresentationLorentzian-broadened, 181-pt vector over 400–4000 cm⁻¹ (20 cm⁻¹ bins).
Labels21 functional-group classes from RDKit SMARTS (deterministic ground truth).
ModelsRandom forest for group inference; cosine nearest-neighbour for compound retrieval.
Regions comparedFULL (400–4000) · FINGERPRINT (<1500) · HIGH (>1500).

Result 1 — functional-group inference (H1)

MetricScoreStrong per-class examples
Macro-F10.61acid 1.00 · carbonyl 0.97 · alcohol 0.85 · aromatic 0.78 · nitrile 0.71
Micro-F10.76

Read: functional class is recoverable from a computed spectrum even at this small scale. Macro < micro reflects rare classes with few positives — expected, and a scaling target.

Result 2 — compound retrieval by region (H2)

RegionTop-1Top-3
FULL (400–4000)0.570.71
FINGERPRINT (<1500)0.420.62
HIGH (>1500)0.360.52

Read: the fingerprint region beats the high region for identifying which molecule a spectrum belongs to (0.42 vs 0.36 top-1; 0.62 vs 0.52 top-3) — H2 supported. The full spectrum is best, as expected, since it carries both channels.

Result 3 — separating look-alikes (H3)

Across 400 molecule pairs with identical functional-group labels, mean cosine distance between spectra:

RegionMean cosine distance
FINGERPRINT (<1500)0.46
HIGH (>1500)0.40

Read: when functional groups are the same, the fingerprint region pulls the spectra further apart than the high region (0.46 vs 0.40) — i.e. it carries the residual identity signal that group frequencies miss. H3 supported.

Honest caveats — this is Phase 1

N is small (146 molecules); spectra are computed, not measured, so absolute accuracy is bounded by GFN2-xTB and the harmonic approximation, and a model could partly learn the generator's systematics. Retrieval is on held-out computed spectra, not lab data. The results establish direction and feasibility, not deployable accuracy. Every number above is reproducible from the generation/training scripts on the compute node.

Domain-shift validation — computed vs measured

The decisive test for a synthetic-data programme: does a model built on GFN2-xTB computed spectra recognise real measured ones? We paired 999 of the 1,000 molecules in the NIST experimental database with a GFN2-xTB calculation of the same molecule (SMILES pulled from PubChem and formula-validated against NIST — 1 mismatch dropped, 0 SMILES/calc failures), put both on a common 181-pt absorbance grid, and measured transfer.

TestIn-domain (measured)Computed → measured
Functional-group F1 (macro / micro)0.57 / 0.810.14 / 0.39
Retrieval — same-class top-1 (full)0.36
Retrieval — same-class (fingerprint / high)0.23 / 0.24
Retrieval — exact-molecule top-1 (full)0.05
Best after frequency-scaling sweep0.39 (×0.98)

Read — the gap is real but not catastrophic at scale. Growing the measured set from 141 → 999 molecules more than doubled the in-domain ceiling (measured-only macro-F1 0.27 → 0.57) — the database growth paid off directly. Cross-domain transfer is still weak (0.14 macro) but a measured spectrum retrieves a same-functional-class computed molecule 36% of the time — real class signal across the gap. Exact-molecule retrieval is low (0.05) because a 1,000-molecule library is dense with near-identical homologs (pentane/hexane/heptane). A global frequency scaling factor still doesn't close the gap (optimum near native, ×0.98) — the mismatch is in intensities, anharmonicity and rotational structure, not a simple offset.

What this means for the programme

So the synthetic library is not a drop-in substitute for measured data — but the scaled learning curve below shows it is not useless either. The research directions remain: (1) better physics — anharmonic VPT2 rather than harmonic frequencies; (2) domain adaptation — fine-tune on the measured anchor set; (3) keep growing the measured database, which moved the ceiling more than anything else (0.27 → 0.57 macro-F1 from 141 → 999 molecules).

When does the computed library help? (the cold-start result)

We train a functional-group model on the full computed library plus k measured spectra, and compare against k measured spectra alone, scoring on held-out measured spectra (5-fold). At 999 molecules a clear pattern emerges that the small (141) set could not show:

Measured spectra in training (k)Measured-only (macro / micro)Computed + measured
00.13 / 0.39
100.08 / 0.290.15 / 0.44
200.12 / 0.380.16 / 0.46
400.17 / 0.500.16 / 0.48
800.24 / 0.580.20 / 0.51
3200.45 / 0.720.37 / 0.67
all (~800)0.56 / 0.800.52 / 0.77

Read — synthetic spectra help exactly when real data is scarce. In the cold-start regime (k ≤ 20) the computed library clearly beats measured-only (k=10: 0.15 vs 0.08 macro) — harmonic spectra are a useful prior when you have almost no labels. The benefit vanishes by k ≈ 40 and reverses beyond it: once enough measured spectra exist, the computed library becomes a distractor (k=320: 0.37 vs 0.45). This refines the earlier small-sample conclusion into an actionable rule: use synthetic IR augmentation when measured data is scarce, drop it once you have plenty — and the fastest way to raise the absolute ceiling is simply more measured spectra (green column climbs to 0.56). Numbers are RandomForest on broadened harmonic spectra; the crossover point will shift with task, representation and better physics.

PDB-grounded structure learning

Experimental protein IR at scale doesn't exist openly — so we ground the learning in the Protein Data Bank: real 3D structures provide true (sequence, secondary-structure) labels, we forward-simulate the amide I band from each fold, and learn the inverse. The structure is the ground truth; the IR is computed. 76 single-domain chains across fold classes (mean 37% helix, 23% sheet).

amide I → secondary-structure contenthelix MAEsheet MAE
Baseline (predict dataset mean)22%18%
Clean simulated band (SS only)3.0%1.2%0.97 / 0.98
Realistic (+ side-chain interference + noise)3.7%3.6%0.96 / 0.94

Read — when the target is structure, IR + ML works. The model recovers secondary-structure content to ~3–4% even when side-chain absorptions (Asn/Gln/Arg/Asp/Glu/Tyr/His) overlap the amide I band — the genuine confound that complicates real protein FTIR — versus 18–22% for guessing the mean. This reproduces the established FTIR protein-structure analysis computationally, validated on real PDB folds, and is the positive counterpart to the small-molecule domain gap above: exact-identity transfer is hard, but structure/composition is well within reach. It is also the data-generation template for the harder targets — per-residue structure, and coupling to the sequence-feasibility loop.

Honest scope

The forward model is our amide I band-shape (secondary-structure components + side-chain bands + noise); real measured protein FTIR adds the strong water background, ATR/scattering effects and conformational heterogeneity. The result establishes that the information is recoverable and the pipeline is sound; the next iterations scale the PDB set, move to per-residue secondary structure, and replace the analytic forward model with computed amide I from real coordinates.

Objective 2 — noncovalent interactions (design)

The next experiment turns the same pipeline onto interactions. A hydrogen bond red-shifts, broadens and intensifies the donor X–H stretch by an amount that tracks bond strength (the Badger–Bauer relation). The plan: compute spectra of monomers vs H-bonded dimers/complexes and train a classifier to detect and grade the interaction from the band shift — first on O–H···O and N–H···O, then halogen bonding and ion pairing.

Δν̄(X–H) ∝ −ΔHH-bond // red-shift grows with interaction strength

Roadmap

PhaseGoalNeeds
1 ✓Feasibility: class, identity-by-region, look-alike separationdone (146 mol, computed)
2Noncovalent detector: monomer vs complex band-shift classifierdimer/complex generation set
3 ◐Scale to 10³–10⁴ molecules; measured anchor set (1,000 NIST spectra live, growing); computed-vs-measured domain-shift study done (see above) → gap quantified, next is domain adaptation + anharmonic spectralocal GPU compute node
4Deep models (1D-CNN / transformer) over raw spectra; amide-shape → secondary structurescaled labelled corpus

Compute

Phases 3–4 are compute-bound. The platform's quantum-chemistry backend already runs the GFN2-xTB calculations on demand; scaling to 10³–10⁴ molecules plus deep models is the motivation for a dedicated local GPU node. Spectra are explored on-site in the simulator.

Related: how the spectra are generated · amide-shape → secondary structure · vibrational probes for binding.