← Validation

Validation Evidence Packets

A validation packet is a small, frozen package that lets an external group test one FluxMateria capability without ambiguity.

Packet contents

README.md
scope.md
case_template.csv
target_template.csv
prediction_schema.csv
scoring_script.py
metrics.md
module_status_labels.md
authorship_policy.md
negative_results_policy.md
version_manifest.json

Packet principles

  • The property must be named.
  • The dataset must be frozen before prediction.
  • Targets should remain hidden whenever possible.
  • The metric must be agreed before prediction.
  • FluxMateria returns a frozen prediction file.
  • External validators can score independently.
  • Results can be positive, mixed, or negative.

Before a packet is run, validators can review the authorship policy and negative-results policy.

Recommended packet types

Packet Best for First test size
Chemistry Core Bond lengths, bond energies, reaction enthalpies 20-100 cases
Materials Holdout Property prediction on selected materials 20-200 cases
Life Science / ADMET One endpoint, one split 100-10,000 cases
Mechanism / Barrier Reaction mechanism or barrier prediction 20-100 cases
Experimental Future or hidden measurements 5-50 cases

Versioning

Every prediction file should include:

fluxmateria_version
module_version
prediction_timestamp
input_file_hash
output_file_hash
status_label

Request a packet

Use the validation packet form with the track, property, approximate number of cases, whether targets are hidden, and preferred metric.

Use the request form