The record

The Record

Preserve the failures as carefully as the successes.

The website is not intended to become a collection of favorable demonstrations. It is the public memory surrounding a bounded artifact: what was tested, under which version, what happened, what failed, what remained unresolved, what reconciliation later established, and what changed as a result. If the project develops, its history should remain capable of showing how it developed.

ATB / RECORD / 001
Artifact fixed Frozen protocol · owner access Preregistration pending Results empty
Scientific state must remain reconstructable.

The organizing principle

The manuscript is the experimental artifact.The website is the experimental record.

Developmental history. Before the test edition was locked, the author and the developing manuscript formed a recursive process: reasoning produced the artifact, the artifact made that reasoning durable and inspectable, and reflection on the artifact helped reorganize later reasoning and revision. The manuscript participated as an external environment; it did not independently create the architecture or contain a complete model of the author's mind.

Experimental condition. Once an edition is designated for testing, that developmental loop is stopped. The printed manuscript becomes the bounded, version-locked artifact supplied without continued intervention from its author.

The website maintains the evolving scientific infrastructure around that artifact: preregistered protocols, controls, scoring methods, experiment versions, datasets, results, replications, and methodological revisions. The website may evolve. The artifact tested in a particular experiment must remain identifiable and fixed. A later website revision cannot retroactively alter the manuscript or the conditions of an earlier test.

Experimental exposure

Once I have encountered it, it is no longer genuinely novel to me.

Because I am presently the human reference against which reconstruction of the artifact can be evaluated, experimental exposure matters.

If I am shown a novel question, scenario, piece of evidence, interpretation, model output, or other information capable of affecting subsequent testing, that exposure becomes part of the experimental history. That exposure is documented. This requirement is not optional.

The scientifically relevant substance of qualifying exposure is preserved through the project's public research record, including its Open Science Framework record or designated successor. Later researchers must be able to distinguish a genuinely novel test from something I have already encountered.

01

What the public record preserves

The record preserves enough information to maintain the interpretability and continuity of the research, including where applicable:

  • artifact and architecture version;
  • experimental period;
  • relevant questions, scenarios, evidence, or exposures;
  • the author's original response and reconstruction outputs;
  • conditions required to interpret the comparison;
  • identified discrepancies and their status;
  • reconciliation findings; and
  • resulting effects on the architecture or version history.

The purpose is contamination control, methodological memory, and an auditable history of how the architecture changed.

02

Confidentiality

Confidentiality can protect the participant. It cannot erase the experiment.

Where appropriate and legally permissible, confidentiality may protect names, organizations, affiliations, contact information, internal project names, unrelated proprietary information, trade secrets, and other identifying or commercially sensitive information unnecessary to preserve the scientific meaning of the exposure.

My identity is known. Yours does not have to be. Your organization does not have to be identified. But my scientifically relevant experimental exposure must remain part of the record.

An engagement requiring the experimental exposure itself to disappear is incompatible with direct participation in this research program.

03

Reconciliation

An observed discrepancy between the author and the artifact is not automatically treated as failure by either one. Experimental exposures accumulate before being considered through a separate reconciliation process designed to determine, as far as the evidence permits, what produced the discrepancy.

Reconciliation preserves the distinction between the original experimental observation and its later interpretation. A discrepancy may reflect corrected information, legitimate revision, an incomplete reconstruction, incorrect weighting, a procedural confound, architectural change, or a question that remains unresolved.

04

Versioning and ESPS

The version under active testing remains bounded during its testing period. Reconciliation findings are evaluated collectively rather than used to rewrite the experimental object after individual trials.

ESPS serves as the formal architectural record of that reconciliation. Where findings establish something new about the distinctions, weighting structures, revision mechanisms, constraints, or other operations underlying the author's reasoning, the appropriate subsequent version records that architectural development.

The version history preserves what the earlier version reconstructed, what the author actually did, what later reconciliation determined, and what changed next. Earlier results are not rewritten to make a later version appear more successful.

Current state

Experiment Status

Accurate as of the Version 1.0 package release on September 4, 2026.

Artifact

The Acts of Erudition — fixed manuscript edition used for testing

Research package

Version 1.0 · owner-protected

Phase

Frozen v1.0 / Pre-Confirmatory Testing

Confirmatory question bank

Not publicly released

Formal results

Not yet published

Preregistration

Pending

Formal Research Package — Version 1.0

A procedure built to be challenged.

Ask the Book began as an exploratory experiment: could a version-locked artifact produced through recursive externalization, reflection, and revision retain enough structure to display measurable continuity when confronted with questions its author never answered?

Version 1.0 establishes the infrastructure required to test that question more rigorously. It defines the confirmatory protocol, control conditions, blinded scoring procedure, independent question-generation process, human-reference baseline, statistical analysis plan, data structure, and preregistration requirements.

These owner-protected materials exist so the experiment can fail, be audited, be criticized, and eventually be replicated. They establish a procedure for testing the hypothesis; they are not proof that the hypothesis is correct.

Complete archive · ZIP · September 2026

The Complete Research Package

The protocol, scoring system, rater and administrator materials, pilot bank, data workbook, analysis specification, preregistration form, and cryptographic manifest in one versioned archive. The ZIP contains protected research materials and is available only after owner verification. Assigned investigators obtain appropriate materials through the Test Administrator.

Obtain owner access
01Protocol · v1.0 · September 2026Ask the Book Confirmatory Experimental ProtocolHow the first formal test can succeed, fail, or be excluded.

The authoritative procedure for the first formal confirmatory test, including experimental conditions, blinding, human-reference reliability testing, exclusions, model controls, replication requirements, and preregistered decision criteria.

02Scoring · v1.0 · September 2026Structural Continuity Scoring ManualWhat counts as correspondence beyond a matching conclusion.

The operational scoring system used to compare human and model responses across multiple dimensions of reasoning structure rather than conclusion agreement alone.

03Blinding · v1.0 · September 2026Blind Rater PacketIndependent comparison without revealing which condition produced a response.

Instructions and scoring materials designed for independent evaluators who compare responses without knowing which condition produced them.

04Administration · v1.0 · September 2026Question Author & Test Administrator PacketHow unseen questions are created, screened, sealed, and preserved.

The procedure for generating, screening, randomizing, sealing, administering, and preserving genuinely unseen confirmatory questions.

05Public training material · v1.0 · September 2026Pilot / Rater-Training Question BankExamples for demonstration and calibration—not confirmatory evidence.
NOT PART OF THE CONFIRMATORY QUESTION SET

A protected set of example and training questions used to demonstrate question construction and calibrate raters. Because these questions are available for pilot and training use, they are permanently excluded from confirmatory testing.

06Data · v1.0 · September 2026Experimental Data WorkbookThe functional instrument that preserves the study record.

The structured data instrument for recording questions, experimental conditions, Austin T1/T2 responses, model runs, blinded pairings, rater scores, exclusions, condition summaries, and final decision gates.

The XLSX is the functional research instrument. The PDF is a read-only map of its sheets and fields; it does not replace the workbook.

07Analysis · v1.0 · September 2026Statistical Analysis SpecificationThe rules that must govern interpretation before results exist.

The preregistered analysis rules governing aggregation, inter-rater reliability, paired comparisons, bootstrap confidence intervals, missing-data treatment, and interpretation of the primary result.

08Preregistration · v1.0 · September 2026Preregistration FormWhat must be frozen before confirmatory testing begins.
STATUS: PENDING — THE FORM IS AVAILABLE, BUT A COMPLETED PREREGISTRATION HAS NOT YET BEEN PUBLISHED.

The declaration of hypotheses, conditions, scoring rules, analysis procedures, and decision thresholds that must be completed and committed before confirmatory testing begins.

09Integrity · v1.0 · September 2026Version Manifest / SHA-256 RecordCryptographic identifiers for the exact native Version 1.0 files.

Cryptographic checksums identify the exact Version 1.0 research files. Later investigators can use these hashes to verify that the archived native materials have not silently changed.

The manifest identifies the original native files inside the Version 1.0 ZIP. Public PDF conversions are presentation copies and do not replace those hashed source files.

Deliberately absent

Why isn't the confirmatory question bank here?

A valid confirmatory test requires questions the author has not seen in advance. Publishing those questions before testing would contaminate the experiment.

The website explains the rules by which the question bank is created, screened, randomized, and preserved—but not the active confirmatory questions themselves before testing. After a completed experimental run is locked, the used questions may be released as part of that experiment's permanent record.

Artifact identity

What Exactly Is Being Tested?

Ask the Book does not test an abstract idea called “the author's philosophy.” It tests the identifiable surviving product of a recursive developmental process. For a formal experiment, that exact product becomes a bounded artifact.

Every formal experiment should preserve
  1. Manuscript edition and publication date
  2. Cryptographic file hash
  3. Exact Ask the Book prompt version
  4. Model and model version
  5. Experimental protocol version

Developmental history and experimental condition are deliberately separated. The author and manuscript could influence one another while the work was being made; after version lock, the author no longer modifies the artifact or participates in the model's answer.

Later revisions to the book, ESPS, prompt, or experimental protocol are new experimental conditions. They must not be silently substituted for earlier versions.

This version ledger allows an experiment conducted years later to identify precisely what was tested—and lets a critic reconstruct the methodological state in which a result was produced.

Preserved revisions

Version History

04 SEP 2026

Research Package v1.0

Initial formal confirmatory architecture.

PRE-CONFIRMATORY

Future versions will not overwrite earlier packages. Each revision must state what changed, why, whether it occurred before or after a run, and which experiments used it.

Results & Replications

No confirmatory result has been published yet.

Exploratory pilot testing informed Version 1.0 but is not being presented as confirmatory evidence.

RECORD EMPTY
What every future result record must preserve
  • Experiment number and date
  • Protocol and artifact versions
  • Models tested and question count
  • Structural Continuity Index results
  • Austin-vs-Austin baseline
  • Control-condition comparisons
  • Inter-rater reliability
  • Failed decision gates
  • Full dataset and raw model outputs
  • Analysis files and protocol deviations
  • Replication attempts
  • Limitations

Failures must be displayed as visibly as successes. This archive is an experimental record, not a collection of testimonials.

Chronological memory

The website preserves what happens around the artifact.

  1. 01Artifact
  2. 02Protocol
  3. 03Preregistration
  4. 04Test
  5. 05Data
  6. 06Result
  7. 07Criticism
  8. 08Replication
  9. 09Revision
  10. 10Next test

The current experiment asks whether a fixed artifact produced through recursive author–manuscript development retains recoverable, measurable aspects of the reasoning architecture that helped produce it. Possible future technologies remain speculation unless controlled evidence makes them more than that.

Researchers and investigators

The most valuable contribution is not endorsement. It is a better test.

If you see a weakness in the hypothesis, architecture, controls, scoring system, interpretation, or experimental design, test it. Propose adversarial questions, stronger controls, independent scoring, replication attempts, alternative explanations, or methods capable of showing that an apparent effect is generic, unstable, contaminated, or absent. A criticism capable of becoming a test is more valuable to this project than agreement that cannot.

Request Austin's participation