QDG Knowledge Base Read-only viewer QWebHub
general

Australia Crawler - Harness Racing Australia

Version 3 · Replaced the former branch-only note with the unified origin/main location and 200-test gate.

Australia Crawler - Harness Racing Australia

<!-- repository-baseline:start -->

Repository location

This crawler is in the unified origin/main baseline through merge commit ab0441e; synchronized documentation is at 545e1fe. The combined registry has 25 T, six H and two G adapters, and the unified suite passes 200 tests. Start new work from origin/main. <!-- repository-baseline:end -->

Last reviewed: 2026-08-08 AEST

Identity and scope

  • Source ID: au_harness_racing
  • Discipline: Harness (H)
  • Racing code / ISO country: AUS / AU
  • Adapter: src/formcrawler/sources/au/harness_racing.py
  • Base site: https://www.harness.org.au/

FormCrawler acquires raw server-rendered HTML only. It discovers current race cards from the fields list and completed meetings from monthly results indexes; it does not parse runners or results.

Routes and history

  • Current fields: https://natsite.harness.org.au/racing/fields/
  • Meeting lifecycle: https://natsite.harness.org.au/racing/fields/race-fields/?mc={meeting_code}
  • Monthly results: https://natsite.harness.org.au/racing/results/?month={MM}&year={YYYY}&state=all&search_type=monthly&activeTab=tab

The meeting URL is overwritten as a meeting progresses, so historical pre-race cards are not preserved. Historical post-race discovery is supported by month and exact date; current cards use the list fallback.

Operation

python scripts\formcrawler.py discover --source au_harness_racing --url "https://natsite.harness.org.au/racing/fields/"
python scripts\formcrawler.py run-queue --source au_harness_racing
python scripts\formcrawler.py capture-date-range --source au_harness_racing --start YYYY-MM-DD --end YYYY-MM-DD

Pre-race readiness requires a published race card and excludes pages already showing final results. Post-race readiness requires the meeting identity, races, and final-results publication marker.

Supplementary and breeding information

Horse pages provide sire, dam, exact foal date, and a partial country suffix.

Storage and verification

Artifacts are written beneath FormCrawler/h-artifacts/<year>/AUS/au_harness_racing/; FormParser handoffs are written beneath FormParser/inbox/H/<year>/AUS/au_harness_racing/.

The adapter and shared workflow are covered by the 123-test suite. The uncapped current-list test captured 25 of 26 cards; future DU090826 remained not-ready after a bounded direct recheck. A complete national results day could not be established: 31 July captured 2/7 indexed meetings and the final 16 July fallback captured 1/3. All 31 stored HRA artifacts (4,572,928 bytes) passed byte-length, SHA-256, metadata, and FormParser-handoff validation.

Limitations

  • Historical cards cannot be reconstructed after the lifecycle page changes to results.
  • A currently listed meeting can remain retryable until its card is actually published.
  • Some monthly-index result links return pages without the final-results publication markers; HRA remains partial for full national results-day coverage after three bounded repair cycles.

Module changelog

  • 2026-08-08: Implemented current-card and monthly-results discovery, raw pre/post capture, readiness validation, and integrity-checked live tests.
Updated by Codex on Aug. 8, 2026, 5:41 a.m. · Task: Unify Thoroughbred Harness Greyhound on main 2026-08-08 · Commit: 545e1fe01974e5c5b2411aab6188beb0659f0cd2