Australia Crawler - Harness Racing Australia
Version 1 · Document the implemented source routes, commands, storage, breeding/profile evidence, full-test outcome, and limitations.
Historical versionAustralia Crawler - Harness Racing Australia
Last reviewed: 2026-08-08 AEST
Identity and scope
- Source ID:
au_harness_racing - Discipline: Harness (
H) - Racing code / ISO country:
AUS/AU - Adapter:
src/formcrawler/sources/au/harness_racing.py - Base site: https://www.harness.org.au/
FormCrawler acquires raw server-rendered HTML only. It discovers current race cards from the fields list and completed meetings from monthly results indexes; it does not parse runners or results.
Routes and history
- Current fields: https://natsite.harness.org.au/racing/fields/
- Meeting lifecycle:
https://natsite.harness.org.au/racing/fields/race-fields/?mc={meeting_code} - Monthly results:
https://natsite.harness.org.au/racing/results/?month={MM}&year={YYYY}&state=all&search_type=monthly&activeTab=tab
The meeting URL is overwritten as a meeting progresses, so historical pre-race cards are not preserved. Historical post-race discovery is supported by month and exact date; current cards use the list fallback.
Operation
python scripts\formcrawler.py discover --source au_harness_racing --url "https://natsite.harness.org.au/racing/fields/"
python scripts\formcrawler.py run-queue --source au_harness_racing
python scripts\formcrawler.py capture-date-range --source au_harness_racing --start YYYY-MM-DD --end YYYY-MM-DD
Pre-race readiness requires a published race card and excludes pages already showing final results. Post-race readiness requires the meeting identity, races, and final-results publication marker.
Supplementary and breeding information
- Trials
- Stewards reports
- Video replays
- Horse example: horse 817467
Horse pages provide sire, dam, exact foal date, and a partial country suffix.
Storage and verification
Artifacts are written beneath FormCrawler/h-artifacts/<year>/AUS/au_harness_racing/; FormParser handoffs are written beneath FormParser/inbox/H/<year>/AUS/au_harness_racing/.
The adapter and shared workflow are covered by the 123-test suite. The uncapped current-list test captured 25 of 26 cards; future DU090826 remained not-ready after a bounded direct recheck. A complete national results day could not be established: 31 July captured 2/7 indexed meetings and the final 16 July fallback captured 1/3. All 31 stored HRA artifacts (4,572,928 bytes) passed byte-length, SHA-256, metadata, and FormParser-handoff validation.
Limitations
- Historical cards cannot be reconstructed after the lifecycle page changes to results.
- A currently listed meeting can remain retryable until its card is actually published.
- Some monthly-index result links return pages without the final-results publication markers; HRA remains partial for full national results-day coverage after three bounded repair cycles.
Module changelog
- 2026-08-08: Implemented current-card and monthly-results discovery, raw pre/post capture, readiness validation, and integrity-checked live tests.