Germany Crawler - HVT Harness
Version 1 · Document the implemented source routes, commands, storage, breeding/profile evidence, full-test outcome, and limitations.
Historical versionGermany Crawler - HVT Harness
Last reviewed: 2026-08-08 AEST
Identity and scope
- Source ID:
de_hvt_harness - Discipline: Harness (
H) - Racing code / ISO country:
GER/DE - Adapter:
src/formcrawler/sources/de/hvt.py - Base site: https://www.hvtonline.de/
Routes and operation
- Monthly calendar:
https://www.hvtonline.de/monatstermine/YYYYMM/ - Complete starter day:
/{track}/starter/YYYYMMDD/ - Complete result day:
/{track}/rennbericht/YYYYMMDD/
python scripts\formcrawler.py capture-date-range --source de_hvt_harness --start YYYY-MM-DD --end YYYY-MM-DD --use-racingandsports-proxy
Direct public GETs presented a redirect challenge. The approved Racing and Sports public-GET proxy is therefore used; authentication, CAPTCHA, and access controls are not bypassed. Starter and race-report pages contain the whole meeting day, so one page per phase is complete.
Supplementary and breeding information
- Monthly race reports
- Result pages link videos, finish photographs, and official PDFs.
Cards expose sire, dam, country suffix/breeder text, and age from which the year can be derived. No stable standalone public horse-detail URL was found.
Storage and verification
Artifacts use FormCrawler/h-artifacts/<year>/GER/de_hvt_harness/; handoffs use FormParser/inbox/H/<year>/GER/de_hvt_harness/.
The complete 2026-06-04 München-Daglfing test captured starter and result pages through the approved proxy: two HTTP 200 artifacts, 193,400 bytes, a 22.838-second request gap, zero retries/content failures, and matching raw lengths, hashes, metadata, and handoffs.
Limitations
- The adapter covers regular-track patterns. Regional-track routes remain documented but not generalized.
capture-discoveredis not appropriate for an already-complete day page with no child links; use directcaptureor calendar discovery.
Module changelog
- 2026-08-08: Implemented monthly discovery and complete starter/result day capture through the approved proxy; full-day integrity test passed.