mirror of
https://github.com/tiennm99/thptqg.git
synced 2026-08-13 17:22:27 +00:00
tiennm99
c359a0b444
The repository now reads as the pipeline it is: crawler fetches, parser converts, assembler verifies and publishes, with data/ and web/ as the stores they hand work through. go-parser is renamed parser now that there is no other. The assembler replaces build-db.js and assemble-site.js. It compiles the parser, builds and verifies each database, compresses it, runs the Vite build and assembles _site — one command, and the only place that knows the order. It also closes a real hole: nothing previously asserted that a database reached the site. An empty staging directory assembled happily, so every page rendered, every query 404d and CI stayed green. The row-count and size guards could not catch that, since they only run when a database was built at all. Removing Node from the root forced the dataset list out of web/src/datasets.js, which the assembler cannot import. datasets.json is now the registry both sides read — JSON because Go and the browser both parse it without a dependency — while presentation stays in the web app, keyed by id and cross-checked against the registry so a half-added dataset fails instead of half-working. Guards verified by making each one fail: a missing database, and an expected row count one higher than the truth.
518 B
518 B
Docs
project-overview.md— goal, scope, constraints, the datasets, historysystem-architecture.md— data flow, canonical schema, routing, how one frontend serves both exam yearsdata-pipeline.md— Excel parse quirks, per-dataset formats, overflow-sheet gotcha, expected row counts, verifying a rebuilddeployment-guide.md— GitHub Pages workflow, adding a dataset, rollback, troubleshooting