refactor: flatten data layout to data/, drop update/ overrides

Browse Source

- Move 63 Excel files from data/raw/ to data/ (single flat dir)
- Remove all 53 files in data/raw/update/: verified identical SBD
  coverage to raw/ (847349 rows either way), so they added no new
  students — only potential score corrections that can be reintroduced
  later if source is recovered
- Update build-database.js to read data/ directly
- Add scripts/audit-row-counts.js: compares source row count to DB row
  count to verify zero-loss parsing
- Point check-duplicates.js at new data/ location

...

This commit is contained in:

tiennm99

2026-04-14 21:02:47 +07:00

parent f10046f63d

commit 718e2e9117

120 changed files with 66 additions and 20 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

data/raw/10_BinhThuan_RIIW.xls.xlsx → data/10_BinhThuan_RIIW.xls.xlsx

data/raw/10_Ca_Mau_BKXT.xls.xlsx → data/10_Ca_Mau_BKXT.xls.xlsx

data/raw/10_LamDong_GNFT.xls.xlsx → data/10_LamDong_GNFT.xls.xlsx

data/raw/10_Soc_Trang_XCGJ.xls.xlsx → data/10_Soc_Trang_XCGJ.xls.xlsx

data/raw/11_BinhDuong_RYQL.xls.xlsx → data/11_BinhDuong_RYQL.xls.xlsx

data/raw/11_LaoCai_GMSU.xls.xlsx → data/11_LaoCai_GMSU.xls.xlsx

data/raw/12_BenTre_DKWF.xls.xlsx → data/12_BenTre_DKWF.xls.xlsx

data/raw/12_LongAn_ZZUK.xls.xlsx → data/12_LongAn_ZZUK.xls.xlsx

data/raw/13_NamDinh_ESEL.xls.xlsx → data/13_NamDinh_ESEL.xls.xlsx

data/raw/13_TraVinh_LKUJ.xls.xlsx → data/13_TraVinh_LKUJ.xls.xlsx

data/raw/14_NgheAn_BSLY.xls.xlsx → data/14_NgheAn_BSLY.xls.xlsx

data/raw/15_PhuTho_ABWQ.xls.xlsx → data/15_PhuTho_ABWQ.xls.xlsx

data/raw/16_QuangBinh_KGEU.xls.xlsx → data/16_QuangBinh_KGEU.xls.xlsx

data/raw/17_QuangNam_AMTK.xls.xlsx → data/17_QuangNam_AMTK.xls.xlsx

data/raw/18_QuangNgai_KOFP.xls.xlsx → data/18_QuangNgai_KOFP.xls.xlsx

data/raw/19_QuangTri_OMZF.xls.xlsx → data/19_QuangTri_OMZF.xls.xlsx

data/raw/1_BaRia_VungTau_HJKG.xls.xlsx → data/1_BaRia_VungTau_HJKG.xls.xlsx

data/raw/1_Da_Nang_AHWJ.xls.xlsx → data/1_Da_Nang_AHWJ.xls.xlsx

data/raw/1_Ha_Noi_CVXG.xls.xlsx → data/1_Ha_Noi_CVXG.xls.xlsx

data/raw/1_Son_La_JIDP.xls.xlsx → data/1_Son_La_JIDP.xls.xlsx

data/raw/1_TuyenQuang_JBYF.xls.xlsx → data/1_TuyenQuang_JBYF.xls.xlsx

data/raw/20_TayNinh_ILFA.xls.xlsx → data/20_TayNinh_ILFA.xls.xlsx

data/raw/21_ThaiBinh_FTVG.xls.xlsx → data/21_ThaiBinh_FTVG.xls.xlsx

data/raw/22_ThaiNguyen_TLTW.xls.xlsx → data/22_ThaiNguyen_TLTW.xls.xlsx

data/raw/23_HaiPhong_HXBV.xls.xlsx → data/23_HaiPhong_HXBV.xls.xlsx

data/raw/24_HCM_XULN.xls.xlsx → data/24_HCM_XULN.xls.xlsx

data/raw/2_BacKan_GFVQ.xls.xlsx → data/2_BacKan_GFVQ.xls.xlsx

data/raw/2_Ha_Giang_QNCM.xls.xlsx → data/2_Ha_Giang_QNCM.xls.xlsx

data/raw/2_Ninh_Thuan_VHLY.xls.xlsx → data/2_Ninh_Thuan_VHLY.xls.xlsx

data/raw/2_Thanh_Hoa_AUFV.xls.xlsx → data/2_Thanh_Hoa_AUFV.xls.xlsx

data/raw/2_VinhPhuc_GUDK.xls.xlsx → data/2_VinhPhuc_GUDK.xls.xlsx

data/raw/3_BacGiang_TOIF.xls.xlsx → data/3_BacGiang_TOIF.xls.xlsx

data/raw/3_BinhPhuoc_YFMU.xls.xlsx → data/3_BinhPhuoc_YFMU.xls.xlsx

data/raw/3_Cao_Bang_CIEY.xls.xlsx → data/3_Cao_Bang_CIEY.xls.xlsx

data/raw/3_Dong_Thap_GSXQ.xls.xlsx → data/3_Dong_Thap_GSXQ.xls.xlsx

data/raw/3_Thua_Thien_Hue_HMDB.xls.xlsx → data/3_Thua_Thien_Hue_HMDB.xls.xlsx

data/raw/4_An_Giang_JNOS.xls.xlsx → data/4_An_Giang_JNOS.xls.xlsx

data/raw/4_BacNinh_STLR.xls.xlsx → data/4_BacNinh_STLR.xls.xlsx

data/raw/4_Binh_Dinh_WWZW.xls.xlsx → data/4_Binh_Dinh_WWZW.xls.xlsx

data/raw/4_DienBien_SOJG.xls.xlsx → data/4_DienBien_SOJG.xls.xlsx

data/raw/4_Lang_Son_NYQL.xls.xlsx → data/4_Lang_Son_NYQL.xls.xlsx

data/raw/5_Bac_Lieu_XEKH.xls.xlsx → data/5_Bac_Lieu_XEKH.xls.xlsx

data/raw/5_Gia_Lai_ABZI.xls.xlsx → data/5_Gia_Lai_ABZI.xls.xlsx

data/raw/5_HaiDuong_WWWG.xls.xlsx → data/5_HaiDuong_WWWG.xls.xlsx

data/raw/5_Hanam_QGJS.xls.xlsx → data/5_Hanam_QGJS.xls.xlsx

data/raw/5_Yen_Bai_FAQR.xls.xlsx → data/5_Yen_Bai_FAQR.xls.xlsx

data/raw/6_Dong_Nai_WOTM.xls.xlsx → data/6_Dong_Nai_WOTM.xls.xlsx

data/raw/6_Hau_Giang_KWDM.xls.xlsx → data/6_Hau_Giang_KWDM.xls.xlsx

data/raw/6_HoaBinh_TPZY.xls.xlsx → data/6_HoaBinh_TPZY.xls.xlsx

data/raw/6_NinhBinh_IGFT.xls.xlsx → data/6_NinhBinh_IGFT.xls.xlsx

data/raw/6_Quang_Ninh_DQCJ.xls.xlsx → data/6_Quang_Ninh_DQCJ.xls.xlsx

data/raw/7_HaTinh_DDHD.xls.xlsx → data/7_HaTinh_DDHD.xls.xlsx

data/raw/7_HungYen_LTIK.xls.xlsx → data/7_HungYen_LTIK.xls.xlsx

data/raw/7_Kon_Tum_RSLR.xls.xlsx → data/7_Kon_Tum_RSLR.xls.xlsx

data/raw/7_Tien_Giang_EFHX.xls.xlsx → data/7_Tien_Giang_EFHX.xls.xlsx

data/raw/8_Can_Tho_RQZM.xls.xlsx → data/8_Can_Tho_RQZM.xls.xlsx

data/raw/8_Dak_Lak_YKPR.xls.xlsx → data/8_Dak_Lak_YKPR.xls.xlsx

data/raw/8_KienGiang_OTOB.xls.xlsx → data/8_KienGiang_OTOB.xls.xlsx

data/raw/8_PhuYen_OGIM.xls.xlsx → data/8_PhuYen_OGIM.xls.xlsx

data/raw/9_DakNong_FBOP.xls.xlsx → data/9_DakNong_FBOP.xls.xlsx

data/raw/9_Khanh_Hoa_KPKQ.xls.xlsx → data/9_Khanh_Hoa_KPKQ.xls.xlsx

data/raw/9_LaiChau_ALKN.xls.xlsx → data/9_LaiChau_ALKN.xls.xlsx

data/raw/9_Vinh_Long_OLWA.xls.xlsx → data/9_Vinh_Long_OLWA.xls.xlsx

data/raw/update/1.BaRia-VungTau_PGZT.xlsx

BIN

Binary file not shown.

data/raw/update/1.Da Nang_ABWU.xlsx

BIN

Binary file not shown.

data/raw/update/1.Son La_XLFN.xlsx

BIN

Binary file not shown.

data/raw/update/1.TuyenQuang_PTMR.xlsx

BIN

Binary file not shown.

data/raw/update/10.BinhThuan_MVVG.xlsx

BIN

Binary file not shown.

data/raw/update/10.LamDong_YUQA.xlsx

BIN

Binary file not shown.

data/raw/update/10.Soc Trang_LQWU.xlsx

BIN

Binary file not shown.

data/raw/update/11.BinhDuong_HVAH.xlsx

BIN

Binary file not shown.

data/raw/update/11.LaoCai_ZTBP.xlsx

BIN

Binary file not shown.

data/raw/update/12.BenTre_NQTU.xlsx

BIN

Binary file not shown.

data/raw/update/12.LongAn_PDRH.xlsx

BIN

Binary file not shown.

data/raw/update/13.NamDinh_NAYR.xlsx

BIN

Binary file not shown.

data/raw/update/13.TraVinh_FODZ.xlsx

BIN

Binary file not shown.

data/raw/update/14.NgheAn_HTKD.xlsx

BIN

Binary file not shown.

data/raw/update/15.PhuTho_IJZW.xlsx

BIN

Binary file not shown.

data/raw/update/17.QuangNam_NQMG.xlsx

BIN

Binary file not shown.

data/raw/update/18.QuangNgai_IUPY.xlsx

BIN

Binary file not shown.

data/raw/update/19.QuangTri_MKNN.xlsx

BIN

Binary file not shown.

data/raw/update/2.BacKan_YQNX.xlsx

BIN

Binary file not shown.

data/raw/update/2.Ha Giang_PIYK.xlsx

BIN

Binary file not shown.

data/raw/update/2.Ninh Thuan_BAGG.xlsx

BIN

Binary file not shown.

data/raw/update/2.Thanh Hoa_UOPE.xlsx

BIN

Binary file not shown.

data/raw/update/2.VinhPhuc_QZJK.xlsx

BIN

Binary file not shown.

data/raw/update/20.TayNinh_KJAQ.xlsx

BIN

Binary file not shown.

data/raw/update/21.ThaiBinh_KTQN.xlsx

BIN

Binary file not shown.

data/raw/update/22.ThaiNguyen_BKIF.xlsx

BIN

Binary file not shown.

data/raw/update/24.HCM_UTLQ.xlsx

BIN

Binary file not shown.

data/raw/update/3.BacGiang_SAVS.xlsx

BIN

Binary file not shown.

data/raw/update/3.BinhPhuoc_IPHL.xlsx

BIN

Binary file not shown.

data/raw/update/3.Cao Bang_WMUU.xlsx

BIN

Binary file not shown.

data/raw/update/3.Dong Thap_HKJX.xlsx

BIN

Binary file not shown.

data/raw/update/3.Thua Thien -Hue_MAET.xlsx

BIN

Binary file not shown.

data/raw/update/4.An Giang_PMJD.xlsx

BIN

Binary file not shown.

data/raw/update/4.BacNinh_NNIS.xlsx

BIN

Binary file not shown.

data/raw/update/4.Binh Dinh_VOMJ.xlsx

BIN

Binary file not shown.

data/raw/update/4.DienBien_FYGN.xlsx

BIN

Binary file not shown.

data/raw/update/4.Lang Son_QWOG.xlsx

BIN

Binary file not shown.

Some files were not shown because too many files have changed in this diff Show More