mirror of
https://github.com/tiennm99/MTTools.git
synced 2026-10-05 14:14:50 +00:00
tiennm99
8eb55da485
Three blocks the site injects inside the chapter body were being extracted as prose: the sponsor block, a source watermark planted mid-chapter, and the prev/next chapter links. Anchors and images are now skipped, since inside a chapter body they are always site chrome, and the sponsor wrapper and watermark are skipped by class. Inline emphasis tags are left alone so italics in the prose survive. The sponsor wrapper has a sibling that must NOT be skipped: on most chapters the real text sits in a container hidden with display:none, because the body is gated behind a click on the sponsor link and revealed with JavaScript. Skipping hidden elements, or treating the two sibling classes as one family, discards the entire chapter. A test pins the gated body as kept while its sibling is dropped. Removes 662 words of injected text across the sample novel and lets the repeated chapter-number paragraph be recognised again, which the sponsor block had been masking by displacing it from the top of the body.
MTTools
Personal toolbox — small utilities and scripts, each formerly a standalone repository, merged here with full history.
| Directory | Tool | Language |
|---|---|---|
utils/ |
Utility batch and shell scripts to make life easier (or harder) | Batch/Shell |
go-util/ |
Miscellaneous CLI scripts (Gitea org cleanup, etc.), multi-binary cmd/ layout |
Go |
export-chrome-cookies/ |
Export Google Chrome cookies on Windows | Python |
miti-scraper/ |
Configurable single-site web scraper | Go |
circular-dependency-checker/ |
Detects cyclic dependencies in Godot projects | Python |
image-resizer/ |
Batch image resizer CLI — scales to a percentage, keeps aspect ratio | Go |
webp-converter/ |
HTTP microservice converting WebP images to PNG on-the-fly | Go |
update-dns/ |
Updates Cloudflare DNS records with your current dynamic IP | Shell |
ghibli-gallery-crawler/ |
Downloads the Studio Ghibli image gallery | Go |
crawl-prime/ |
Crawls large prime numbers from compoasso.free.fr | Go |
fbcount/ |
Counts messages per person in a Facebook data export | Node.js, Python |
bulk-telegram-sticker/ |
Creates Telegram stickers in bulk from images | Python |
Unmerged Go-rewrite drafts live on feature/export-chrome-cookies-go,
feature/circular-dependency-checker-go, and feature/bulk-telegram-sticker-go.