Commit Graph
13 Commits
Author SHA1 Message Date
PavelandAlex aaad51f951 Harden protection with pinned requests and path-param encoding (#2486)
* Harden protection with pinned requests and path-param encoding

* fix: domain pinning

* fix: tests

* fix: html test 2

---------

Co-authored-by: Alex <a@tushynski.me>
2026-05-23 02:33:29 +01:00
Alex df57053613 feat: improve crawlers and update chunk filtering (#2250) 2026-01-06 00:52:12 +02:00
Alex 98e949d2fd Patches (#2218)
* feat: implement URL validation to prevent SSRF

* feat: add zip extraction security

* ruff fixes
2025-12-24 17:05:35 +02:00
Alex 481df4d604 fix: enhance error logging with exception info across multiple modules 2025-05-05 13:12:39 +01:00
Pavel 13fcbe3e74 scraper with markdownify 2025-01-15 01:08:09 +03:00
Alex c49b7613e0 fix: langchain warning 2024-08-31 12:53:37 +01:00
Alex 0cb3d12d94 Refactor loader classes to accept inputs directly 2024-02-14 15:17:56 +00:00
Pavel 381a2740ee change input 2023-10-13 21:52:56 +04:00
Pavel 719ca63ec1 fixes 2023-10-12 19:40:23 +04:00
Pavel 2cfb416fd0 Desc loader 2023-10-12 13:44:32 +04:00
Pavel 50f07f9ef5 limit crawler 2023-10-12 12:53:33 +04:00
Pavel c517bdd2e1 Crawler + sitemap 2023-10-12 12:35:26 +04:00
Pavel 658867cb46 No crawler, no sitemap 2023-10-12 01:03:40 +04:00