Xirui 8bc9c8bea1 feat: 1. add a crawl delay function to honor the Crawl-delay directive parsed from robots.txt during clone. (#57) ...

2. add --craw-delay flag to specify/override robots directive.

2026-06-22 16:16:54 +07:00

..

_index.md

Add the clone engine, CLI, tests, CI, and docs

2026-06-14 18:22:25 +07:00

cli.md

feat: 1. add a crawl delay function to honor the Crawl-delay directive parsed from robots.txt during clone. (#57)

2026-06-22 16:16:54 +07:00

configuration.md

Add mandatory ZIM metadata for zimcheck (#14)

2026-06-15 13:30:45 +07:00

release-notes.md

Cut the v0.3.4 release notes

2026-06-17 16:09:05 +07:00