Xirui 8bc9c8bea1 feat: 1. add a crawl delay function to honor the Crawl-delay directive parsed from robots.txt during clone. (#57) ...

2. add --craw-delay flag to specify/override robots directive.

2026-06-22 16:16:54 +07:00

..

clone.go

feat: 1. add a crawl delay function to honor the Crawl-delay directive parsed from robots.txt during clone. (#57)

2026-06-22 16:16:54 +07:00

open.go

Check the deferred Close calls so the linter is happy

2026-06-15 00:02:48 +07:00

pack.go

Add incremental packing that reuses unchanged compression (#22)

2026-06-15 19:12:16 +07:00

parquet.go

Add ZIM <-> Parquet conversion for dataset publishing (#23)

2026-06-15 19:30:42 +07:00

root.go

Add ZIM <-> Parquet conversion for dataset publishing (#23)

2026-06-15 19:30:42 +07:00

serve.go

fix: serve Ctrl-C stop

2026-06-16 23:26:52 +08:00

styles.go

Add the clone engine, CLI, tests, CI, and docs

2026-06-14 18:22:25 +07:00

version.go

Add the clone engine, CLI, tests, CI, and docs

2026-06-14 18:22:25 +07:00