Monitor discovery, downloads, and document intelligence
User documentation
Practical guides for setup, safe crawling, job operations, document management, troubleshooting, and deployment.
Start the backend and frontend, confirm the connection, and run a safe first crawl.
Understand depth, page, file, retry, and pacing limits before running a job.
Control what is followed and downloaded while respecting website policies.
Organize work and safely pause, resume, stop, restart, or duplicate crawls.
Manage local files, inspect provenance, and diagnose common failures.
Configure runtime behavior and understand the local production profile.