In URL list mode, the crawler fetches each URL you provide exactly once and does not discover new pages. It is equivalent to a crawl depth of zero.
It is used to check migration redirects, audit a specific set of landing pages or re-check URLs after a fix.
Sometimes you only care about a known set of pages. List mode checks them quickly without crawling the whole site.
VisibilityKit Crawler supports URL list crawls and a migration-list preset, which is the fastest way to verify a redirect map after launch.
Migrations, audits of specific landing pages and re-checking a set of fixed URLs.
It records the response of each URL, including where it redirects.
A list pairing old URLs with the new URLs they should redirect to, used during site migrations.
The number of clicks a page sits away from the start URL, usually the homepage.
Re-checking a page after a fix ships to confirm, with evidence, that the issue is actually resolved.
A page that exists on your site but has no internal links pointing to it.
A desktop SEO crawler for macOS, Windows and Linux. Find what is broken, assign the work, then verify every fix. Crawl data stays on your machine.
Get Crawler free