Broken link checker for discovered pages on your site

Yes, WebPixie checks for broken internal links with the Link Crawler. The Link Crawler starts from your homepage, follows discovered public internal links up to your plan limit, and records per-link health data such as HTTP status code, response time, content size, page title, favicon, redirect status, and timeout behavior. This helps identify 4xx errors, 5xx errors, missing pages, slow destinations, and redirect responses that can affect user experience or search visibility. The crawler also discovers the outbound links on each page and extracts their rel values (nofollow, sponsored, ugc), anchor text, and occurrence count, so you can review your external link profile, though outbound links are listed for review rather than health-checked. Canonical URLs, hreflang tags, and other meta data are recorded for the internal links WebPixie crawls. Re-crawls run on a schedule, typically about once a week, and crawl limits depend on your plan. You can compare limits on the pricing page, then pair results with the Indexability Checker for broader crawlability review.

The Link Crawler re-scans discovered links on a schedule, typically about once a week, with a minimum of 24 hours between runs. WebPixie starts by discovering links from your homepage, then schedules automatic re-crawls across the sites in your workspace. Crawl limits per site depend on your plan, and the current limits are listed on the pricing page. During each Link Crawler scan, WebPixie health-checks each internal link it crawls, recording status code, response time, content size, page title, favicon, rel attributes, canonical URLs, hreflang tags, and related meta data. Outbound links are listed for review rather than health-checked, but still carry their rel attributes, anchor text, and occurrence count. This helps you catch broken internal links, slow pages, redirect responses, and link-level issues, and review the outbound links each page points to. For broader crawlability and indexing signals, pair crawler results with the Indexability Checker.

The Link Crawler discovers and lists the external links your pages point to, but it does not health-check them. On every crawl run it follows and health-checks the internal links between pages on your monitored domain, recording status code, redirect outcome, and response time for each. For outbound links to other domains, it records the anchor text, how often each appears, and the rel attributes such as nofollow, sponsored, and ugc, so you can audit your external link profile without WebPixie testing those third-party destinations. This keeps the crawl focused on the pages you control while still giving you a full map of where your site points out. Pair it with the Indexability Checker for broader crawlability signals, and compare crawl limits on the pricing page.

Yes. The Link Crawler supports a reverse lookup: give it any URL and it returns which of your crawled pages link to that URL. Point it at one of your own pages to see that page's internal inbound links, which helps you understand your internal link structure and how link equity flows toward your most important pages. Point it at an external URL to find every page on your site that links out to that destination, which is useful when you need to update or remove a specific outbound link across your site. Each result carries the same per-link detail as the rest of the crawl, such as anchor text and the page's own status. This works from the links discovered during the normal homepage-based crawl, up to your plan limit. For broader crawlability signals, pair it with the Indexability Checker, and compare crawl limits on the pricing page.

No. The Link Crawler follows only publicly accessible links, starting from your homepage, so it does not log in or send credentials, and pages that require authentication are not crawled. If you need to check a private URL, uptime monitoring supports authentication, custom headers, and expected status codes, though it checks one endpoint at a time rather than crawling a whole site. You can review per-plan crawl limits on the pricing page.

No. The Link Crawler does not skip links that robots.txt would disallow, because it has to fetch each linked page to confirm the link works and to read the sublinks on it. Honoring robots.txt mid-crawl would leave gaps in your link health report, so the crawler checks discovered links up to your plan limit and labels robots-disallowed URLs for review. Whether a URL is eligible for search engines or AI crawlers is a separate question that belongs to indexability rather than link health. This keeps link health and crawl eligibility as two distinct signals. For the search-eligibility side, pair it with the Indexability Checker, and review per-plan crawl limits on the pricing page.