Posts tagged with SEO on the WebPixie Blog.https://webpixie.io/blog/en-gbhttps://webpixie.io/blog/post/audit-outbound-link-rel-attributeshttps://webpixie.io/blog/post/audit-outbound-link-rel-attributesAffiliate links need rel=sponsored, comment links need rel=ugc, and both get missed the moment they're added, not on a schedule. Here is why an outbound link audit needs to be continuous, not a one-off.Wed, 23 Sep 2026 20:04:00 GMTSEOMonitoringMatt Scotthttps://webpixie.io/blog/post/find-your-orphan-pageshttps://webpixie.io/blog/post/find-your-orphan-pagesOrphan pages have no internal links pointing to them, so search engines struggle to find them. Most guides tell you to stitch together a crawler, a sitemap, and Analytics. Here is a faster way, plus a use case most guides skip entirely.Thu, 17 Sep 2026 18:04:00 GMTSEOMonitoringMatt Scotthttps://webpixie.io/blog/post/seo-monitoring-not-one-time-audithttps://webpixie.io/blog/post/seo-monitoring-not-one-time-auditMost SEO monitoring advice means stitching together five separate tools and a dashboard yourself. The signals that actually predict a traffic drop, robots.txt, canonical, hreflang, noindex, sitemap coverage, and link health, are more useful correlated in one place than tracked apart.Tue, 18 Aug 2026 07:10:00 GMTSEOMonitoringMatt Scotthttps://webpixie.io/blog/post/sitemap-crawl-disagreehttps://webpixie.io/blog/post/sitemap-crawl-disagreeA sitemap is a snapshot of what your site looked like when it was generated. A crawl reflects your site right now. The two drift apart continuously, not just after a big migration.Tue, 28 Jul 2026 20:51:00 GMTMonitoringSEOMatt Scotthttps://webpixie.io/blog/post/broken-link-auditshttps://webpixie.io/blog/post/broken-link-auditsA weekly link crawl catches most broken links before they cost you traffic. When you find them, internal 404s on your highest-traffic pages come first, then redirect chains, then outbound links last.Sat, 25 Jul 2026 20:50:00 GMTMonitoringSEOMatt Scotthttps://webpixie.io/blog/post/is-your-website-agent-readyhttps://webpixie.io/blog/post/is-your-website-agent-readyAI agents now crawl, read, and act on websites the way search engines used to. Here is a practical, standards-graded checklist for making your site agent-ready, and what to skip for now.Wed, 15 Jul 2026 10:09:00 GMTAI CrawlersGEOSEOMatt Scotthttps://webpixie.io/blog/post/llms-txt-ai-crawler-indexabilityhttps://webpixie.io/blog/post/llms-txt-ai-crawler-indexabilityllms.txt still does almost nothing for AI search citations, and a 137,000-site study found 97% of files never get fetched. But in 2026 Google moved it into a new agentic browsing standard alongside WebMCP. Here is what changed, and when llms.txt is still worth adding.Wed, 10 Jun 2026 16:35:06 GMTAI CrawlersSEOGEOMatt Scotthttps://webpixie.io/blog/post/geo-vs-seo-content-changeshttps://webpixie.io/blog/post/geo-vs-seo-content-changesGEO is SEO with one extra job: getting cited inside AI assistant responses. The 2023 paper that coined the term tested 9 content interventions. Four worked strongly, three gave moderate gains, and two flatlined or backfired, including classic keyword stuffing.Thu, 04 Jun 2026 23:40:08 GMTSEOGEOMatt Scotthttps://webpixie.io/blog/post/block-ai-crawlershttps://webpixie.io/blog/post/block-ai-crawlersMost sites should allow AI training crawlers in 2026: invisibility in AI assistant answers now costs more than uncrawled-for-training saves. Here is the per-provider breakdown (GPTBot, ClaudeBot, Google-Extended) and the robots.txt for each realistic decision.Sun, 31 May 2026 23:40:00 GMTAI CrawlersSEOGEOMatt Scotthttps://webpixie.io/blog/post/robots-txt-vs-llms-txt-vs-sitemaphttps://webpixie.io/blog/post/robots-txt-vs-llms-txt-vs-sitemapThree small files with three different jobs. robots.txt controls who crawls, sitemap.xml maps what to crawl, and llms.txt curates what AI assistants read first. Get the mental model right with minimum-viable examples and the mistakes that confuse them.Sat, 23 May 2026 11:55:16 GMTSEOGEOAI CrawlersMatt Scott