Roxy SEO: an open-source agent skill and PI extension for SEO, AEO, GEO, AI search visibility, technical audits, structured data, and content strategy.
Ruby sitemap generator for Rails apps with deterministic XML, validation, and IndexNow/Search Console pinging
A framework-agnostic reference for handling faceted navigation without wrecking crawl budget: a five-tier classifier (index / canonicalize / noindex / robots-block) driven by one facet registry, with sitemap, robots.txt, and parameter normalization.
AI Search Readiness & Web Discoverability Toolkit — Analyze how well websites are prepared for AI-powered search engines
Description: Technical SEO audit checklist and report template for crawlability, indexing, sitemap, robots.txt, PageSpeed, Core Web Vitals, schema and website health.
Inspect crawler-facing HTTP, indexability, sitemap, structured-data and migration evidence from inside WordPress.
Deterministic CI for technical SEO. Prove that sitemaps, canonicals, robots directives, redirects, internal links, hreflang, and indexability signals agree before deployment.
Google Search Console indexing checklist for crawlability, sitemap, robots.txt, canonical tags, noindex issues, redirects, 404 errors and technical SEO fixes.
Ruby sitemap crawler for Rails SEO audits with metadata, JSON-LD, uniqueness, link checks, and structured issues
Local-only robots.txt and sitemap.xml validation for AI coding agents
llms.txt validator CLI and GitHub Action for AI visibility, GEO/AEO, AI SEO, sitemap/robots alignment, and AI crawler readiness.
Google robotstxt: Reference parser/matcher robots.txt, близкий к поведению Googlebot.
Audit robots.txt and sitemap XML for crawlability, sitemap discovery, blocked important paths, broken URL limits, and SEO-safe indexing basics.
Add a description, image, and links to the crawlability topic page so that developers can more easily learn about it.
To associate your repository with the crawlability topic, visit your repo's landing page and select "manage topics."