improvement(seo): restore explicit AI/search bot allow-list and add link-preview rules - #4480

Merged

waleedlatif1 merged 6 commits into

waleedlatif1/sofia-v3

May 6, 2026

Commits on May 6, 2026

improvement(seo): restore explicit AI/search bot allow-list and add link-preview rules
waleedlatif1
committed
a40dc53
fix(seo): correct xAI UA strings, drop Bravebot, block /playground/ and /w/ from link-preview bots
waleedlatif1
committed
2c78835
fix(seo): drop unverified Grok UAs, correct DeepSeekBot and ImagesiftBot tokens
waleedlatif1
committed
ec7e5a7
fix(seo): re-add Bravebot to allow-list per Brave Search docs
waleedlatif1
committed
8a615f3
improvement(seo): drop redundant named AI/search bot allow-list
waleedlatif1
committed
5510485
chore(seo): trim verbose comments in robots.ts
waleedlatif1
committed
b9a1f58