Skip to content

Exclude /dart/ from crawling - #475

Merged
armiol merged 3 commits into
masterfrom
exclude-dart-docs-from-crawling
Mar 18, 2024
Merged

Exclude /dart/ from crawling#475
armiol merged 3 commits into
masterfrom
exclude-dart-docs-from-crawling

Conversation

@armiol

Copy link
Copy Markdown
Contributor

Previously, there were several thousand 404 responses detected by Google Search Console review process, the majority of which were related to the generated documentation for Spine Dart client.

Attempts to address the problem, or at least, locate its roots failed. Seems like some previously crawled pages are still in Google Search cache, but now (as of 1.9.0 release) they are missing.

Therefore, within this PR, the whole /dart/ subtree is excluded from crawling altogether. Hopefully, it will enforce the cache cleanup.

In some future, we may re-enable the crawling for this part of the site. Most likely, it will make sense to do together with 2.0.0 release.

@armiol

Copy link
Copy Markdown
ContributorAuthor

@alexander-yevsyukov PTAL.

@armiol

Copy link
Copy Markdown
ContributorAuthor

See #476 for the issue on re-enabling.

@alexander-yevsyukovalexander-yevsyukov left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@armiol
armiol merged commit f96154b into masterMar 18, 2024
@armiol
armiol deleted the exclude-dart-docs-from-crawling branch March 18, 2024 19:27
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@armiol@alexander-yevsyukov