All issues

Search results

Limit container resources

Status: Open.

#22In fooock/robots.txt;

· fooock opened on Jul 19, 2019

Auth based in JWT

Status: Open.

#20In fooock/robots.txt;

· fooock opened on Jul 15, 2019

Rate limit for the checker API

Status: Open.

#19In fooock/robots.txt;

· fooock opened on Jul 11, 2019

Strategy to crawl robots from ftp scheme

Status: Open.

#13In fooock/robots.txt;

· fooock opened on Jul 5, 2019

Check disallow typos?

Status: Open.

#8In fooock/robots.txt;

· fooock opened on Jul 2, 2019

Use HTTP headers to control host rule expiration

Status: Open.

#5In fooock/robots.txt;

· fooock opened on Jun 30, 2019

Implement robots.txt download priority system

enhancementNew feature or requestNew feature or request

Status: Open.

#4In fooock/robots.txt;

· fooock opened on Jun 30, 2019