static.knowde.com
robots.txt

Robots Exclusion Standard data for static.knowde.com

Resource Scan

Scan Details

Site Domain static.knowde.com
Base Domain knowde.com
Scan Status Ok
Last Scan2024-10-15T12:57:11+00:00
Next Scan 2024-11-14T12:57:11+00:00

Last Scan

Scanned2024-10-15T12:57:11+00:00
URL https://static.knowde.com/robots.txt
Domain IPs 13.226.2.129, 13.226.2.76, 13.226.2.78, 13.226.2.92, 2600:9000:21f8:2c00:d:7045:9140:93a1, 2600:9000:21f8:3c00:d:7045:9140:93a1, 2600:9000:21f8:4400:d:7045:9140:93a1, 2600:9000:21f8:6c00:d:7045:9140:93a1, 2600:9000:21f8:7800:d:7045:9140:93a1, 2600:9000:21f8:ca00:d:7045:9140:93a1, 2600:9000:21f8:f000:d:7045:9140:93a1, 2600:9000:21f8:fa00:d:7045:9140:93a1
Response IP 52.85.49.87
Found Yes
Hash e0184be9c762aa65f5f0e3bb2fbd379c41a3f0d312be783695048a6ffe160837
SimHash 6924d862cf31

Groups

nutch

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

r6_commentreader

Rule Path
Disallow /

r6_feedfetcher_

Rule Path
Disallow /

ocelli

Rule Path
Disallow /

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

googlebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 0

Other Records

Field Value
sitemap https://www.knowde.com/production_sitemaps/sitemap.xml