static.knowde.com
robots.txt

Robots Exclusion Standard data for static.knowde.com

Resource Scan

Scan Details

Site Domain static.knowde.com
Base Domain knowde.com
Scan Status Ok
Last Scan2024-05-18T12:56:00+00:00
Next Scan 2024-06-17T12:56:00+00:00

Last Scan

Scanned2024-05-18T12:56:00+00:00
URL https://static.knowde.com/robots.txt
Domain IPs 13.226.2.129, 13.226.2.76, 13.226.2.78, 13.226.2.92, 2600:9000:249b:1400:d:7045:9140:93a1, 2600:9000:249b:5800:d:7045:9140:93a1, 2600:9000:249b:7a00:d:7045:9140:93a1, 2600:9000:249b:7e00:d:7045:9140:93a1, 2600:9000:249b:c00:d:7045:9140:93a1, 2600:9000:249b:c400:d:7045:9140:93a1, 2600:9000:249b:dc00:d:7045:9140:93a1, 2600:9000:249b:f400:d:7045:9140:93a1
Response IP 108.157.60.60
Found Yes
Hash e0184be9c762aa65f5f0e3bb2fbd379c41a3f0d312be783695048a6ffe160837
SimHash 6924d862cf31

Groups

nutch

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

r6_commentreader

Rule Path
Disallow /

r6_feedfetcher_

Rule Path
Disallow /

ocelli

Rule Path
Disallow /

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

googlebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 0

Other Records

Field Value
sitemap https://www.knowde.com/production_sitemaps/sitemap.xml