Log In Sign Up

knowde.com
robots.txt

Robots Exclusion Standard data for knowde.com

Resource Scan

Scan Details

Site Domain knowde.com
Base Domain knowde.com
Scan Status Ok
Last Scan2024-05-24T13:59:20+00:00
Next Scan 2024-06-23T13:59:20+00:00

Last Scan

Scanned2024-05-24T13:59:20+00:00
URL https://knowde.com/robots.txt
Redirect https://static.knowde.com/robots.txt
Redirect Domain static.knowde.com
Redirect Base knowde.com
Domain IPs 151.101.1.91, 151.101.129.91, 151.101.193.91, 151.101.65.91, 2600:9000:20a6:1200:13:61fd:a640:93a1, 2600:9000:20a6:2000:13:61fd:a640:93a1, 2600:9000:20a6:600:13:61fd:a640:93a1, 2600:9000:20a6:8c00:13:61fd:a640:93a1, 2600:9000:20a6:b200:13:61fd:a640:93a1, 2600:9000:20a6:ba00:13:61fd:a640:93a1, 2600:9000:20a6:dc00:13:61fd:a640:93a1, 2600:9000:20a6:ea00:13:61fd:a640:93a1
Redirect IPs 18.238.109.3, 18.238.109.37, 18.238.109.61, 18.238.109.91, 2600:9000:2778:1a00:d:7045:9140:93a1, 2600:9000:2778:2400:d:7045:9140:93a1, 2600:9000:2778:3c00:d:7045:9140:93a1, 2600:9000:2778:4600:d:7045:9140:93a1, 2600:9000:2778:4e00:d:7045:9140:93a1, 2600:9000:2778:800:d:7045:9140:93a1, 2600:9000:2778:dc00:d:7045:9140:93a1, 2600:9000:2778:fc00:d:7045:9140:93a1
Response IP 108.157.60.25
Found Yes
Hash e0184be9c762aa65f5f0e3bb2fbd379c41a3f0d312be783695048a6ffe160837
SimHash 6924d862cf31

Groups

nutch

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

r6_commentreader

Rule Path
Disallow /

r6_feedfetcher_

Rule Path
Disallow /

ocelli

Rule Path
Disallow /

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

googlebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 0
Back to top

Other Records

Field Value
sitemap https://www.knowde.com/production_sitemaps/sitemap.xml
Back to top