schurter.com
robots.txt

Robots Exclusion Standard data for schurter.com

Resource Scan

Scan Details

Site Domain schurter.com
Base Domain schurter.com
Scan Status Ok
Last Scan2024-09-25T07:59:05+00:00
Next Scan 2024-10-25T07:59:05+00:00

Last Scan

Scanned2024-09-25T07:59:05+00:00
URL https://schurter.com/robots.txt
Redirect https://www.schurter.com/robots.txt
Redirect Domain www.schurter.com
Redirect Base schurter.com
Domain IPs 54.195.160.86
Redirect IPs 13.35.238.129, 13.35.238.40, 13.35.238.6, 13.35.238.60, 2600:9000:2014:3e00:e:aeec:ef80:93a1, 2600:9000:2014:4a00:e:aeec:ef80:93a1, 2600:9000:2014:6600:e:aeec:ef80:93a1, 2600:9000:2014:7c00:e:aeec:ef80:93a1, 2600:9000:2014:8800:e:aeec:ef80:93a1, 2600:9000:2014:aa00:e:aeec:ef80:93a1, 2600:9000:2014:ae00:e:aeec:ef80:93a1, 2600:9000:2014:d600:e:aeec:ef80:93a1
Response IP 13.35.238.60
Found Yes
Hash bff4e0e056eb71e03ea2dc9d309a6963a3fccae23594985c3c13599c61891c36
SimHash 020c5153e633

Groups

googlebot
bingbot
msnbot
baiduspider
baiduspider-image
baiduspider-video
baiduspider-news
baiduspider-favo
baiduspider-sfkr
baiduspider-cpro
yandex
yahoo! slurp

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

ahrefsbot
gnowitnewsbot
blp_bbot/0.1
owlin bot v3
owlin bot
rogerbot
searchmetricsbot
mj12bot
dotbot
nutch
trendictionbot
xovibot
cliqzbot

Rule Path
Disallow /*

Other Records

Field Value
sitemap https://www.schurter.com/sitemap.xml
sitemap https://www.schurter.com/api/catalog/v1/sitemap.xml