snowandrock.com
robots.txt

Robots Exclusion Standard data for snowandrock.com

Resource Scan

Scan Details

Site Domain snowandrock.com
Base Domain snowandrock.com
Scan Status Ok
Last Scan2024-05-07T23:02:17+00:00
Next Scan 2024-06-06T23:02:17+00:00

Last Scan

Scanned2024-05-07T23:02:17+00:00
URL https://snowandrock.com/robots.txt
Redirect https://www.snowandrock.com/robots.txt
Redirect Domain www.snowandrock.com
Redirect Base snowandrock.com
Domain IPs 18.154.144.111, 18.154.144.36, 18.154.144.40, 18.154.144.72
Redirect IPs 2600:9000:21f8:0:10:7d94:fd00:93a1, 2600:9000:21f8:1400:10:7d94:fd00:93a1, 2600:9000:21f8:2c00:10:7d94:fd00:93a1, 2600:9000:21f8:6e00:10:7d94:fd00:93a1, 2600:9000:21f8:c000:10:7d94:fd00:93a1, 2600:9000:21f8:dc00:10:7d94:fd00:93a1, 2600:9000:21f8:f600:10:7d94:fd00:93a1, 2600:9000:21f8:fe00:10:7d94:fd00:93a1, 99.84.203.103, 99.84.203.105, 99.84.203.129, 99.84.203.19
Response IP 18.165.171.46
Found Yes
Hash ed0debe32e58427dc30535d241dd5388fb5f745d0d3f9d3bd04803d80b97c8f8
SimHash 2a0cc2328fb3

Groups

*

Rule Path
Disallow /api*
Allow /api/aem/search*
Disallow /checkout*
Disallow /account*
Disallow /lister.html*
Disallow /cache/productmanual*
Disallow /content/platform-blueprints/*
Disallow /demo-pages*
Disallow /clearance/*
Disallow /errors.html
Disallow /test/*
Disallow /hosted-tokenisation.html
Disallow /fredhopper-glossary.html
Disallow /newsletter-confirmation.html
Disallow c/fillers*
Disallow /about-us/jeroen-about.html
Disallow /jeroen-flush*
Disallow /lister/no-results.html
Disallow /temporarily-unavailable.html
Disallow /Templates.html
Disallow /errors.html
Disallow /includes*
Disallow /review*
Disallow /content/experience-fragments/*
Disallow /content/dam/content-fragments/*

baiduspider

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

companybook

Rule Path
Disallow /

companybook crawler

Rule Path
Disallow /

companybook-crawler

Rule Path
Disallow /

companybook crawler (+https://www.companybooknetworking.com/)

Rule Path
Disallow /

companybook-crawler (+https://www.companybooknetworking.com/)

Rule Path
Disallow /

yandex

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.snowandrock.com/sitemap/index.xml