chapelle.co.uk
robots.txt
Robots Exclusion Standard data for chapelle.co.uk
Resource Scan
Scan Details
Site Domain | chapelle.co.uk |
Base Domain | chapelle.co.uk |
Scan Status | Ok |
Last Scan | 2024-10-05T22:59:27+00:00 |
Next Scan | 2024-11-04T22:59:27+00:00 |
Last Scan
Scanned | 2024-10-05T22:59:27+00:00 |
URL | https://www.chapelle.co.uk/robots.txt |
Domain IPs | 93.184.255.133 |
Response IP | 93.184.255.133 |
Found | Yes |
Hash | 2e561d0eb85189649ad68fd69d12b7ebc07cb07af5ddf5392f775413900a92ea |
SimHash | 0a3e6410c6b2 |
Groups
*
Rule | Path |
---|---|
Disallow | /*Basket.aspx |
Disallow | /*Checkout.aspx |
Disallow | /*Login.aspx |
Disallow | /*checkout |
Disallow | /*login |
Disallow | /*basket |
Disallow | /*?*filter=* |
Disallow | /*?*donotindex=* |
Disallow | /*?*sortorder=* |
Disallow | /*?*listing_pagesize=* |
Disallow | /*?*acceptcookiesvalue=* |
Disallow | /Services/*.asmx |
ahrefsbot
sogou pic spider/3.0( http://www.sogou.com/docs/help/webmasters.htm
sogou head spider/3.0( http://www.sogou.com/docs/help/webmasters.htm
sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm
sogou orion spider/3.0( http://www.sogou.com/docs/help/webmasters.htm
sogou-test-spider/4.0 (compatible; msie 5.5; windows 98)
sogou spider
sogou pic agent
blexbot
blexbot/1.0
voltron
uptimebot
uptimerobot
mj12bot
yandexbot
appinsights
nexcess(tm) site performance bot (https://www.nexcess.net) v(1.0.0)
nexcess
megaindex.ru
megaindex
geedobot
barkrowler
ccbot
netestate ne crawler
stormcrawler
orbbot
seekport crawler
brightedge crawler
proximic
coccocbot-web
velenpublicwebcrawler
seznambot
politecrawl
ioncrawl
Rule | Path |
---|---|
Disallow | / |
Other Records
Field | Value |
---|---|
sitemap | http://www.fhinds.co.uk/sitemap_index.xml |
Warnings
- 1 invalid line.