fhinds.co.uk
robots.txt
Robots Exclusion Standard data for fhinds.co.uk
Resource Scan
Scan Details
| Site Domain | fhinds.co.uk |
| Base Domain | fhinds.co.uk |
| Scan Status | Ok |
| Last Scan | 2024-07-01T10:12:39+00:00 |
| Next Scan | 2024-07-31T10:12:39+00:00 |
Last Scan
| Scanned | 2024-07-01T10:12:39+00:00 |
| URL | https://fhinds.co.uk/robots.txt |
| Redirect | https://www.fhinds.co.uk/robots.txt |
| Redirect Domain | www.fhinds.co.uk |
| Redirect Base | fhinds.co.uk |
| Domain IPs | 93.184.250.124 |
| Redirect IPs | 93.184.250.124 |
| Response IP | 93.184.250.124 |
| Found | Yes |
| Hash | 2e561d0eb85189649ad68fd69d12b7ebc07cb07af5ddf5392f775413900a92ea |
| SimHash | 0a3e6410c6b2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*Basket.aspx |
| Disallow | /*Checkout.aspx |
| Disallow | /*Login.aspx |
| Disallow | /*checkout |
| Disallow | /*login |
| Disallow | /*basket |
| Disallow | /*?*filter=* |
| Disallow | /*?*donotindex=* |
| Disallow | /*?*sortorder=* |
| Disallow | /*?*listing_pagesize=* |
| Disallow | /*?*acceptcookiesvalue=* |
| Disallow | /Services/*.asmx |
ahrefsbot
sogou pic spider/3.0( http://www.sogou.com/docs/help/webmasters.htm
sogou head spider/3.0( http://www.sogou.com/docs/help/webmasters.htm
sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm
sogou orion spider/3.0( http://www.sogou.com/docs/help/webmasters.htm
sogou-test-spider/4.0 (compatible; msie 5.5; windows 98)
sogou spider
sogou pic agent
blexbot
blexbot/1.0
voltron
uptimebot
uptimerobot
mj12bot
yandexbot
appinsights
nexcess(tm) site performance bot (https://www.nexcess.net) v(1.0.0)
nexcess
megaindex.ru
megaindex
geedobot
barkrowler
ccbot
netestate ne crawler
stormcrawler
orbbot
seekport crawler
brightedge crawler
proximic
coccocbot-web
velenpublicwebcrawler
seznambot
politecrawl
ioncrawl
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.fhinds.co.uk/sitemap_index.xml |
Warnings
- 1 invalid line.