offeroftheday.co.uk
robots.txt

Robots Exclusion Standard data for offeroftheday.co.uk

Resource Scan

Scan Details

Site Domain offeroftheday.co.uk
Base Domain offeroftheday.co.uk
Scan Status Ok
Last Scan2024-11-12T11:58:34+00:00
Next Scan 2024-11-19T11:58:34+00:00

Last Scan

Scanned2024-11-12T11:58:34+00:00
URL https://www.offeroftheday.co.uk/robots.txt
Domain IPs 188.65.36.177
Response IP 188.65.36.177
Found Yes
Hash ce58b798ad5febf6bca1e934a7ecc6c3e39a1611c411cb8964cd791e401153a2
SimHash 424e0ab8fa21

Groups

mediapartners-google

Rule Path
Allow /

ahrefsbot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

*

Rule Path
Disallow /*?order=*
Disallow /todays.xml
Disallow /redirect.asp
Disallow /error400.html
Disallow /error401.html
Disallow /error403.html
Disallow /error404.html
Disallow /error404.asp
Disallow /error410.asp
Disallow /error500.html
Disallow /model.asp
Disallow /model_ean.asp
Disallow /voucher_info.asp
Disallow /adv.asp
Disallow /report.asp
Disallow /promo.asp
Disallow /friend.asp
Disallow /no-store.asp
Disallow /category2.asp
Disallow /xmas.asp
Disallow /voucher-products.asp
Disallow /store-vouchers.asp
Disallow /sections/more.asp
Disallow /report.asp
Disallow /sections/pages.asp
Disallow /sections/show_cats.asp
Disallow /sections/fast_register.asp
Disallow /product.asp
Disallow /functions/
Disallow /help/

Other Records

Field Value
sitemap https://www.offeroftheday.co.uk/sitemap.xml