topvoucherscode.co.uk
robots.txt

Robots Exclusion Standard data for topvoucherscode.co.uk

Resource Scan

Scan Details

Site Domain topvoucherscode.co.uk
Base Domain topvoucherscode.co.uk
Scan Status Ok
Last Scan2024-09-25T17:34:20+00:00
Next Scan 2024-10-25T17:34:20+00:00

Last Scan

Scanned2024-09-25T17:34:20+00:00
URL https://topvoucherscode.co.uk/robots.txt
Redirect https://www.topvoucherscode.co.uk/robots.txt
Redirect Domain www.topvoucherscode.co.uk
Redirect Base topvoucherscode.co.uk
Domain IPs 104.26.12.30, 104.26.13.30, 172.67.72.250, 2606:4700:20::681a:c1e, 2606:4700:20::681a:d1e, 2606:4700:20::ac43:48fa
Redirect IPs 104.26.12.30, 104.26.13.30, 172.67.72.250, 2606:4700:20::681a:c1e, 2606:4700:20::681a:d1e, 2606:4700:20::ac43:48fa
Response IP 104.26.13.30
Found Yes
Hash 5607f3ee5d04a2ca25ae3a8b8f3fe2ef93c8b1b7199e73ce124744f86a1ae0c0
SimHash d01e4650c460

Groups

*

Rule Path
Disallow /image/
Disallow /system/
Disallow /cpnew/
Disallow /blog/tag/*
Disallow /*?
Disallow /*%26
Disallow /*?generate_static_index=
Disallow /*?shopnow=
Disallow /*?copy=
Disallow /*?std=
Disallow /*?reff=
Disallow /*?iframe=
Disallow /*?embed
Disallow /*?*
Disallow /public/
Disallow /public/image/blocked/
Disallow /male/*
Disallow /female/*
Disallow /blog/category/*/*
Disallow /profile/*
Disallow /logingoogle/*
Disallow /login/*
Disallow /logoff/*
Disallow /my-favourite-brands/*
Disallow /my-saved-offers/*
Disallow /reset-password/*

applebot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

coccoc

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

slackbot

Rule Path
Disallow /
Allow /

*

No rules defined. All paths allowed.

Other Records

Field Value
sitemap https://www.topvoucherscode.co.uk/sitemap.xml