Log In Sign Up

msschippers.co.uk
robots.txt

Robots Exclusion Standard data for msschippers.co.uk

Resource Scan

Scan Details

Site Domain msschippers.co.uk
Base Domain msschippers.co.uk
Scan Status Ok
Last Scan2024-11-16T05:40:13+00:00
Next Scan 2024-11-30T05:40:13+00:00

Last Scan

Scanned2024-11-16T05:40:13+00:00
URL https://msschippers.co.uk/robots.txt
Redirect https://www.msschippers.co.uk/robots.txt
Redirect Domain www.msschippers.co.uk
Redirect Base msschippers.co.uk
Domain IPs 104.21.56.112, 172.67.184.168, 2606:4700:3031::6815:3870, 2606:4700:3033::ac43:b8a8
Redirect IPs 13.226.2.104, 13.226.2.129, 13.226.2.56, 13.226.2.82, 2600:9000:269a:3600:f:782b:bc80:93a1, 2600:9000:269a:4600:f:782b:bc80:93a1, 2600:9000:269a:6000:f:782b:bc80:93a1, 2600:9000:269a:7400:f:782b:bc80:93a1, 2600:9000:269a:7a00:f:782b:bc80:93a1, 2600:9000:269a:8000:f:782b:bc80:93a1, 2600:9000:269a:a200:f:782b:bc80:93a1, 2600:9000:269a:c600:f:782b:bc80:93a1
Response IP 3.164.68.49
Found Yes
Hash 3301ead868b5dbaf6c287c82d154bd0e35909aa1af48c4629abe2914a7468ca0
SimHash 69047951a3c3

Groups

*

Rule Path
Disallow /*ViewUser-LoginPage?Product=*
Disallow /*systempage.account.overview*
Disallow /my-schippers*
Disallow /basket*
Disallow /register*
Disallow /--co00055
Disallow /storyblok-preview

*
*

Rule Path
Disallow /

bingbot

Rule Path
Allow /

googlebot

Rule Path
Allow /

sebot-wa

Rule Path
Allow /

gptbot

Rule Path
Allow /

chatgpt-user

Rule Path
Allow /

oai-searchbot

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://www.msschippers.co.uk/sitemap.xml
Back to top

Comments

  • Robots.txt
Back to top

Warnings

  • `noindex` is not a known field.
Back to top