ohmymag.co.uk
robots.txt

Robots Exclusion Standard data for ohmymag.co.uk

Resource Scan

Scan Details

Site Domain ohmymag.co.uk
Base Domain ohmymag.co.uk
Scan Status Ok
Last Scan2024-09-19T01:41:09+00:00
Next Scan 2024-09-26T01:41:09+00:00

Last Scan

Scanned2024-09-19T01:41:09+00:00
URL https://ohmymag.co.uk/robots.txt
Redirect https://www.ohmymag.co.uk/robots.txt
Redirect Domain www.ohmymag.co.uk
Redirect Base ohmymag.co.uk
Domain IPs 185.68.151.20
Redirect IPs 185.68.151.20, 185.68.151.21
Response IP 185.68.151.21
Found Yes
Hash 808da2cb6935a50d4af5203417e56dd3d1b0d980919ad68eb2835bf4a8d516c1
SimHash 01104a30d583

Groups

*

Rule Path
Disallow /xhr/*
Disallow /partial/*
Disallow /landing
Disallow /offline
Disallow /passerelle_ta.php
Disallow *_pic*.html

mediapartners-google

Rule Path
Disallow

ia_archiver

Rule Path
Disallow /

spiderbot

Rule Path
Disallow /

spiderbot/nutch-1.7

Rule Path
Disallow /

*
googlebot-news

No rules defined. All paths allowed.

Other Records

Field Value
sitemap https://www.ohmymag.co.uk/sitemaps/sitemap.xml
sitemap https://www.ohmymag.co.uk/sitemaps/google_0.xml
sitemap https://www.ohmymag.co.uk/sitemaps/google_0.xml