mediamole.co.uk
robots.txt

Robots Exclusion Standard data for mediamole.co.uk

Resource Scan

Scan Details

Site Domain mediamole.co.uk
Base Domain mediamole.co.uk
Scan Status Ok
Last Scan2024-06-21T10:56:25+00:00
Next Scan 2024-06-28T10:56:25+00:00

Last Scan

Scanned2024-06-21T10:56:25+00:00
URL https://www.mediamole.co.uk/robots.txt
Redirect https://www.sportsmole.co.uk/robots.txt
Redirect Domain www.sportsmole.co.uk
Redirect Base sportsmole.co.uk
Domain IPs 108.156.133.118, 108.156.133.119, 108.156.133.120, 108.156.133.2
Redirect IPs 13.225.4.14, 13.225.4.21, 13.225.4.25, 13.225.4.91
Response IP 13.225.4.14
Found Yes
Hash ab07da1ce6c8b58df5a8b35e41f235b79e49dfad84f3fb97759ec6a1cbacd493
SimHash edfeceefea92

Groups

*

Rule Path
Disallow *.amp_latest_update_time
Disallow /fwd/*
Disallow /go/*
Disallow /esi/*
Disallow /sw3/
Disallow /search/
Disallow /preview/preview-index/
Disallow *_photo_*.html

Other Records

Field Value
sitemap https://www.sportsmole.co.uk/sitemap_index.xml