phoneweek.co.uk
robots.txt

Robots Exclusion Standard data for phoneweek.co.uk

Resource Scan

Scan Details

Site Domain phoneweek.co.uk
Base Domain phoneweek.co.uk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-09-16T19:14:21+00:00
Next Scan 2025-12-15T19:14:21+00:00

Last Successful Scan

Scanned2024-11-21T18:09:34+00:00
URL https://phoneweek.co.uk/robots.txt
Domain IPs 2a02:2350:5:111:1:29b9:62ef:3fd3, 46.30.215.64
Response IP 46.30.215.64
Found Yes
Hash 92ded540b1243e5fab7d3f1ed384558283547738a22ffd223ddadee4121dee6a
SimHash 4614ddf2c711

Groups

*

Rule Path
Disallow

*

Rule Path
Allow /

googlebot

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

bingbot

Rule Path
Allow /

slurp

Rule Path
Allow /

*

Rule Path
Allow /ads.txt

yandex

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

org_bot

Rule Path
Disallow /

accompanybot

Rule Path
Disallow /

tweetmemebot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.phoneweek.co.uk/sitemap.xml