joke.co.uk
robots.txt

Robots Exclusion Standard data for joke.co.uk

Resource Scan

Scan Details

Site Domain joke.co.uk
Base Domain joke.co.uk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-08-16T05:31:05+00:00
Next Scan 2025-10-15T05:31:05+00:00

Last Successful Scan

Scanned2025-06-17T19:58:12+00:00
URL https://joke.co.uk/robots.txt
Redirect https://www.joke.co.uk/robots.txt
Redirect Domain www.joke.co.uk
Redirect Base joke.co.uk
Domain IPs 104.18.22.153, 104.18.23.153, 2606:4700::6812:1699, 2606:4700::6812:1799
Redirect IPs 104.18.22.153, 104.18.23.153, 2606:4700::6812:1699, 2606:4700::6812:1799
Response IP 104.18.22.153
Found Yes
Hash ccdec4a5e98a1e43d4ca22315a8670d4dfe56494ef1c3c18ed69bb6c0761fb44
SimHash f6df59c8cf81

Groups

*

Rule Path
Disallow /account/
Disallow /cart/
Disallow /handlers/
Disallow /pre-order/
Disallow /services/
Disallow /barcode.ashx
Disallow /google-payments.ashx
Disallow /google-trusted-stores.ashx
Disallow /paypal-ipn.ashx
Disallow /quick-cart.aspx
Disallow /quick-view.aspx
Disallow /tracking.ashx
Disallow /verify.aspx
Disallow /verify-redirect.aspx
Disallow /*a%3D*
Disallow /*ah%3D*
Disallow /*al%3D*
Disallow /*bt%3D*
Disallow /*pa13%3D*
Disallow /*g%3D*
Disallow /*ht%3D*
Disallow /*lt%3D*
Disallow /*n%3D*
Disallow /*ph%3D*
Disallow /*pl%3D*
Disallow /*p%3D*
Disallow /*qq%3D*
Disallow /*srt%3D*
Disallow /*t%3D*
Disallow /*v%3D*

yandex

Rule Path
Disallow /

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 0.5

Other Records

Field Value
sitemap https://www.joke.co.uk/sitemap.xml