wetherspoonmenus.com
robots.txt

Robots Exclusion Standard data for wetherspoonmenus.com

Resource Scan

Scan Details

Site Domain wetherspoonmenus.com
Base Domain wetherspoonmenus.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-05-31T10:25:46+00:00
Next Scan 2025-06-14T10:25:46+00:00

Last Successful Scan

Scanned2025-05-22T10:25:01+00:00
URL https://wetherspoonmenus.com/robots.txt
Domain IPs 2a02:4780:16:dc7e:a50a:e1a4:d4fa:b7d3, 84.32.84.79
Response IP 93.127.187.0
Found Yes
Hash c6f5fae5ff1c0f3a9435a1c713f7b8a5552999edab1f476c9649e947a5f0cc8f
SimHash cb008ca222b3

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /*/feed/
Disallow /?s=
Disallow /page/*/?s=
Disallow /search/
Allow /wp-admin/admin-ajax.php
Allow /wp-content/uploads/

Other Records

Field Value
sitemap https://wetherspoonmenus.com/sitemap_index.xml