21club.com
robots.txt

Robots Exclusion Standard data for 21club.com

Resource Scan

Scan Details

Site Domain 21club.com
Base Domain 21club.com
Scan Status Ok
Last Scan2024-10-21T16:21:00+00:00
Next Scan 2024-11-20T16:21:00+00:00

Last Scan

Scanned2024-10-21T16:21:00+00:00
URL https://21club.com/robots.txt
Redirect https://www.21club.com/robots.txt
Redirect Domain www.21club.com
Redirect Base 21club.com
Domain IPs 13.74.96.153
Redirect IPs 23.32.29.90, 23.32.29.99
Response IP 23.32.29.99
Found Yes
Hash 77f2a2c136e0154e3ae749c2c477068f13deb631901e3ece04dd6cdc2ba73d98
SimHash 0b54e9865b13

Groups

archive.org_bot

Rule Path
Disallow /

*

Rule Path
Disallow /reservations/
Disallow *?reserve=on
Disallow /search-data/
Disallow /search-worker
Disallow /search-worker-layer
Disallow *high-traffic*
Disallow /*-api/
Disallow /?format
Disallow /*?format