liiga.me
robots.txt

Robots Exclusion Standard data for liiga.me

Resource Scan

Scan Details

Site Domain liiga.me
Base Domain liiga.me
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-11-10T03:21:07+00:00
Next Scan 2025-11-24T03:21:07+00:00

Last Successful Scan

Scanned2024-06-30T17:52:16+00:00
URL https://liiga.me/robots.txt
Domain IPs 52.192.18.80, 54.150.82.219, 57.180.176.194
Response IP 13.114.64.177
Found Yes
Hash 7b281b70a5f8327f1c2eec11b7bed10c217c13541c570d28cedf204f0fd27dac
SimHash b28c8c8f7170

Groups

*

Rule Path
Disallow /agents/174

mj12bot

Rule Path
Disallow /

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines: