gamefree.la
robots.txt
Robots Exclusion Standard data for gamefree.la
Resource Scan
Scan Details
Site Domain | gamefree.la |
Base Domain | gamefree.la |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2024-03-02T23:59:53+00:00 |
Next Scan | 2024-05-31T23:59:53+00:00 |
Last Successful Scan
Scanned | 2023-10-12T08:37:06+00:00 |
URL | https://gamefree.la/robots.txt |
Redirect | http://gamefree.la/robots.txt |
Domain IPs | 104.21.65.159, 172.67.191.42, 2606:4700:3030::ac43:bf2a, 2606:4700:3037::6815:419f |
Response IP | 172.67.191.42 |
Found | Yes |
Hash | 560266c9f70e4d1d8349691716a0608aa35f98e85232fef4c10063e0c41246ba |
SimHash | 2d0ada6082f3 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /?* |
Disallow | /_zc |
Disallow | /terms |
Disallow | /privacy |
Other Records
Field | Value |
---|---|
crawl-delay | 120 |