offgamers.com
robots.txt
Robots Exclusion Standard data for offgamers.com
Resource Scan
Scan Details
Site Domain | offgamers.com |
Base Domain | offgamers.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-05-18T09:49:38+00:00 |
Next Scan | 2024-08-16T09:49:38+00:00 |
Last Successful Scan
Scanned | 2023-07-15T20:44:52+00:00 |
URL | https://offgamers.com/robots.txt |
Redirect | https://www.offgamers.com:443/robots.txt |
Redirect Domain | www.offgamers.com |
Redirect Base | offgamers.com |
Domain IPs | 13.33.88.119, 13.33.88.129, 13.33.88.77, 13.33.88.90 |
Redirect IPs | 23.59.168.121, 23.59.168.130, 2600:1413:1::1734:ab3b, 2600:1413:1::1734:abd1 |
Response IP | 23.59.168.121 |
Found | Yes |
Hash | 82279165e8a99a70c2be747936f813603a1c8f04d7d886d5c68ed1b7155c5f65 |
SimHash | 679f737347c0 |
Groups
googlebot
Rule | Path |
---|---|
Disallow | /*/with_friends |
Disallow | /buyback.php |
Disallow | /*? |
Allow | *search/index.htm?keyword=Itunes$ |
Allow | *search/index.htm?keyword=Google%2BPlay$ |
Allow | *search/index.htm?keyword=PSN$ |
Allow | *search/index.htm?keyword=Karma%2BKoin$ |
Allow | *search/index.htm?keyword=Steam$ |
slurp
Rule | Path |
---|---|
Disallow | /*? |
Disallow | /*/with_friends |
Disallow | /buyback.php |
Allow | *search/index.htm?keyword=Itunes$ |
Allow | *search/index.htm?keyword=Google%2BPlay$ |
Allow | *search/index.htm?keyword=PSN$ |
Allow | *search/index.htm?keyword=Karma%2BKoin$ |
Allow | *search/index.htm?keyword=Steam$ |
Other Records
Field | Value |
---|---|
crawl-delay | 1 |
msnbot
Rule | Path |
---|---|
Disallow | /*? |
Disallow | /*/with_friends |
Disallow | /buyback.php |
Allow | *search/index.htm?keyword=Itunes$ |
Allow | *search/index.htm?keyword=Google%2BPlay$ |
Allow | *search/index.htm?keyword=PSN$ |
Allow | *search/index.htm?keyword=Karma%2BKoin$ |
Allow | *search/index.htm?keyword=Steam$ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Comments