supergeekforum.org
robots.txt
Robots Exclusion Standard data for supergeekforum.org
Resource Scan
Scan Details
| Site Domain | supergeekforum.org |
| Base Domain | supergeekforum.org |
| Scan Status | Ok |
| Last Scan | 2024-10-02T00:41:49+00:00 |
| Next Scan | 2024-10-09T00:41:49+00:00 |
Last Scan
| Scanned | 2024-10-02T00:41:49+00:00 |
| URL | http://supergeekforum.org/robots.txt |
| Domain IPs | 103.115.127.14 |
| Response IP | 103.115.127.14 |
| Found | Yes |
| Hash | 55f3675d63d7ad6b953638488a215aabaad0e06f2da50ca4635f8a8585a60b09 |
| SimHash | e03149fad680 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Disallow | /downloads/ |
| Disallow | /wp-admin/ |
*
| Rule | Path |
|---|---|
| Disallow | /search?* |
| Disallow | */page/* |
| Disallow | */pages/* |
| Disallow | */comments* |
| Disallow | */comments/feed |
| Disallow | */*/feed |
| Disallow | /xmlrpc.php |
| Disallow | /trackback/ |
| Disallow | */*.php* |
| Disallow | /400 |
| Disallow | /401 |
| Disallow | /403 |
| Disallow | /404 |
| Disallow | /500 |