domenforum.net
robots.txt
Robots Exclusion Standard data for domenforum.net
Resource Scan
Scan Details
| Site Domain | domenforum.net |
| Base Domain | domenforum.net |
| Scan Status | Ok |
| Last Scan | 2024-06-21T20:49:11+00:00 |
| Next Scan | 2024-07-21T20:49:11+00:00 |
Last Scan
| Scanned | 2024-06-21T20:49:11+00:00 |
| URL | https://domenforum.net/robots.txt |
| Domain IPs | 185.108.85.34 |
| Response IP | 185.108.85.34 |
| Found | Yes |
| Hash | fb0b5927bdd624dbcad6f0e424b91029900a36c82463c9017c33cb94c07f6e9a |
| SimHash | 295556f0d395 |
Groups
slurp
| Rule | Path |
|---|---|
| Disallow | /usercp.php |
| Disallow | /misc.php |
| Disallow | /online.php |
| Disallow | /report.php |
| Disallow | /postings.php |
| Disallow | /private.php |
| Disallow | /sendtofriend.php |
| Disallow | /register.php |
| Disallow | /newthread.php |
| Disallow | /newreply.php |
| Disallow | /editpost.php |
| Disallow | /warn.php |
| Disallow | /search.php |
| Disallow | /search_forum.php |
| Disallow | /poll.html |
| Disallow | /showthread.php?p=1383655 |
| Disallow | /showthread.php?p=1383662 |
| Disallow | /showthread.php?p=1383649 |
| Disallow | /showthread.php?p=1383657 |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
msnbot
| Rule | Path |
|---|---|
| Disallow | /usercp.php |
| Disallow | /misc.php |
| Disallow | /online.php |
| Disallow | /report.php |
| Disallow | /postings.php |
| Disallow | /private.php |
| Disallow | /sendtofriend.php |
| Disallow | /register.php |
| Disallow | /newthread.php |
| Disallow | /newreply.php |
| Disallow | /editpost.php |
| Disallow | /warn.php |
| Disallow | /search.php |
| Disallow | /search_forum.php |
| Disallow | /poll.html |
| Disallow | /showthread.php?p=1383655 |
| Disallow | /showthread.php?p=1383662 |
| Disallow | /showthread.php?p=1383649 |
| Disallow | /showthread.php?p=1383657 |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
yandex
| Rule | Path |
|---|---|
| Disallow | /usercp.php |
| Disallow | /misc.php |
| Disallow | /online.php |
| Disallow | /report.php |
| Disallow | /postings.php |
| Disallow | /private.php |
| Disallow | /sendtofriend.php |
| Disallow | /register.php |
| Disallow | /newthread.php |
| Disallow | /newreply.php |
| Disallow | /editpost.php |
| Disallow | /warn.php |
| Disallow | /search.php |
| Disallow | /search_forum.php |
| Disallow | /poll.html |
| Disallow | /showthread.php?p=1383655 |
| Disallow | /showthread.php?p=1383662 |
| Disallow | /showthread.php?p=1383649 |
| Disallow | /showthread.php?p=1383657 |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
*
| Rule | Path |
|---|---|
| Disallow | /usercp.php |
| Disallow | /misc.php |
| Disallow | /online.php |
| Disallow | /report.php |
| Disallow | /postings.php |
| Disallow | /private.php |
| Disallow | /sendtofriend.php |
| Disallow | /register.php |
| Disallow | /newthread.php |
| Disallow | /newreply.php |
| Disallow | /editpost.php |
| Disallow | /warn.php |
| Disallow | /search.php |
| Disallow | /search_forum.php |
| Disallow | /poll.html |
| Disallow | /showthread.php?p=1383655 |
| Disallow | /showthread.php?p=1383662 |
| Disallow | /showthread.php?p=1383649 |
| Disallow | /showthread.php?p=1383657 |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |