forum.adultdvdtalk.com
robots.txt
Robots Exclusion Standard data for forum.adultdvdtalk.com
Resource Scan
Scan Details
| Site Domain | forum.adultdvdtalk.com |
| Base Domain | adultdvdtalk.com |
| Scan Status | Ok |
| Last Scan | 2024-11-11T15:06:37+00:00 |
| Next Scan | 2024-11-25T15:06:37+00:00 |
Last Scan
| Scanned | 2024-11-11T15:06:37+00:00 |
| URL | https://forum.adultdvdtalk.com/robots.txt |
| Domain IPs | 104.22.62.96, 104.22.63.96, 172.67.5.2, 2606:4700:10::6816:3e60, 2606:4700:10::6816:3f60, 2606:4700:10::ac43:502 |
| Response IP | 172.67.5.2 |
| Found | Yes |
| Hash | c45a61d989332e1f4a3ede9c364eec2efa0543e79353e28acc3027cb17a5d50c |
| SimHash | 181cd5720701 |
Groups
googlebot
| Rule | Path |
|---|---|
| Disallow | /enter.asp* |
| Disallow | /enter_terms.asp |
| Disallow | /conversation* |
| Disallow | /*?$ |
| Disallow | /click.asp* |
| Disallow | /forum/search.asp*sid%3D* |
| Disallow | /forum/pop_* |
| Disallow | /forum/post.asp* |
| Disallow | /*/1$ |
slurp
| Rule | Path |
|---|---|
| Disallow | /enter.asp* |
| Disallow | /conversation* |
| Disallow | /enter_terms.asp |
| Disallow | /*?$ |
| Disallow | /click.asp* |
| Disallow | /forum/search.asp*sid%3D* |
| Allow | /forum/search.asp* |
| Allow | /forum/topic.asp?* |
| Allow | /forum/forum.asp?* |
| Disallow | /forum/*?* |
| Disallow | /forum/pop_* |
| Disallow | /forum/post.asp* |
| Disallow | /*/reply/* |
msnbot
| Rule | Path |
|---|---|
| Disallow | /enter.asp* |
| Disallow | /conversation* |
| Disallow | /enter_terms.asp |
| Disallow | /*?$ |
| Disallow | /click.asp* |
| Disallow | /forum/search.asp*sid%3D* |
| Allow | /forum/search.asp* |
| Allow | /forum/topic.asp?* |
| Allow | /forum/forum.asp?* |
| Disallow | /forum/*?* |
| Disallow | /forum/pop_* |
| Disallow | /forum/post.asp* |
| Disallow | /*/reply/* |
bingbot
| Rule | Path |
|---|---|
| Disallow | /enter.asp* |
| Disallow | /conversation* |
| Disallow | /enter_terms.asp |
| Disallow | /*?$ |
| Disallow | /click.asp* |
| Disallow | /forum/search.asp*sid%3D* |
| Allow | /forum/search.asp* |
| Allow | /forum/topic.asp?* |
| Allow | /forum/forum.asp?* |
| Disallow | /forum/*?* |
| Disallow | /forum/pop_* |
| Disallow | /forum/post.asp* |
| Disallow | /*/reply/* |
*
| Rule | Path |
|---|---|
| Disallow | /enter.asp |
| Disallow | /conversation/ |
| Disallow | /conversations |
| Disallow | /enter_terms.asp |
| Disallow | /click.asp |
| Disallow | /forum/post.asp |