predp.com
robots.txt
Robots Exclusion Standard data for predp.com
Resource Scan
Scan Details
| Site Domain | predp.com |
| Base Domain | predp.com |
| Scan Status | Failed |
| Failure Reason | Scan timed out. |
| Last Scan | 2024-10-29T22:18:10+00:00 |
| Next Scan | 2024-11-05T22:18:10+00:00 |
Last Successful Scan
| Scanned | 2024-10-21T22:17:10+00:00 |
| URL | http://predp.com/robots.txt |
| Domain IPs | 2a00:15f8:a000:5:1:11:7:bf13, 2a00:15f8:a000:5:1:12:7:bf13, 2a00:15f8:a000:5:1:13:7:bf13, 2a00:15f8:a000:5:1:14:7:bf13, 90.156.201.113, 90.156.201.47, 90.156.201.51, 90.156.201.87 |
| Response IP | 90.156.201.87 |
| Found | Yes |
| Hash | 7a56a7df7404b568eb212f2bbe59a2ba6179423ae10d213dd4243241647520c3 |
| SimHash | 68dc5e861b61 |
Groups
googlebot
| Rule | Path |
|---|---|
| Disallow | /*.php$ |
| Disallow | /*.js$ |
| Disallow | /*.inc$ |
| Disallow | /*.css$ |
| Disallow | /*.gz$ |
| Disallow | /*.wmv$ |
| Disallow | /*.cgi$ |
| Disallow | /*.xhtml$ |
| Disallow | /*.xlsx$ |
| Disallow | /*.doc$ |
| Disallow | /*.pdf$ |
| Disallow | /*.zip$ |
*
| Rule | Path |
|---|---|
| Disallow | /category |
| Disallow | /tag |
| Disallow | /archives |
| Disallow | /cgi-bin/ |
| Disallow | /wp-admin/ |
| Disallow | /wp-includes/ |
| Disallow | /wp-content/plugins |
| Disallow | /wp-content/cache |
| Disallow | /wp-content/themes |
| Disallow | */trackback/ |
| Disallow | /feed |
| Disallow | /*/feed |
| Disallow | /comments |
| Disallow | /author |
Warnings
- `clean-param` is not a known field.