st-babylon.ru
robots.txt
Robots Exclusion Standard data for st-babylon.ru
Resource Scan
Scan Details
Site Domain | st-babylon.ru |
Base Domain | st-babylon.ru |
Scan Status | Ok |
Last Scan | 2024-10-05T13:34:41+00:00 |
Next Scan | 2024-11-04T13:34:41+00:00 |
Last Scan
Scanned | 2024-10-05T13:34:41+00:00 |
URL | http://st-babylon.ru/robots.txt |
Domain IPs | 2a00:15f8:a000:5:1:11:7:bf13, 2a00:15f8:a000:5:1:12:7:bf13, 2a00:15f8:a000:5:1:13:7:bf13, 2a00:15f8:a000:5:1:14:7:bf13, 90.156.201.113, 90.156.201.47, 90.156.201.51, 90.156.201.87 |
Response IP | 90.156.201.113 |
Found | Yes |
Hash | 49fb72badf6f55abc896980c2e2233899b293cf69ccc9ec58744e64e3e689ac9 |
SimHash | 69485e831b61 |
Groups
googlebot
Rule | Path |
---|---|
Disallow | /*.php$ |
Disallow | /*.js$ |
Disallow | /*.inc$ |
Disallow | /*.css$ |
Disallow | /*.gz$ |
Disallow | /*.wmv$ |
Disallow | /*.cgi$ |
Disallow | /*.xhtml$ |
Disallow | /*.xlsx$ |
Disallow | /*.doc$ |
Disallow | /*.pdf$ |
Disallow | /*.zip$ |
*
Rule | Path |
---|---|
Disallow | /category |
Disallow | /tag |
Disallow | /archives |
Disallow | /cgi-bin/ |
Disallow | /wp-admin/ |
Disallow | /wp-includes/ |
Disallow | /wp-content/plugins |
Disallow | /wp-content/cache |
Disallow | /wp-content/themes |
Disallow | */trackback/ |
Disallow | /feed |
Disallow | /*/feed |
Disallow | /comments |
Disallow | /author |
Allow | /wp-content/upload |
Warnings
- `clean-param` is not a known field.