rostabletka.com
robots.txt
Robots Exclusion Standard data for rostabletka.com
Resource Scan
Scan Details
Site Domain | rostabletka.com |
Base Domain | rostabletka.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2025-01-26T07:07:29+00:00 |
Next Scan | 2025-04-26T07:07:29+00:00 |
Last Successful Scan
Scanned | 2023-03-16T05:05:17+00:00 |
URL | https://rostabletka.com/robots.txt |
Redirect | https://rostabletka5.ru/robots.txt |
Redirect Domain | rostabletka5.ru |
Redirect Base | rostabletka5.ru |
Domain IPs | 104.21.18.14, 172.67.179.42, 2606:4700:3032::6815:120e, 2606:4700:3037::ac43:b32a |
Redirect IPs | 104.21.25.171, 172.67.134.105, 2606:4700:3030::ac43:8669, 2606:4700:3036::6815:19ab |
Response IP | 104.21.25.171 |
Found | Yes |
Hash | 1caaf4d66830d53976b729bac4f832965ad3f016024b73640a27153c0392acd3 |
SimHash | bb0368826715 |
Groups
*
Rule | Path |
---|---|
Disallow | /admin/ |
Disallow | /cache/ |
Disallow | /class/ |
Disallow | /config/ |
Disallow | /cron/ |
Disallow | /list/ |
Disallow | /data/ |
Disallow | /functions/ |
Disallow | /templates/ |
Disallow | /ajax/ |
Disallow | /scripts/ |
Disallow | /cart/ |
Disallow | /order/ |
Disallow | /forum/user*.html |
Disallow | /forum/admin/ |
Disallow | /forum/cache/ |
Disallow | /forum/post*.html |
Disallow | /forum/*new-posts.html |
Disallow | /forum/*last-post.html |
Disallow | /forum/feed-*.xml |
Disallow | /forum/search.php |
Disallow | /forum/register.html |
Disallow | /forum/login.html |
Disallow | /forum/help-bbcode.html |
Disallow | /forum/search* |