ruskniga.com
robots.txt
Robots Exclusion Standard data for ruskniga.com
Resource Scan
Scan Details
Site Domain | ruskniga.com |
Base Domain | ruskniga.com |
Scan Status | Ok |
Last Scan | 2024-10-07T11:16:36+00:00 |
Next Scan | 2024-11-06T11:16:36+00:00 |
Last Scan
Scanned | 2024-10-07T11:16:36+00:00 |
URL | https://ruskniga.com/robots.txt |
Domain IPs | 104.21.37.243, 172.67.216.108, 2606:4700:3030::6815:25f3, 2606:4700:3033::ac43:d86c |
Response IP | 104.21.37.243 |
Found | Yes |
Hash | 99dd301bb8548227dac5fb2ce1cc05eb639f9b8efda4d5023fe67b6d3bcdf5dc |
SimHash | 8544cb144633 |
Groups
*
Rule | Path |
---|---|
Disallow | *utm |
Disallow | *openstat |
Disallow | *home |
Disallow | *?p=1$ |
Disallow | /catalogsearch/ |
Disallow | /var/* |
Disallow | *review/product* |
Allow | *?p= |
trovitbot
Rule | Path |
---|---|
Disallow | / |
Disallow | /CVS |
Disallow | /*.svn$ |
Disallow | /*.idea$ |
Disallow | /*.sql$ |
Disallow | /*.tgz$ |
Disallow | /admin/ |
Disallow | /app/ |
Disallow | /downloader/ |
Disallow | /errors/ |
Disallow | /includes/ |
Disallow | /lib/ |
Disallow | /pkginfo/ |
Disallow | /shell/ |
Disallow | /api.php |
Disallow | /cron.php |
Disallow | /cron.sh |
Disallow | /error_log |
Disallow | /get.php |
Disallow | /install.php |
Disallow | /LICENSE.html |
Disallow | /LICENSE.txt |
Disallow | /LICENSE_AFL.txt |
Disallow | /README.txt |
Disallow | /RELEASE_NOTES.txt |
Disallow | /cgi-bin/ |
Disallow | /cleanup.php |
Disallow | /apc.php |
Disallow | /memcache.php |
Disallow | /phpinfo.php |
Other Records
Field | Value |
---|---|
sitemap | https://www.ruskniga.com/sitemap.xml |
Comments