keys.so
robots.txt
Robots Exclusion Standard data for keys.so
Resource Scan
Scan Details
Site Domain | keys.so |
Base Domain | keys.so |
Scan Status | Ok |
Last Scan | 2024-09-24T22:35:12+00:00 |
Next Scan | 2024-10-24T22:35:12+00:00 |
Last Scan
Scanned | 2024-09-24T22:35:12+00:00 |
URL | https://keys.so/robots.txt |
Redirect | https://www.keys.so/robots.txt |
Redirect Domain | www.keys.so |
Redirect Base | keys.so |
Domain IPs | 104.26.12.125, 104.26.13.125, 172.67.72.161, 2606:4700:20::681a:c7d, 2606:4700:20::681a:d7d, 2606:4700:20::ac43:48a1 |
Redirect IPs | 104.26.12.125, 104.26.13.125, 172.67.72.161, 2606:4700:20::681a:c7d, 2606:4700:20::681a:d7d, 2606:4700:20::ac43:48a1 |
Response IP | 104.26.12.125 |
Found | Yes |
Hash | 35be8ff639eedfe977b2a1dd2cdd26f5f7721a272912fe8744d6d6e04b32bd40 |
SimHash | b5894cb68db3 |
Groups
*
Rule | Path |
---|---|
Disallow | /ru/too-many-requests |
Disallow | /ru/only-region-db |
Disallow | /ru/*?* |
Disallow | /ru*?* |
Disallow | /ru/tools/concurents-by-keywords/ |
Disallow | /ru/tools/dictionary-by-pages? |
Disallow | /ru/tools/dictionary-ext-by-page/ |
Disallow | /ru/tools/domains-batch? |
Disallow | /ru/tools/keywords-by-list/ |
Disallow | /ru/tools/keywords-by-pages? |
Disallow | /ru/billresult |
Disallow | /ru/clustering/ |
Disallow | /ru/report? |
Disallow | /ru/forgotpassword |
Disallow | /ru/keywords |
Disallow | /ru/adreport |
Disallow | /ru/adcompany |
Disallow | /ru/sitepages |
Disallow | /ru/concurents |
Disallow | /ru/concurentpages |
Disallow | /ru/owner |
Disallow | /ru/keysbypage |
Disallow | /ru/group |
Disallow | /ru/compare |
Disallow | /ru/ads |
Disallow | /ru/adconcurents |
Disallow | /ru/adkeys |
Disallow | /ru/adcompany |
Disallow | /ru/adkeysbyads |
Disallow | /ru/changedb |
Disallow | /ru/topvis |
Disallow | /ru/topkeys |
Disallow | /ru/similarkeys |
Disallow | /ru/lostkeywords |
Disallow | /ru/treepages |
Disallow | /?closePromoNotification |
Disallow | /ru/?closePromoNotification |
Disallow | /ru/bill/ |
Disallow | /ru/tools/keywords-by-pages/ |
Disallow | /ru/tools/extended-keywords/ |
Disallow | /ru/tools/domains-batch?domains |
Disallow | /en/ |
Disallow | /en/report? |
Disallow | /en/forgotpassword |
Disallow | /en/keywords |
Disallow | /en/adreport |
Disallow | /en/adcompany |
Disallow | /en/sitepages |
Disallow | /en/concurents |
Disallow | /en/concurentpages |
Disallow | /en/owner |
Disallow | /en/keysbypage |
Disallow | /en/group |
Disallow | /en/compare |
Disallow | /en/ads |
Disallow | /en/adconcurents |
Disallow | /en/adkeys |
Disallow | /en/adcompany |
Disallow | /en/adkeysbyads |
Disallow | /en/changedb |
Disallow | /en/topvis |
Disallow | /en/topkeys |
Disallow | /en/similarkeys |
Disallow | /en/lostkeywords |
Disallow | /en/treepages |
Disallow | /en/?closePromoNotification |
Disallow | /en/bill/ |
Disallow | /en/tools/keywords-by-pages/ |
Disallow | /en/tools/extended-keywords/ |
Disallow | /en/tools/domains-batch?domains |
Other Records
Field | Value |
---|---|
crawl-delay | 1 |
Warnings
- `host` is not a known field.