keys.so
robots.txt
Robots Exclusion Standard data for keys.so
Resource Scan
Scan Details
| Site Domain | keys.so |
| Base Domain | keys.so |
| Scan Status | Ok |
| Last Scan | 2024-05-27T22:33:42+00:00 |
| Next Scan | 2024-06-26T22:33:42+00:00 |
Last Scan
| Scanned | 2024-05-27T22:33:42+00:00 |
| URL | https://keys.so/robots.txt |
| Redirect | https://www.keys.so/robots.txt |
| Redirect Domain | www.keys.so |
| Redirect Base | keys.so |
| Domain IPs | 104.26.12.125, 104.26.13.125, 172.67.72.161, 2606:4700:20::681a:c7d, 2606:4700:20::681a:d7d, 2606:4700:20::ac43:48a1 |
| Redirect IPs | 104.26.12.125, 104.26.13.125, 172.67.72.161, 2606:4700:20::681a:c7d, 2606:4700:20::681a:d7d, 2606:4700:20::ac43:48a1 |
| Response IP | 104.26.12.125 |
| Found | Yes |
| Hash | 9ed255d6c1f5298a051a184e09c900c5d5816b8c2c7332fe677cfc1d2615d15c |
| SimHash | b5894cb68db3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /ru/too-many-requests |
| Disallow | /ru/only-region-db |
| Disallow | /ru/*?* |
| Disallow | /ru*?* |
| Disallow | /ru/tools/concurents-by-keywords/ |
| Disallow | /ru/tools/dictionary-by-pages? |
| Disallow | /ru/tools/dictionary-ext-by-page/ |
| Disallow | /ru/tools/domains-batch? |
| Disallow | /ru/tools/keywords-by-list/ |
| Disallow | /ru/tools/keywords-by-pages? |
| Disallow | /ru/billresult |
| Disallow | /ru/clustering/ |
| Disallow | /ru/report? |
| Disallow | /ru/forgotpassword |
| Disallow | /ru/keywords |
| Disallow | /ru/adreport |
| Disallow | /ru/adcompany |
| Disallow | /ru/sitepages |
| Disallow | /ru/concurents |
| Disallow | /ru/concurentpages |
| Disallow | /ru/owner |
| Disallow | /ru/keysbypage |
| Disallow | /ru/group |
| Disallow | /ru/compare |
| Disallow | /ru/ads |
| Disallow | /ru/adconcurents |
| Disallow | /ru/adkeys |
| Disallow | /ru/adcompany |
| Disallow | /ru/adkeysbyads |
| Disallow | /ru/changedb |
| Disallow | /ru/topvis |
| Disallow | /ru/topkeys |
| Disallow | /ru/similarkeys |
| Disallow | /ru/lostkeywords |
| Disallow | /ru/treepages |
| Disallow | /?closePromoNotification |
| Disallow | /ru/?closePromoNotification |
| Disallow | /ru/bill/ |
| Disallow | /ru/tools/keywords-by-pages/ |
| Disallow | /ru/tools/extended-keywords/ |
| Disallow | /ru/tools/domains-batch?domains |
| Disallow | /en/ |
| Disallow | /en/report? |
| Disallow | /en/forgotpassword |
| Disallow | /en/keywords |
| Disallow | /en/adreport |
| Disallow | /en/adcompany |
| Disallow | /en/sitepages |
| Disallow | /en/concurents |
| Disallow | /en/concurentpages |
| Disallow | /en/owner |
| Disallow | /en/keysbypage |
| Disallow | /en/group |
| Disallow | /en/compare |
| Disallow | /en/ads |
| Disallow | /en/adconcurents |
| Disallow | /en/adkeys |
| Disallow | /en/adcompany |
| Disallow | /en/adkeysbyads |
| Disallow | /en/changedb |
| Disallow | /en/topvis |
| Disallow | /en/topkeys |
| Disallow | /en/similarkeys |
| Disallow | /en/lostkeywords |
| Disallow | /en/treepages |
| Disallow | /en/?closePromoNotification |
| Disallow | /en/bill/ |
| Disallow | /en/tools/keywords-by-pages/ |
| Disallow | /en/tools/extended-keywords/ |
| Disallow | /en/tools/domains-batch?domains |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 3 |
Warnings
- `host` is not a known field.