secondstreet.ru
robots.txt
Robots Exclusion Standard data for secondstreet.ru
Resource Scan
Scan Details
Site Domain | secondstreet.ru |
Base Domain | secondstreet.ru |
Scan Status | Ok |
Last Scan | 4/1/2025, 10:36:34 AM |
Next Scan | 4/8/2025, 10:36:34 AM |
Last Scan
Scanned | 4/1/2025, 10:36:34 AM |
URL | https://secondstreet.ru/robots.txt |
Domain IPs | 104.21.27.88, 172.67.169.21, 2606:4700:3031::ac43:a915, 2606:4700:3037::6815:1b58 |
Response IP | 104.21.27.88 |
Found | Yes |
Hash | 0378382fc25be2b923401041328da1dfa2e1ed7ea2bf63ed319251ab069b76e7 |
SimHash | a589d3438915 |
Groups
*
Rule | Path |
---|---|
Disallow | /auth/ |
Disallow | /rss |
Disallow | /search/ |
Disallow | /stream |
Disallow | /feed |
Disallow | /ajax |
Disallow | /admin |
Disallow | /subscribe/ |
Disallow | /error/$ |
Disallow | /settings/$ |
Disallow | /talk/$ |
Disallow | */edit/* |
Disallow | *?ssp_iabi |
Disallow | *?* |
Allow | /*/*.css |
Allow | /*/*.js |
Warnings
- `host` is not a known field.