briefly.ru
robots.txt
Robots Exclusion Standard data for briefly.ru
Resource Scan
Scan Details
Site Domain | briefly.ru |
Base Domain | briefly.ru |
Scan Status | Ok |
Last Scan | 2024-11-13T09:38:43+00:00 |
Next Scan | 2024-11-20T09:38:43+00:00 |
Last Scan
Scanned | 2024-11-13T09:38:43+00:00 |
URL | https://briefly.ru/robots.txt |
Domain IPs | 104.26.2.126, 104.26.3.126, 172.67.72.101, 2606:4700:20::681a:27e, 2606:4700:20::681a:37e, 2606:4700:20::ac43:4865 |
Response IP | 172.67.72.101 |
Found | Yes |
Hash | 8d746a0b6e77bc4881bae5666f6c7a716fc8d2ae799d8b3b4f90d07c2d87e17f |
SimHash | 6011cd22e510 |
Groups
*
Rule | Path |
---|---|
Disallow | /search/ |
Disallow | /wanted/ |
Disallow | /random/ |
Disallow | /nointernet/ |
Disallow | /api/ |