spbdnevnik.ru
robots.txt
Robots Exclusion Standard data for spbdnevnik.ru
Resource Scan
Scan Details
Site Domain | spbdnevnik.ru |
Base Domain | spbdnevnik.ru |
Scan Status | Ok |
Last Scan | 2024-07-04T20:42:01+00:00 |
Next Scan | 2024-07-11T20:42:01+00:00 |
Last Scan
Scanned | 2024-07-04T20:42:01+00:00 |
URL | https://spbdnevnik.ru/robots.txt |
Domain IPs | 92.255.97.76 |
Response IP | 92.255.97.76 |
Found | Yes |
Hash | f9a88274e18588e281686f0d7f87b2319c56dc20d7390b0cd27b505ab1d793b7 |
SimHash | d856d1c083f1 |
Groups
*
Rule | Path |
---|---|
Disallow | /news/2021-09-17/aleksandr-beglov* |
Disallow | /news/2021-09-17/smolnyy-uvelichit* |
Disallow | /news/2021-12-25/novye-shkoly* |
Disallow | /news/2022-03-14/aleksandr-beglov* |
Disallow | /news/2022-03-14/glavnoe-za-den-v-peterburge* |
Disallow | /news/2022-04-28/v-peterburge-k-2024* |
Disallow | /news/2022-12-11/ekspert-prokommentiroval* |
Disallow | /news/2023-04-26/v-peterburge-v-2024* |
Disallow | /news/2023-08-22/v-byudzhete-peterburga* |
Disallow | /news/2023-07-03/v-2024-godu-v-peterburge* |
Disallow | /news/2023-04-27/gubernator-peterburga* |
Disallow | /news/2022-03-14/glavnoe-za-den-v-peterburge-14-marta* |
Disallow | /customer/* |