peterburg2.ru
robots.txt

Robots Exclusion Standard data for peterburg2.ru

Resource Scan

Scan Details

Site Domain peterburg2.ru
Base Domain peterburg2.ru
Scan Status Ok
Last Scan2024-09-27T01:22:33+00:00
Next Scan 2024-10-04T01:22:33+00:00

Last Scan

Scanned2024-09-27T01:22:33+00:00
URL https://peterburg2.ru/robots.txt
Domain IPs 104.21.87.66, 172.67.142.43, 2606:4700:3031::6815:5742, 2606:4700:3032::ac43:8e2b
Response IP 104.21.87.66
Found Yes
Hash 042f7006f90dfe2ca9af70fe9c5eb8616ab673783a281bb00f36ae5328f4fabc
SimHash 580d726fe6bb

Groups

*

Rule Path
Disallow /main
Disallow /pm
Disallow /look
Disallow /counter/
Disallow /counters/
Disallow /favourites
Disallow /pda
Disallow /index_dev.php
Disallow /index.php
Disallow /filmsearch
Disallow /pop/
Disallow /desc/
Disallow /go/
Disallow /movies
Disallow /kino/date/
Disallow /theatre/date/
Disallow /photo/
Disallow */page/1
Disallow /*/filters/*
Disallow /complaint/
Disallow /events/*.html?
Disallow */search?
Disallow /event/listFree/
Disallow /*/result/*
Disallow /articles/webp/
Disallow /theatre/playarchive?
Allow /ratings/spectacle/full/
Disallow /ratings/
Disallow /reimg/
Allow /news/?p=
Allow /restplaces/*/area/*/$
Disallow /restplaces/*/area/*/*/
Disallow /place/xhttpGetLovedUsers
Disallow /place/xhttpGetLovedUsers
Disallow /event/xhttpGetEventUsers

yadirectbot

Rule Path
Disallow /counter/
Disallow /counters/
Disallow /*/filters/*
Disallow /complaint/

twitterbot

Rule Path
Disallow *
Allow /articles/
Allow /news/

Other Records

Field Value
sitemap https://peterburg2.ru/map/sitemap.xml

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.