tel-spb.ru
robots.txt

Robots Exclusion Standard data for tel-spb.ru

Resource Scan

Scan Details

Site Domain tel-spb.ru
Base Domain tel-spb.ru
Scan Status Ok
Last Scan2025-04-06T00:47:22+00:00
Next Scan 2025-04-13T00:47:22+00:00

Last Scan

Scanned2025-04-06T00:47:22+00:00
URL https://tel-spb.ru/robots.txt
Domain IPs 141.8.194.164
Response IP 141.8.194.164
Found Yes
Hash 5be6ca5c63146b57622268a507b9a7112beb7e74eb571be9ded391d01ce43faf
SimHash 6de05c468943

Groups

*

Rule Path
Disallow /search/
Disallow /generator/aksa_*
Disallow /generator/geko_*
Disallow /tv/sony/2017
Disallow /tv/sony/2016
Disallow /tv/supra/2016
Disallow /tv/supra/2015
Disallow /tv/mystery/2016

Other Records

Field Value
sitemap https://tel-spb.ru/sitemap.xml
sitemap https://tel-spb.ru/tv/sitemap.xml
sitemap https://tel-spb.ru/remont-tv-lcd/sitemap.xml
sitemap https://tel-spb.ru/generator/sitemap.xml
sitemap https://tel-spb.ru/dumps/sitemap.xml

Warnings

  • `host` is not a known field.