sinoptik.uk
robots.txt

Robots Exclusion Standard data for sinoptik.uk

Resource Scan

Scan Details

Site Domain sinoptik.uk
Base Domain sinoptik.uk
Scan Status Ok
Last Scan2024-06-17T20:45:27+00:00
Next Scan 2024-06-24T20:45:27+00:00

Last Scan

Scanned2024-06-17T20:45:27+00:00
URL https://sinoptik.uk/robots.txt
Domain IPs 212.42.73.100
Response IP 212.42.73.100
Found Yes
Hash 14fc6bfd5c6a6ad5b6320b763828240921014e33492708794d648acf39635dfa
SimHash 600e8460c4b3

Groups

mediapartners-google

Rule Path
Disallow

dotbot

Rule Path
Disallow /redirector/
Disallow /printroadweather*
Disallow /*/p_*
Disallow *?id
Disallow /*?*
Disallow /*?iframe*
Disallow /_cache*
Disallow /rss/
Disallow /pinformer.php
Disallow /img/sea_weather.swf
Disallow /informers_js*
Disallow /*v1/local-time/id*
Disallow *?events=GetLastCities&speedlink=1&id*
Disallow /api/
Disallow /stats/
Disallow /resources/

Other Records

Field Value
crawl-delay 120

mail.ru

Rule Path
Disallow /redirector/
Disallow /printroadweather*
Disallow /*/p_*
Disallow *?id
Disallow /?*
Disallow /*?iframe*
Disallow /_cache*
Disallow /rss/
Disallow /pinformer.php
Disallow /img/sea_weather.swf
Disallow /informers_js*
Disallow /*v1/local-time/id*
Disallow *?events=GetLastCities&speedlink=1&id*
Disallow /api/
Disallow /stats/
Disallow /resources/

Other Records

Field Value
crawl-delay 20

slurp

Rule Path
Disallow /redirector/
Disallow /printroadweather*
Disallow /*/p_*
Disallow *?id
Disallow /*?iframe*
Disallow /_cache*
Disallow /rss/
Disallow /img/sea_weather.swf
Disallow /informers_js*
Disallow /*v1/local-time/id*
Disallow *?events=GetLastCities&speedlink=1&id*
Disallow /api/
Disallow /stats/
Disallow /resources/

Other Records

Field Value
crawl-delay 120

*

Rule Path
Disallow /redirector/
Disallow /printroadweather*
Disallow /*/p_*
Disallow *?id
Disallow /?*
Disallow /*?iframe*
Disallow /_cache*
Disallow /rss/
Disallow /pinformer.php
Disallow /img/sea_weather.swf
Disallow /informers_js*
Disallow /*v1/local-time/id*
Disallow *?events=GetLastCities&speedlink=1&id*
Disallow /api/
Disallow /stats/
Disallow /resources/

Other Records

Field Value
sitemap https://sinoptik.uk/sitemap/sitemap.xml

Warnings

  • `host` is not a known field.