glavred.net
robots.txt
Robots Exclusion Standard data for glavred.net
Resource Scan
Scan Details
Site Domain | glavred.net |
Base Domain | glavred.net |
Scan Status | Ok |
Last Scan | 2024-11-16T17:09:22+00:00 |
Next Scan | 2024-11-23T17:09:22+00:00 |
Last Scan
Scanned | 2024-11-16T17:09:22+00:00 |
URL | https://glavred.net/robots.txt |
Domain IPs | 104.22.78.221, 104.22.79.221, 172.67.26.147 |
Response IP | 104.22.78.221 |
Found | Yes |
Hash | 064d2c306d7406a7a263c5b55495fdad6b8f1a625b66684d32b01a1c7ad784d2 |
SimHash | 791dc442f715 |
Groups
*
Rule | Path |
---|---|
Allow | *.jpg |
Allow | *.gif |
Allow | *.svg |
Allow | *.css |
Allow | *.png |
Allow | *.js |
Disallow | /cdn-cgi/ |
Disallow | */search/ |
Disallow | */ajax/ |
Disallow | */content/ |
Disallow | */profile/ |
Disallow | */redirect/ |
Disallow | *utm_source%3D* |
Disallow | *utm_medium%3D* |
Disallow | *utm_campaign%3D* |
Disallow | /?url=* |
Disallow | /*_sm_byp |
Disallow | /*CFID%3D* |
Disallow | /div_location%3D |
Disallow | /*?refresh |
Disallow | /?quot |
Disallow | /?_ga |
Disallow | /?desktop |
Disallow | /*?device_view |
Disallow | /*?*items= |
Disallow | /*?*type= |
Disallow | /*?*razd= |
googlebot
Rule | Path |
---|---|
Allow | /*.jpg |
Allow | /*.gif |
Allow | /*.svg |
Allow | /*.css |
Allow | /*.png |
Allow | /*.js |
Disallow | */search/ |
Disallow | */profile/ |
yandex
Rule | Path |
---|---|
Allow | /*.jpg |
Allow | /*.gif |
Allow | /*.svg |
Allow | /*.css |
Allow | /*.png |
Allow | /*.js |
Disallow | */search/ |
Disallow | */profile/ |
Other Records
Field | Value |
---|---|
sitemap | https://glavred.net/sitemap.xml |
sitemap | https://glavred.net/sitemaps/sitemaps/sitemap.rubrics.all_rubrics.xml |
sitemap | https://glavred.net/sitemap.last.news.xml |
sitemap | https://glavred.net/sitemap_google.last.news.xml |