Log In Sign Up

eroglobusspb.com
robots.txt

Robots Exclusion Standard data for eroglobusspb.com

Resource Scan

Scan Details

Site Domain eroglobusspb.com
Base Domain eroglobusspb.com
Scan Status Ok
Last Scan2024-10-05T19:40:49+00:00
Next Scan 2024-11-04T19:40:49+00:00

Last Scan

Scanned2024-10-05T19:40:49+00:00
URL https://eroglobusspb.com/robots.txt
Domain IPs 190.115.31.223
Response IP 190.115.31.223
Found Yes
Hash 393807ad7bfe481f19dddb2fdd001341d96ce89440c3c054560466be12856401
SimHash 0b6b144a1473

Groups

*

Rule Path
Disallow /backup
Disallow /includes
Disallow /cron
Disallow /tmp
Disallow /print*
Disallow /*?sort_by=
Disallow /*%26sort_by%3D
Disallow /*?sort_type=
Disallow /*%26sort_type%3D
Disallow /%5Bgeo_url%5D*

yandex

Rule Path
Disallow /backup
Disallow /includes
Disallow /cron
Disallow /tmp
Disallow /print*
Disallow /*?sort_by=
Disallow /*%26sort_by%3D
Disallow /*?sort_type=
Disallow /*%26sort_type%3D
Disallow /%5Bgeo_url%5D*

alexabot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

semrushbot
semrushbot-sa
mj12bot
dotbot
rogerbot
megaindex.ru
megaindex.com
megaindex.ru/2.0
alexibot
surveybot
backlinkcrawler
sistrix crawler
sistrix
sistrix
uptimerobot/2.0

Product Comment
semrushbot Semrush
semrushbot-sa Semrush technical
mj12bot Majestic
dotbot Moz
rogerbot Moz
megaindex.ru https://megaindex.com/crawler
megaindex.com https://megaindex.com/crawler
megaindex.ru/2.0 MegaIndex.ru
alexibot Alexa
surveybot Surveybot.io
backlinkcrawler http://www.backlinktest.com
sistrix crawler Block SISTRIX
sistrix Block SISTRIX
sistrix Block SISTRIX
uptimerobot/2.0 Block Uptime robot
Rule Path
Disallow /
Disallow /*confirm.html*
Disallow /*listing-details.html*
Disallow /*print.html*
Disallow /404.html*
Disallow /*listing-remove.html*
Disallow /*newsletter.html*
Disallow /*excel-import-export.html*
Disallow /*confirm.html*
Disallow /*listing-details.html*
Disallow /*print.html*
Disallow /404.html*
Disallow /*listing-remove.html*
Disallow /*newsletter.html*
Disallow /*excel-import-export.html*
Disallow /*booking-order.html*
Back to top

Other Records

Field Value
sitemap https://eroglobusspb.com/sitemap.xml
sitemap https://eroglobusspb.com/sitemap.xml
Back to top

Comments

  • robots.txt
  • Excluded pages:
  • Rules generated by the Sitemap plugin
  • Excluded pages:
Back to top

Warnings

  • `host` is not a known field.
Back to top