virgool.io
robots.txt

Robots Exclusion Standard data for virgool.io

Resource Scan

Scan Details

Site Domain virgool.io
Base Domain virgool.io
Scan Status Ok
Last Scan2024-09-23T01:23:12+00:00
Next Scan 2024-10-23T01:23:12+00:00

Last Scan

Scanned2024-09-23T01:23:12+00:00
URL https://virgool.io/robots.txt
Domain IPs 185.143.233.120, 185.143.234.120
Response IP 185.143.234.120
Found Yes
Hash fd8680ccd9b86b93317934a9d389d3b0b2892e0fafe5c80314424ed51a0a079f
SimHash 4d4cc308e319

Groups

*

Rule Path
Disallow /*/*/likes
Disallow /authorize
Disallow /authorize-token
Disallow /*/*?source=*

megaindex.ru/2.0

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

yandex

Rule Path
Disallow /

baiduspider
baiduspider-video
baiduspider-image

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /
Disallow /search

Comments

  • Block MegaIndex.ru
  • Block YandexBot
  • Block Baidu
  • Block Youdao
  • Block Majestic