news.voyage.gentside.com
robots.txt

Robots Exclusion Standard data for news.voyage.gentside.com

Resource Scan

Scan Details

Site Domain news.voyage.gentside.com
Base Domain gentside.com
Scan Status Ok
Last Scan2024-11-05T23:45:50+00:00
Next Scan 2024-11-19T23:45:50+00:00

Last Scan

Scanned2024-11-05T23:45:50+00:00
URL https://news.voyage.gentside.com/robots.txt
Domain IPs 185.151.190.98, 2a0a:1580:2000:1a00::25
Response IP 185.151.190.98
Found Yes
Hash a9040f80201ca91ab207c047f55370c7133c68a49a59ecf31e2494430d20d0e5
SimHash 4e08cb314571

Groups

*

Rule Path
Allow /ads.txt
Allow /

googlebot

Rule Path
Disallow /

googleother

Rule Path
Disallow /

googlebot-news

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

slurp

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

duckduckbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

exabot

Rule Path
Disallow /

msnbot

Rule Path
Disallow /