news.gaming.gentside.com
robots.txt

Robots Exclusion Standard data for news.gaming.gentside.com

Resource Scan

Scan Details

Site Domain news.gaming.gentside.com
Base Domain gentside.com
Scan Status Ok
Last Scan2024-11-05T21:04:14+00:00
Next Scan 2024-11-19T21:04:14+00:00

Last Scan

Scanned2024-11-05T21:04:14+00:00
URL https://news.gaming.gentside.com/robots.txt
Redirect https://news.gamesider.com/robots.txt
Redirect Domain news.gamesider.com
Redirect Base gamesider.com
Domain IPs 185.151.190.98, 2a0a:1580:2000:1a00::25
Redirect IPs 185.151.190.98, 2a0a:1580:2000:1a00::25
Response IP 185.151.190.98
Found Yes
Hash a9040f80201ca91ab207c047f55370c7133c68a49a59ecf31e2494430d20d0e5
SimHash 4e08cb314571

Groups

*

Rule Path
Allow /ads.txt
Allow /

googlebot

Rule Path
Disallow /

googleother

Rule Path
Disallow /

googlebot-news

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

slurp

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

duckduckbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

exabot

Rule Path
Disallow /

msnbot

Rule Path
Disallow /