granitehistory.org
robots.txt

Robots Exclusion Standard data for granitehistory.org

Resource Scan

Scan Details

Site Domain granitehistory.org
Base Domain granitehistory.org
Scan Status Ok
Last Scan2024-11-16T20:13:16+00:00
Next Scan 2024-11-23T20:13:16+00:00

Last Scan

Scanned2024-11-16T20:13:16+00:00
URL https://granitehistory.org/robots.txt
Domain IPs 172.96.187.223
Response IP 172.96.187.223
Found Yes
Hash a471dffebd5d2228369640acf231f41adbd3bd20f3e26481516321811812a693
SimHash 524c5342c032

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

rogerbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

xenu

Rule Path
Disallow /

yandex

Rule Path
Disallow /

moget

Rule Path
Disallow /

ichiro

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

umbot-ln

Rule Path
Disallow /

Comments

  • User-agent: MJ12bot
  • Disallow: /
  • User-agent: SemrushBot
  • Disallow: /