southerndia.co.jp
robots.txt

Robots Exclusion Standard data for southerndia.co.jp

Resource Scan

Scan Details

Site Domain southerndia.co.jp
Base Domain southerndia.co.jp
Scan Status Ok
Last Scan2024-06-12T21:06:37+00:00
Next Scan 2024-07-12T21:06:37+00:00

Last Scan

Scanned2024-06-12T21:06:37+00:00
URL https://southerndia.co.jp/robots.txt
Domain IPs 183.90.246.6
Response IP 183.90.246.6
Found Yes
Hash 05d65ab6c713ee27ed0d9c1be2e2d6b715b900d35bfa045570d2e2036fcb6995
SimHash 8074d0b2cd2a

Groups

megalodon

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

updownerbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

slurp

Rule Path
Disallow

teoma

Rule Path
Disallow

rogerbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /