omnimaga.org
robots.txt

Robots Exclusion Standard data for omnimaga.org

Resource Scan

Scan Details

Site Domain omnimaga.org
Base Domain omnimaga.org
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-08-06T15:49:30+00:00
Next Scan 2025-10-05T15:49:30+00:00

Last Successful Scan

Scanned2025-05-16T15:47:16+00:00
URL https://omnimaga.org/robots.txt
Redirect https://www.omnimaga.org/robots.txt
Redirect Domain www.omnimaga.org
Redirect Base omnimaga.org
Domain IPs 104.21.59.118, 172.67.177.49, 2606:4700:3034::6815:3b76, 2606:4700:3035::ac43:b131
Redirect IPs 104.21.59.118, 172.67.177.49, 2606:4700:3034::6815:3b76, 2606:4700:3035::ac43:b131
Response IP 104.21.59.118
Found Yes
Hash 73f571372885bd3f5f70725f33ab20f010b6070fafcf46828c517547647ef789
SimHash d64469a68033

Groups

*

Rule Path
Disallow /cache/
Disallow /sources/
Disallow /ssi_templates/
Disallow /back.php

baiduspider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

moget
ichiro

Rule Path
Disallow /

naverbot
yeti

Rule Path
Disallow /

baiduspider
baiduspider-video
baiduspider-image

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

sosospider

Rule Path
Disallow /