umen.org
robots.txt

Robots Exclusion Standard data for umen.org

Resource Scan

Scan Details

Site Domain umen.org
Base Domain umen.org
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-14T17:25:52+00:00
Next Scan 2024-12-13T17:25:52+00:00

Last Successful Scan

Scanned2023-07-27T23:33:24+00:00
URL https://umen.org/robots.txt
Domain IPs 34.160.81.203
Response IP 34.160.81.203
Found Yes
Hash 930435cfdf16c4c8d99f6ca07f81886213c6779a8a6200b27be7fcc82f98d4bb
SimHash 045c49b0ea12

Groups

googlebot-image

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

aspiegelbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

googlebot

Rule Path
Disallow /wp-content/uploads/

baiduspider

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-news

Rule Path
Disallow /

baiduspider-favo

Rule Path
Disallow /

baiduspider-ads

Rule Path
Disallow /

baiduspider-cpro

Rule Path
Disallow /

*

Rule Path
Disallow /media/
Disallow /wp-