oaklandmofo.com
robots.txt

Robots Exclusion Standard data for oaklandmofo.com

Resource Scan

Scan Details

Site Domain oaklandmofo.com
Base Domain oaklandmofo.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-11-13T12:21:48+00:00
Next Scan 2024-11-27T12:21:48+00:00

Last Successful Scan

Scanned2024-10-29T12:20:39+00:00
URL https://oaklandmofo.com/robots.txt
Domain IPs 158.51.123.249
Response IP 158.51.123.249
Found Yes
Hash 3ffbdb51cadc231771f35a8b224dd610668b1485ee9cd94c02279f30ff00d37b
SimHash 124c79058173

Groups

*

Rule Path
Allow /
Disallow /blog/cgi-bin/
Disallow /old/

moget
ichiro
naverbot
yeti
baiduspider
baiduspider-video
baiduspider-image
sogou spider
youdaobot
seokicks-robot
umbot-ln

Rule Path
Disallow /

googlebot

Rule Path
Allow /ads.txt

Other Records

Field Value
sitemap https://oaklandmofo.com/sitemap.xml
sitemap https://oaklandmofo.com/blog/post-sitemap.xml
sitemap https://oaklandmofo.com/blog/page-sitemap.xml