Log In Sign Up

maize.com
robots.txt

Robots Exclusion Standard data for maize.com

Resource Scan

Scan Details

Site Domain maize.com
Base Domain maize.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-08-29T20:04:15+00:00
Next Scan 2025-09-05T20:04:15+00:00

Last Successful Scan

Scanned2025-08-21T19:54:46+00:00
URL https://maize.com/robots.txt
Domain IPs 2a02:4780:16:e68d:3a:51c1:b62c:d83d, 2a02:4780:38:c302:95f1:dff7:85da:e79d, 77.37.75.102, 91.108.100.177
Response IP 93.127.201.63
Found Yes
Hash 88519c1699b70786a13ec6777781b9a49cd1a44ae86d3f2d8afe9d8d7d13a21c
SimHash b21488209e02

Groups

claudebot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

nbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

censysinspect

Rule Path
Disallow /

go-http-client

Rule Path
Disallow /

expanse

Rule Path
Disallow /

l9explore

Rule Path
Disallow /

python-requests

Rule Path
Disallow /

custom-asynchttpclient

Rule Path
Disallow /

zgrab

Rule Path
Disallow /

siteuptime

Rule Path
Disallow /

genomecrawlerd

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /
Back to top