bentobox.io
robots.txt

Robots Exclusion Standard data for bentobox.io

Resource Scan

Scan Details

Site Domain bentobox.io
Base Domain bentobox.io
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-06-24T12:03:54+00:00
Next Scan 2025-09-22T12:03:54+00:00

Last Successful Scan

Scanned2024-05-31T12:01:02+00:00
URL https://bentobox.io/robots.txt
Redirect https://bento.io/robots.txt
Redirect Domain bento.io
Redirect Base bento.io
Domain IPs 104.21.36.190, 172.67.198.192, 2606:4700:3033::ac43:c6c0, 2606:4700:3034::6815:24be
Redirect IPs 104.21.36.190, 172.67.198.192, 2606:4700:3033::ac43:c6c0, 2606:4700:3034::6815:24be
Response IP 172.67.198.192
Found Yes
Hash eb9e5ebcb1d5dbaf73ce16fdeb4f7c3683814c961a3abdb349888a91305ef6de
SimHash 78011c548791

Groups

*

Rule Path
Disallow /auth/
Disallow /login/
Disallow /admin/

Other Records

Field Value
sitemap https://bento.io/sitemap.xml