widgetbot.io
robots.txt

Robots Exclusion Standard data for widgetbot.io

Resource Scan

Scan Details

Site Domain widgetbot.io
Base Domain widgetbot.io
Scan Status Ok
Last Scan2026-02-19T21:23:52+00:00
Next Scan 2026-03-21T21:23:52+00:00

Last Scan

Scanned2026-02-19T21:23:52+00:00
URL https://widgetbot.io/robots.txt
Domain IPs 104.18.10.54, 104.18.11.54, 2606:4700::6812:a36, 2606:4700::6812:b36
Response IP 104.18.11.54
Found Yes
Hash 5c40f2e432956158853e410d4c31236971d4442775885ab91447259dba33c858
SimHash 491cd632c713

Groups

*

Rule Path
Allow /
Disallow /api/

Other Records

Field Value
sitemap https://widgetbot.io/sitemap.xml