indexbox.io
robots.txt

Robots Exclusion Standard data for indexbox.io

Resource Scan

Scan Details

Site Domain indexbox.io
Base Domain indexbox.io
Scan Status Ok
Last Scan2025-11-15T11:44:21+00:00
Next Scan 2025-12-15T11:44:21+00:00

Last Scan

Scanned2025-11-15T11:44:21+00:00
URL https://indexbox.io/robots.txt
Redirect https://www.indexbox.io/robots.txt
Redirect Domain www.indexbox.io
Redirect Base indexbox.io
Domain IPs 104.21.10.160, 172.67.131.160, 2606:4700:3035::ac43:83a0, 2606:4700:3036::6815:aa0
Redirect IPs 104.21.10.160, 172.67.131.160, 2606:4700:3035::ac43:83a0, 2606:4700:3036::6815:aa0
Response IP 172.67.131.160
Found Yes
Hash 35c44fc303441f5b16ae9f67af9336dbc5b480b770b36776b8f9ed50e19fafd0
SimHash c85c91c78a13

Groups

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.indexbox.io/sitemap.xml

Warnings

  • `clean-param` is not a known field.