iolabs.io
robots.txt

Robots Exclusion Standard data for iolabs.io

Resource Scan

Scan Details

Site Domain iolabs.io
Base Domain iolabs.io
Scan Status Ok
Last Scan2025-10-07T19:31:13+00:00
Next Scan 2025-11-06T19:31:13+00:00

Last Scan

Scanned2025-10-07T19:31:13+00:00
URL https://iolabs.io/robots.txt
Domain IPs 104.21.68.183, 172.67.197.208, 2606:4700:3032::ac43:c5d0, 2606:4700:3033::6815:44b7
Response IP 104.21.68.183
Found Yes
Hash 10fc8e7648e7254cda094ded12a875b34fb9fb364e2781688aa42b21e8b573c8
SimHash 64610175dd71

Groups

*

Rule Path
Disallow /tools/search?domain
Disallow /tools/javascript-stats?name
Disallow /tools/hostname-stats?hostname

googlebot

Rule Path
Allow /tools/search?domain
Allow /tools/javascript-stats?name
Allow /tools/hostname-stats?hostname

Other Records

Field Value
sitemap https://iolabs.io/sitemap.xml

Comments

  • Googlebot understands JavaScript and can make AJAX POST to retrieve the page content.