ooni.io
robots.txt

Robots Exclusion Standard data for ooni.io

Resource Scan

Scan Details

Site Domain ooni.io
Base Domain ooni.io
Scan Status Ok
Last Scan2024-08-29T13:54:13+00:00
Next Scan 2024-09-28T13:54:13+00:00

Last Scan

Scanned2024-08-29T13:54:13+00:00
URL https://ooni.io/robots.txt
Redirect https://ooni.org/robots.txt
Redirect Domain ooni.org
Redirect Base ooni.org
Domain IPs 104.198.14.52
Redirect IPs 75.2.60.5
Response IP 75.2.60.5
Found Yes
Hash 7c8a6ffaa17b2c2c1b11fef5f55f272901bb599de300d92e8bdc423d0a2cc1eb
SimHash dd0c8517cdb5

Groups

*

Rule Path
Disallow /categories/
Disallow /tags/
Disallow /retired/
Allow /

Other Records

Field Value
sitemap https://ooni.org/sitemap.xml

Comments

  • We tell search engines to ignore these paths which don't have content in them