Log In Sign Up

rivox.io
robots.txt

Robots Exclusion Standard data for rivox.io

Resource Scan

Scan Details

Site Domain rivox.io
Base Domain rivox.io
Scan Status Ok
Last Scan2025-10-07T23:15:27+00:00
Next Scan 2025-11-06T23:15:27+00:00

Last Scan

Scanned2025-10-07T23:15:27+00:00
URL https://rivox.io/robots.txt
Domain IPs 2a03:6f00:1::5ec6:df4a, 94.198.223.74
Response IP 94.198.223.74
Found Yes
Hash 5bd161d13d368f011bf9b18eed180c57a7d12ecf83ec679b3f1e40960249a069
SimHash 4d80d8d32730

Groups

*

Rule Path
Allow /

googlebot

Rule Path
Allow /

yandex

Rule Path
Allow /

bingbot

Rule Path
Allow /
Disallow /admin/
Disallow /private/
Disallow /*.pdf$
Allow /cases/
Allow /dock/
Allow /blog/

Other Records

Field Value
crawl-delay 1
Back to top

Other Records

Field Value
sitemap https://rivox.io/sitemap.xml
Back to top

Comments

  • Sitemap
  • Specific crawlers
  • Disallow admin and private areas
  • Allow important pages
  • Crawl delay for better server performance
  • Host directive for Yandex
Back to top

Warnings

  • `host` is not a known field.
Back to top