Log In Sign Up

oxifresh.com
robots.txt

Robots Exclusion Standard data for oxifresh.com

Resource Scan

Scan Details

Site Domain oxifresh.com
Base Domain oxifresh.com
Scan Status Ok
Last Scan2026-01-21T17:43:56+00:00
Next Scan 2026-02-20T17:43:56+00:00

Last Scan

Scanned2026-01-21T17:43:56+00:00
URL https://oxifresh.com/robots.txt
Redirect https://www.oxifresh.com/robots.txt
Redirect Domain www.oxifresh.com
Redirect Base oxifresh.com
Domain IPs 162.159.129.73, 162.159.130.73, 2606:4700:7::a29f:8149, 2606:4700:7::a29f:8249
Redirect IPs 162.159.129.73, 162.159.130.73, 2606:4700:7::a29f:8149, 2606:4700:7::a29f:8249
Response IP 162.159.130.73
Found Yes
Hash fe97a1910882ca9c45fdfd8191857da62b0232d1ad35408626602d7f5eccd814
SimHash 71265252e0f4

Groups

*

Rule Path
Disallow /*?replytocom=
Disallow /login/*
Disallow /*q%3D
Disallow /*?pageid=
Disallow /*/reviews/?pageid=*
Disallow /locations/*/reviews/?pageid=*
Disallow /*?reviews-page=
Disallow /*?page=
Disallow /*?paged=
Back to top

Other Records

Field Value
sitemap https://www.oxifresh.com/sitemap_index.xml
Back to top

Comments

  • Added by Andy
  • Block Ahrefs pagination crawling that causes site crashes
  • Block global reviews pagination (testimonials page)
  • Additional crawler protection
Back to top