Log In Sign Up

omr.com
robots.txt

Robots Exclusion Standard data for omr.com

Resource Scan

Scan Details

Site Domain omr.com
Base Domain omr.com
Scan Status Ok
Last Scan2024-06-25T18:31:43+00:00
Next Scan 2024-07-02T18:31:43+00:00

Last Scan

Scanned2024-06-25T18:31:43+00:00
URL https://omr.com/robots.txt
Domain IPs 151.101.130.132, 151.101.194.132, 151.101.2.132, 151.101.66.132
Response IP 151.101.66.132
Found Yes
Hash 3313f193a2d3627397f6ed67f0f73b11ca837fc019ed77d86c3f3468f3530cf2
SimHash 45a80354601d

Groups

gptbot
chatgpt-user
google-extended
anthropic-ai
ccbot
omgilibot
omgili
facebookbot
bytespider
claude-web
cohere-ai
perplexitybot

Rule Path
Disallow /*/reviews/product/*

*

Rule Path
Allow *
Disallow /*/wp-admin/
Allow /*/daily/author/*/
Allow /*/daily/author/*/2
Allow /*/daily/author/*/3
Allow /*/daily/category/*
Allow /*/daily/category/*/2
Allow /*/daily/category/*/3
Disallow /*/daily/category/*/*
Disallow /*/daily/author/*/*
Allow /*/reviews/contenthub/category/*
Allow /*/reviews/contenthub/category/*/2
Allow /*/reviews/contenthub/category/*/3
Allow /*/reviews/contenthub/tag/*
Allow /*/reviews/contenthub/tag/*/2
Allow /*/reviews/contenthub/tag/*/3
Allow /*/reviews/contenthub/product/*
Allow /*/reviews/contenthub/product/*/2
Allow /*/reviews/contenthub/product/*/3
Allow /*/reviews/contenthub/author/*
Allow /*/reviews/contenthub/author/*/2
Allow /*/reviews/contenthub/author/*/3
Disallow /*/reviews/contenthub/author/*/*
Disallow /*/reviews/contenthub/product/*/*
Disallow /*/reviews/contenthub/category/*/*
Disallow /*/reviews/contenthub/tag/*/*
Disallow /login/
Disallow /*?__hstc=*
Back to top

Other Records

Field Value
sitemap https://omr.com/sitemap.xml
Back to top

Comments

  • block wordpress backend
  • limit daily author/category pagination
  • limit reviews ContentHub category/tag/product/author pagination
  • block login pages
  • block parameter from omr.ninja
Back to top