omweb.com
robots.txt

Robots Exclusion Standard data for omweb.com

Resource Scan

Scan Details

Site Domain omweb.com
Base Domain omweb.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-21T10:11:03+00:00
Next Scan 2025-11-20T10:11:03+00:00

Last Successful Scan

Scanned2025-07-24T06:43:25+00:00
URL https://omweb.com/robots.txt
Domain IPs 191.101.228.27, 2a02:4780:15:ab00:4bc2:b5ca:ed8f:f01a, 2a02:4780:38:d961:e906:e3d9:eb60:c9d1, 77.37.66.172
Response IP 77.37.66.89
Found Yes
Hash c0e793ee0fb87ec5146bff4edbdd11098437a715845f89f2bd50b4fb59ba1688
SimHash aca06a3aeec1

Groups

*

Rule Path
Disallow /admin/
Disallow /admin_login.php
Disallow /config.php
Disallow /checkout/
Disallow /cart/
Disallow /cgi-bin/
Disallow /private/
Disallow /tmp/
Disallow /wp-admin/
Disallow /*?replytocom
Disallow /*?search=
Disallow /*?q=
Disallow /blogs/?search=&page=
Allow /services/
Allow /services/*
Allow /blogs/
Allow /blogs/*
Allow /blog/
Allow /blog/*
Allow /about/
Allow /contact/
Allow /p/terms/
Allow /p/privacy/
Allow /p/refund/
Allow /p/trademark/
Allow /p/certificate/
Allow /x/
Allow /x/*

Other Records

Field Value
sitemap https://omweb.com/sitemap.xml

Comments

  • Block sensitive or non-public pages
  • Block URL parameters that cause duplicate content
  • Block paginated blog search pages
  • Allow full access to key content directories
  • Allow access to policy and legal pages
  • Allow access to tools and calculators
  • Sitemap location