octeth.com
robots.txt

Robots Exclusion Standard data for octeth.com

Resource Scan

Scan Details

Site Domain octeth.com
Base Domain octeth.com
Scan Status Ok
Last Scan5/7/2025, 10:03:19 AM
Next Scan 6/6/2025, 10:03:19 AM

Last Scan

Scanned5/7/2025, 10:03:19 AM
URL https://octeth.com/robots.txt
Domain IPs 104.21.34.193, 172.67.164.51, 2606:4700:3034::ac43:a433, 2606:4700:3037::6815:22c1
Response IP 104.21.34.193
Found Yes
Hash e92f32d6c1d41cb0b7d75d4ee2d911354bfdf35e80ad5f834a60a9e7dea453f0
SimHash 7b064c534aba

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /wp-includes/
Disallow /wp-content/plugins/
Disallow /wp-content/themes/
Disallow /wp-content/cache/
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /cgi-bin/
Disallow /trackback/
Disallow /xmlrpc.php
Disallow /wp-json/
Disallow /readme.html
Disallow /license.txt
Disallow /*?s=
Disallow /*?search=
Disallow /*?replytocom
Disallow /*?attachment_id
Disallow /comments/feed/
Disallow /*/feed
Disallow /*/rss
Disallow /*/embed
Disallow /*/comment-page-
Disallow /*?author=
Disallow /*?orderby=
Disallow /privacy-policy/
Disallow /terms-of-use/
Disallow /wp-content/uploads/*.pdf$

Other Records

Field Value
sitemap https://www2.octeth.com/sitemap_index.xml
sitemap https://www2.octeth.com/post-sitemap.xml
sitemap https://www2.octeth.com/page-sitemap.xml
sitemap https://www2.octeth.com/directory_entry-sitemap.xml
sitemap https://www2.octeth.com/glossary-sitemap.xml
sitemap https://www2.octeth.com/category-sitemap.xml
sitemap https://www2.octeth.com/directory_category-sitemap.xml
sitemap https://www2.octeth.com/author-sitemap.xml
sitemap https://www2.octeth.com/directory_comparisons-sitemap.xml

Comments

  • Allow all bots
  • Sitemap