ocean-corner.com
robots.txt

Robots Exclusion Standard data for ocean-corner.com

Resource Scan

Scan Details

Site Domain ocean-corner.com
Base Domain ocean-corner.com
Scan Status Ok
Last Scan2024-10-11T02:25:45+00:00
Next Scan 2024-10-18T02:25:45+00:00

Last Scan

Scanned2024-10-11T02:25:45+00:00
URL https://ocean-corner.com/robots.txt
Domain IPs 128.65.195.216, 2001:1600:4:b:4ed9:8fff:fec5:11d6
Response IP 128.65.195.216
Found Yes
Hash 6b069b7c665f2ba05d670bb2e3b2525afebfd90a8a03ed52b2492727307205e0
SimHash 66745fc52512

Groups

googlebot

Rule Path
Allow /
Disallow /?s=
Disallow /search/
Disallow *?nocache
Disallow /wp-admin
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /trackback/
Disallow /wp-trackback.php
Disallow /tag/
Disallow /cdn-cgi/l/email-protection
Disallow /?orderby=price-desc
Disallow /porpoiseant/
Disallow /detroitchicago/
Disallow /tardisrocinante/

*

Rule Path
Allow /wp-admin/admin-ajax.php
Disallow /wp-admin
Disallow /wp-login.php
Disallow /trackback/
Disallow /wp-trackback.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /porpoiseant/
Disallow /detroitchicago/
Disallow /tardisrocinante/
Disallow /go/

Other Records

Field Value
sitemap https://ocean-corner.com/sitemap_index.xml
sitemap https://ocean-corner.com/post-sitemap.xml
sitemap https://ocean-corner.com/page-sitemap.xml

Comments

  • WordPress Optimized Robots.txt
  • Prevent crawl-budget waste on search pages
  • Prevent private admin areas from being crawled
  • Prevent login page crawls
  • Prevent register page crawls
  • Prevent Trackback Neg SEO
  • Prevent tag pages from being crawled
  • Allow AJAX
  • Prevent affiliate links from being crawled
  • Sitemaps