mycfavisit.org
robots.txt

Robots Exclusion Standard data for mycfavisit.org

Resource Scan

Scan Details

Site Domain mycfavisit.org
Base Domain mycfavisit.org
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-03-04T15:00:39+00:00
Next Scan 2025-04-03T15:00:39+00:00

Last Successful Scan

Scanned2025-02-03T14:59:38+00:00
URL https://mycfavisit.org/robots.txt
Domain IPs 176.123.0.83
Response IP 176.123.0.83
Found Yes
Hash 0680c030f934e5236e2efc853986ee1f197f16b0a48ccd41cf1d6042b4f7b30b
SimHash c020591ae21a

Groups

*

Rule Path
Allow /wp-admin/admin-ajax.php
Allow /*/*.css
Allow /*/*.js
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /readme.html
Disallow /license.txt
Disallow /xmlrpc.php
Disallow /wp-login.php
Disallow /wp-register.php
Disallow *?attachment_id=

*

Rule Path
Disallow /wp-json/
Disallow /?rest_route=

*

Rule Path
Disallow /search/
Disallow /?s=

*

Rule Path
Disallow *?s=*
Disallow *?p=*
Disallow *%26p%3D*
Disallow *%26preview%3D*

*

Rule Path
Disallow /feed/
Disallow /feed/$
Disallow /comments/feed
Disallow */feed
Disallow */feed$
Disallow /?feed=
Disallow /wp-feed

*

Rule Path
Disallow /trackback/
Disallow */comments$
Disallow */trackback
Disallow */trackback$
Disallow /wp-comments
Disallow /wp-trackback
Disallow */replytocom%3D

Other Records

Field Value
sitemap https://www.mycfavisit.org/post-sitemap.xml
sitemap https://www.mycfavisit.org/page-sitemap.xml

Comments

  • Advanced Wordpress
  • Prevent Crawling of WordPress JSON API Endpoints
  • Block Search URLs /search/ and /?s=
  • Block Parameters
  • Block Feed
  • Block Spam Directories
  • Rankmath Sitemap Link