techfinanceguide.com
robots.txt

Robots Exclusion Standard data for techfinanceguide.com

Resource Scan

Scan Details

Site Domain techfinanceguide.com
Base Domain techfinanceguide.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-08-23T17:39:10+00:00
Next Scan 2025-09-22T17:39:10+00:00

Last Successful Scan

Scanned2025-07-25T16:48:04+00:00
URL https://techfinanceguide.com/robots.txt
Domain IPs 2a02:4780:38:474b:1423:5f2d:20a7:a04a, 2a02:4780:39:4bb0:196b:37fb:92d8:f358, 77.37.66.84, 91.108.100.16
Response IP 77.37.66.141
Found Yes
Hash 6f5b69d7c8f1540d2a7ff5d41b36dd737da7090ef3d8674841d59d56322c3309
SimHash 69be487066b9

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-content/plugins/
Disallow /wp-content/cache/
Disallow /readme.html
Disallow /license.txt
Disallow /cgi-bin/
Disallow /*.php$
Disallow /*?s=*
Disallow /tag/
Disallow /category/*/feed/
Allow /wp-content/uploads/
Allow /wp-content/themes/
Allow /wp-content/plugins/*.css
Allow /wp-content/plugins/*.js
Disallow /private/
Disallow /tmp/
Disallow /backups/

Other Records

Field Value
sitemap https://techfinanceguide.com/sitemap_index.xml

Comments

  • Block specific URLs or file types
  • Allow Google to access important content
  • Block sensitive data
  • Sitemap location