Log In Sign Up

handytoolshome.com
robots.txt

Robots Exclusion Standard data for handytoolshome.com

Resource Scan

Scan Details

Site Domain handytoolshome.com
Base Domain handytoolshome.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-07-16T15:02:21+00:00
Next Scan 2025-07-23T15:02:21+00:00

Last Successful Scan

Scanned2025-07-08T08:35:46+00:00
URL https://handytoolshome.com/robots.txt
Domain IPs 153.92.12.194, 2a02:4780:15:dbe0:1455:6c39:3c84:fa2c, 2a02:4780:39:f02c:e921:bbef:1ff2:d3e6, 91.108.119.185
Response IP 93.127.196.115
Found Yes
Hash 2907c11271046c20bdfd119c8081bf4df6820ce67f5c6c294c9ebe774e5d46c4
SimHash 3e4459e10512

Groups

googlebot

Rule Path
Allow *.js
Allow *.css
Allow /wp-admin/admin-ajax.php
Disallow /?s=
Disallow /search/
Disallow /wp-admin
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /trackback/

*

Rule Path
Allow /wp-admin/admin-ajax.php
Disallow /wp-admin
Disallow /wp-login.php
Disallow /trackback/
Disallow /wp-register.php
Back to top

Comments

  • Allow files critical for rendering
  • Allow AJAX - Do Not Remove
  • Prevent crawl-budget waste on search pages
  • Prevent private admin areas from being crawled
  • Prevent duplicate /feed/ pages from being crawled
  • Disallow: /*/feed/
  • Prevent login page crawls etc
  • Prevent register page crawls etc
  • Prevent Trackback Neg SEO
  • Allow AJAX - Do Not Remove
  • Add all sitemaps
Back to top

Warnings

  • 3 invalid lines.
  • `https` is not a known field.
Back to top