hardwarezone.info
robots.txt

Robots Exclusion Standard data for hardwarezone.info

Resource Scan

Scan Details

Site Domain hardwarezone.info
Base Domain hardwarezone.info
Scan Status Ok
Last Scan2024-06-10T04:20:15+00:00
Next Scan 2024-06-17T04:20:15+00:00

Last Scan

Scanned2024-06-10T04:20:15+00:00
URL https://hardwarezone.info/robots.txt
Domain IPs 87.236.16.91
Response IP 87.236.16.91
Found Yes
Hash 7e90d0d2225caf22fcbb11be3a67adeca8f360e365c114e07e9b390f1c5e445a
SimHash cb625c5e6e2a

Groups

*

Rule Path
Disallow /cgi-bin
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /wp-content/plugins/
Disallow /wp-content/cache/
Disallow /wp-content/themes/
Disallow /author
Disallow /page
Disallow /tag/
Disallow /*?
Disallow /?s=
Disallow /2010
Disallow /2011
Disallow /xmlrpc.php
Disallow /category/*/page
Disallow /trackback
Disallow /feed
Disallow /*/feed
Disallow /comments
Disallow /*/comment-page-1

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap http://hardwarezone.info/sitemap.xml

Warnings

  • `host` is not a known field.