hardweb.it
robots.txt

Robots Exclusion Standard data for hardweb.it

Resource Scan

Scan Details

Site Domain hardweb.it
Base Domain hardweb.it
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-09-12T19:49:06+00:00
Next Scan 2025-10-12T19:49:06+00:00

Last Successful Scan

Scanned2025-08-14T17:37:48+00:00
URL https://hardweb.it/robots.txt
Domain IPs 185.116.60.9, 2a0c:79c0:1:9::4
Response IP 185.116.60.9
Found Yes
Hash f50d7a96010deb41b7e3f198e42be3134812bafa4252fa11d0a3e8b2bd941ebc
SimHash 4aeeda0389f2

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /tag/
Disallow /c/
Disallow /mall.php
Disallow /online.php
Disallow /mall.php?c%2F
Disallow /online.php?c%2F
Disallow /mall.php?n%2F
Disallow /online.php?n%2F
Disallow /mall.php?r%2F
Disallow /online.php?r%2F
Disallow /billing.hardweb.it/
Allow /
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://hardweb.it/sitemap_index.xml

Comments

  • This file is automatically added by Rank Math SEO plugin to help a website index better
  • More info: https://rankmath.com/?utm_source=Plugin&utm_medium=Robots&utm_campaign=WP