softclever.com
robots.txt
Robots Exclusion Standard data for softclever.com
Resource Scan
Scan Details
Site Domain | softclever.com |
Base Domain | softclever.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2025-10-17T05:40:20+00:00 |
Next Scan | 2025-10-31T05:40:20+00:00 |
Last Successful Scan
Scanned | 2025-10-02T05:39:45+00:00 |
URL | https://softclever.com/robots.txt |
Domain IPs | 160.25.226.148 |
Response IP | 160.25.226.148 |
Found | Yes |
Hash | 0098648ec2beddf4efb43ce228e591f30f9bb9d298ac0525cd81587aeb37cd7c |
SimHash | 4180d8020b31 |
Groups
*
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Disallow | /wp-includes/ |
Allow | /wp-admin/admin-ajax.php |
Disallow | /mb-license/ |
Disallow | /ie-license/ |
Disallow | /ec-license/ |
Disallow | /bbp-license/ |
Disallow | /tdt-license/ |
Disallow | /ur-license/ |
Disallow | /fs-license/ |
Disallow | /service-eligibility/ |
Disallow | /*/out/ |