cleantechblog.com
robots.txt

Robots Exclusion Standard data for cleantechblog.com

Resource Scan

Scan Details

Site Domain cleantechblog.com
Base Domain cleantechblog.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-10T18:19:53+00:00
Next Scan 2025-12-09T18:19:53+00:00

Last Successful Scan

Scanned2022-10-31T22:38:06+00:00
URL https://cleantechblog.com/robots.txt
Redirect https://www.cleantechblog.com/robots.txt
Redirect Domain www.cleantechblog.com
Redirect Base cleantechblog.com
Response IP 104.196.122.90
Found Yes
Hash 2553a26303ae21f833f34c6e036826d7d7d5b58500c4374f1115b89c287fe371
SimHash 6101cc40cf93

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://www.cleantechblog.com/wp-sitemap.xml