howtodobest.com
robots.txt

Robots Exclusion Standard data for howtodobest.com

Resource Scan

Scan Details

Site Domain howtodobest.com
Base Domain howtodobest.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-07-07T13:02:16+00:00
Next Scan 2025-10-05T13:02:16+00:00

Last Successful Scan

Scanned2023-12-16T12:38:39+00:00
URL https://howtodobest.com/robots.txt
Domain IPs 104.21.18.92, 172.67.181.136, 2606:4700:3031::6815:125c, 2606:4700:3036::ac43:b588
Response IP 172.67.181.136
Found Yes
Hash 33bf825d65f2f027a560a9a1d790c07b75a5a6a7d1dd616425f3f588da1ca601
SimHash 690098400db2

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://howtodobest.com/sitemap_index.xml