thebestwebsitebuildersonline.com
robots.txt

Robots Exclusion Standard data for thebestwebsitebuildersonline.com

Resource Scan

Scan Details

Site Domain thebestwebsitebuildersonline.com
Base Domain thebestwebsitebuildersonline.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-10T00:08:33+00:00
Next Scan 2024-11-08T00:08:33+00:00

Last Successful Scan

Scanned2022-09-21T08:36:39+00:00
URL https://thebestwebsitebuildersonline.com/robots.txt
Response IP 192.0.78.24
Found Yes
Hash e5b69c64a794f9f7c26fcea52ec20344afe8bf141a7f50b088cdfc3761e1b750
SimHash 69204800efb2

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://thebestwebsitebuildersonline.com/sitemap.xml
sitemap https://thebestwebsitebuildersonline.com/news-sitemap.xml