thecrunchgreen.com
robots.txt

Robots Exclusion Standard data for thecrunchgreen.com

Resource Scan

Scan Details

Site Domain thecrunchgreen.com
Base Domain thecrunchgreen.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-07-07T18:55:18+00:00
Next Scan 2024-10-05T18:55:18+00:00

Last Successful Scan

Scanned2022-05-29T17:21:49+00:00
URL https://thecrunchgreen.com/robots.txt
Response IP 192.0.78.239
Found Yes
Hash 4d0067635950e4b7b469cc21314d888420d478efc99f2d588bcf7ee686d218fe
SimHash 68214c4289b2

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://thecrunchgreen.com/sitemap.xml
sitemap https://thecrunchgreen.com/news-sitemap.xml