nutritioncrawler.com
robots.txt

Robots Exclusion Standard data for nutritioncrawler.com

Resource Scan

Scan Details

Site Domain nutritioncrawler.com
Base Domain nutritioncrawler.com
Scan Status Ok
Last Scan6/8/2025, 6:33:49 PM
Next Scan 7/8/2025, 6:33:49 PM

Last Scan

Scanned6/8/2025, 6:33:49 PM
URL https://nutritioncrawler.com/robots.txt
Redirect https://www.nutritioncrawler.com/robots.txt
Redirect Domain www.nutritioncrawler.com
Redirect Base nutritioncrawler.com
Domain IPs 118.139.176.36
Redirect IPs 118.139.176.36
Response IP 118.139.176.36
Found Yes
Hash 6bb4b8e1865e871b19a3a8b87b5690f83b79ad63d5b7d5c427130b5a4382a333
SimHash 6100cc408db2

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://www.nutritioncrawler.com/wp-sitemap.xml