poshonabudget.com
robots.txt

Robots Exclusion Standard data for poshonabudget.com

Resource Scan

Scan Details

Site Domain poshonabudget.com
Base Domain poshonabudget.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-05-08T16:26:19+00:00
Next Scan 2024-07-07T16:26:19+00:00

Last Successful Scan

Scanned2021-10-16T13:30:09+00:00
URL http://poshonabudget.com/robots.txt
Redirect https://thesugarfreediva.com/robots.txt
Redirect Domain thesugarfreediva.com
Redirect Base thesugarfreediva.com
Found Yes
Hash 997c55f1af0cbd2b9035abc693e50ccc24f8037170cc1e36370791c50b58258e
SimHash 60009a120b93

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://thesugarfreediva.com/sitemap_index.xml/