cheapthriftyliving.com
robots.txt

Robots Exclusion Standard data for cheapthriftyliving.com

Resource Scan

Scan Details

Site Domain cheapthriftyliving.com
Base Domain cheapthriftyliving.com
Scan Status Ok
Last Scan2024-09-27T16:06:18+00:00
Next Scan 2024-10-04T16:06:18+00:00

Last Scan

Scanned2024-09-27T16:06:18+00:00
URL https://cheapthriftyliving.com/robots.txt
Redirect https://www.cheapthriftyliving.com/robots.txt
Redirect Domain www.cheapthriftyliving.com
Redirect Base cheapthriftyliving.com
Domain IPs 18.161.111.23, 18.161.111.33, 18.161.111.95, 18.161.111.98
Redirect IPs 18.161.111.23, 18.161.111.33, 18.161.111.95, 18.161.111.98
Response IP 108.156.22.25
Found Yes
Hash de404aaac8ad43606e379366107d3ea427ae6d303e8cc16c04679de7ea567c32
SimHash 61149c42c391

Groups

*

Rule Path
Disallow /admin/
Disallow /site_admin/
Disallow /primeads/
Disallow /preview_article/

pinterest

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.cheapthriftyliving.com/www.cheapthriftyliving.com.xml