budgetsmadeeasy.com
robots.txt

Robots Exclusion Standard data for budgetsmadeeasy.com

Resource Scan

Scan Details

Site Domain budgetsmadeeasy.com
Base Domain budgetsmadeeasy.com
Scan Status Ok
Last Scan2025-10-23T22:58:20+00:00
Next Scan 2025-10-30T22:58:20+00:00

Last Scan

Scanned2025-10-23T22:58:20+00:00
URL https://budgetsmadeeasy.com/robots.txt
Domain IPs 104.21.42.224, 172.67.167.33, 2606:4700:3034::ac43:a721, 2606:4700:3035::6815:2ae0
Response IP 172.67.167.33
Found Yes
Hash f46606c58700e62c6ab02385656b3d5c8aafe82c2082bf553550a1271a855e2d
SimHash 60011a02abb3

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://www.budgetsmadeeasy.com/sitemap.xml
sitemap https://www.budgetsmadeeasy.com/news-sitemap.xml