mybudgetsherpa.com
robots.txt

Robots Exclusion Standard data for mybudgetsherpa.com

Resource Scan

Scan Details

Site Domain mybudgetsherpa.com
Base Domain mybudgetsherpa.com
Scan Status Ok
Last Scan4/10/2025, 3:00:55 PM
Next Scan 4/17/2025, 3:00:55 PM

Last Scan

Scanned4/10/2025, 3:00:55 PM
URL https://mybudgetsherpa.com/robots.txt
Domain IPs 104.21.77.96, 172.67.206.118, 2606:4700:3036::ac43:ce76, 2606:4700:3037::6815:4d60
Response IP 172.67.206.118
Found Yes
Hash efbbc826c188bebf95e1473994ca86a8f36bcf1fd4375b33050f5101b9f934a2
SimHash 0850cb02c732

Groups

*

Rule Path
Disallow /invitation

*

Rule Path
Allow /

Comments

  • Block all crawlers for /accounts
  • Allow all crawlers