Log In Sign Up

mrrebates.com
robots.txt

Robots Exclusion Standard data for mrrebates.com

Resource Scan

Scan Details

Site Domain mrrebates.com
Base Domain mrrebates.com
Scan Status Ok
Last Scan5/6/2025, 8:24:40 AM
Next Scan 6/5/2025, 8:24:40 AM

Last Scan

Scanned5/6/2025, 8:24:40 AM
URL https://mrrebates.com/robots.txt
Domain IPs 104.26.14.174, 104.26.15.174, 172.67.74.57, 2606:4700:20::681a:eae, 2606:4700:20::681a:fae, 2606:4700:20::ac43:4a39
Response IP 104.26.15.174
Found Yes
Hash a5e7755698d0794b1e724745fc207a7d651e25889f2523f9ce9edb34bdf8eadc
SimHash 4946caa01253

Groups

*

Rule Path
Disallow /amazon/
Disallow /click/
Disallow /account/
Disallow /product_research/
Disallow /categories/change_sort_preference.asp

googlebot

Rule Path
Disallow /*director
Disallow /*nw
Disallow /*add_favorite
Disallow /*tell_a_friend

slurp

Rule Path
Disallow /stores

msnbot

Rule Path
Disallow /stores

magpie-crawler

Rule Path
Disallow /
Back to top