redeemtv.com
robots.txt

Robots Exclusion Standard data for redeemtv.com

Resource Scan

Scan Details

Site Domain redeemtv.com
Base Domain redeemtv.com
Scan Status Ok
Last Scan2025-05-19T03:52:06+00:00
Next Scan 2025-06-18T03:52:06+00:00

Last Scan

Scanned2025-05-19T03:52:06+00:00
URL https://redeemtv.com/robots.txt
Domain IPs 45.79.141.237
Response IP 45.79.141.237
Found Yes
Hash 0d1ea33bff904d110ccd56c97720a9cdc4976715626cc8a8afe11a6040099607
SimHash c67f12b6cb43

Groups

googlebot

Rule Path
Disallow /cart
Disallow /cart/
Disallow /wishlist
Disallow /wishlist/
Disallow /checkout
Disallow /checkout/
Disallow /buynow/account
Disallow /buynow/account/
Disallow /buynow
Disallow /buynow/
Disallow /reset
Disallow /reset/
Disallow /register
Disallow /register/
Disallow /account
Disallow /account/

slurp

Rule Path
Disallow /cart
Disallow /cart/
Disallow /wishlist
Disallow /wishlist/
Disallow /checkout
Disallow /checkout/
Disallow /buynow/account
Disallow /buynow/account/
Disallow /buynow
Disallow /buynow/
Disallow /reset
Disallow /reset/
Disallow /register
Disallow /register/
Disallow /account
Disallow /account/

Other Records

Field Value
crawl-delay 5

bingbot

Rule Path
Disallow /cart
Disallow /cart/
Disallow /wishlist
Disallow /wishlist/
Disallow /checkout
Disallow /checkout/
Disallow /buynow/account
Disallow /buynow/account/
Disallow /buynow
Disallow /buynow/
Disallow /reset
Disallow /reset/
Disallow /register
Disallow /register/
Disallow /account
Disallow /account/

Other Records

Field Value
crawl-delay 5

baiduspider

Rule Path
Disallow /cart
Disallow /cart/
Disallow /wishlist
Disallow /wishlist/
Disallow /checkout
Disallow /checkout/
Disallow /buynow/account
Disallow /buynow/account/
Disallow /buynow
Disallow /buynow/
Disallow /reset
Disallow /reset/
Disallow /register
Disallow /register/
Disallow /account
Disallow /account/

Other Records

Field Value
crawl-delay 5

yandex

Rule Path
Disallow /cart
Disallow /cart/
Disallow /wishlist
Disallow /wishlist/
Disallow /checkout
Disallow /checkout/
Disallow /buynow/account
Disallow /buynow/account/
Disallow /buynow
Disallow /buynow/
Disallow /reset
Disallow /reset/
Disallow /register
Disallow /register/
Disallow /account
Disallow /account/

Other Records

Field Value
crawl-delay 5

msiecrawler

Rule Path
Disallow /

sitesucker

Rule Path
Disallow /

winhttp

Rule Path
Disallow /

httrack

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

facebookexternalhit

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

instagram

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

meta

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

amazonbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

*

Rule Path
Disallow /cart
Disallow /cart/
Disallow /wishlist
Disallow /wishlist/
Disallow /checkout
Disallow /checkout/
Disallow /buynow/account
Disallow /buynow/account/
Disallow /buynow
Disallow /buynow/
Disallow /reset
Disallow /reset/
Disallow /register
Disallow /register/
Disallow /account
Disallow /account/

Other Records

Field Value
crawl-delay 1