dealcatcher.com
robots.txt

Robots Exclusion Standard data for dealcatcher.com

Resource Scan

Scan Details

Site Domain dealcatcher.com
Base Domain dealcatcher.com
Scan Status Ok
Last Scan2024-11-11T03:51:35+00:00
Next Scan 2024-11-18T03:51:35+00:00

Last Scan

Scanned2024-11-11T03:51:35+00:00
URL https://dealcatcher.com/robots.txt
Redirect https://www.dealcatcher.com/robots.txt
Redirect Domain www.dealcatcher.com
Redirect Base dealcatcher.com
Domain IPs 104.26.14.136, 104.26.15.136, 172.67.73.125, 2606:4700:20::681a:e88, 2606:4700:20::681a:f88, 2606:4700:20::ac43:497d
Redirect IPs 104.26.14.136, 104.26.15.136, 172.67.73.125, 2606:4700:20::681a:e88, 2606:4700:20::681a:f88, 2606:4700:20::ac43:497d
Response IP 172.67.73.125
Found Yes
Hash 398115dd1bbc317c5d4b4229f75988d5f163db19d9aceb166677a8d7b70307c6
SimHash 7a55d3600f11

Groups

*

Rule Path
Disallow /news.asp
Disallow /m/
Disallow /*sort/recent
Disallow /*sort/new
Disallow /*sort/price_low
Disallow /*sort/price_high
Disallow /*alert_popup_helper
Disallow /redirect_restaurant
Disallow /redirect_local
Disallow /do/deals/local_division
Disallow /do/deals/send_a_deal
Disallow /do/deals/redirect_merchant_outbound
Disallow /do/deals/coupons_by_merchant
Disallow /do/alerts/confirm_alert
Disallow /*/134*
Disallow /popped_deal/
Disallow /load-more-content*
Disallow /merchant-id/*
Disallow /deal-alert/*
Disallow /donotvisit
Disallow /search
Disallow /_nuxt
Disallow /~partytown
Disallow /redir

mediapartners-google

Rule Path
Allow /

cjnetworkquality

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

stratagems kumo

Rule Path
Disallow /

linkwalker

Rule Path
Disallow /

mediatoolkitbot

Rule Path
Disallow /

vegi bot

Rule Path
Disallow /

naver

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /search

sogou spider

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.dealcatcher.com/sitemap.xml

Warnings

  • 2 invalid lines.