dealcatcher.com
robots.txt
Robots Exclusion Standard data for dealcatcher.com
Resource Scan
Scan Details
Site Domain | dealcatcher.com |
Base Domain | dealcatcher.com |
Scan Status | Ok |
Last Scan | 2024-11-11T03:51:35+00:00 |
Next Scan | 2024-11-18T03:51:35+00:00 |
Last Scan
Scanned | 2024-11-11T03:51:35+00:00 |
URL | https://dealcatcher.com/robots.txt |
Redirect | https://www.dealcatcher.com/robots.txt |
Redirect Domain | www.dealcatcher.com |
Redirect Base | dealcatcher.com |
Domain IPs | 104.26.14.136, 104.26.15.136, 172.67.73.125, 2606:4700:20::681a:e88, 2606:4700:20::681a:f88, 2606:4700:20::ac43:497d |
Redirect IPs | 104.26.14.136, 104.26.15.136, 172.67.73.125, 2606:4700:20::681a:e88, 2606:4700:20::681a:f88, 2606:4700:20::ac43:497d |
Response IP | 172.67.73.125 |
Found | Yes |
Hash | 398115dd1bbc317c5d4b4229f75988d5f163db19d9aceb166677a8d7b70307c6 |
SimHash | 7a55d3600f11 |
Groups
*
Rule | Path |
---|---|
Disallow | /news.asp |
Disallow | /m/ |
Disallow | /*sort/recent |
Disallow | /*sort/new |
Disallow | /*sort/price_low |
Disallow | /*sort/price_high |
Disallow | /*alert_popup_helper |
Disallow | /redirect_restaurant |
Disallow | /redirect_local |
Disallow | /do/deals/local_division |
Disallow | /do/deals/send_a_deal |
Disallow | /do/deals/redirect_merchant_outbound |
Disallow | /do/deals/coupons_by_merchant |
Disallow | /do/alerts/confirm_alert |
Disallow | /*/134* |
Disallow | /popped_deal/ |
Disallow | /load-more-content* |
Disallow | /merchant-id/* |
Disallow | /deal-alert/* |
Disallow | /donotvisit |
Disallow | /search |
Disallow | /_nuxt |
Disallow | /~partytown |
Disallow | /redir |
Other Records
Field | Value |
---|---|
sitemap | https://www.dealcatcher.com/sitemap.xml |
Warnings
- 2 invalid lines.