dealcatcher.com
robots.txt
Robots Exclusion Standard data for dealcatcher.com
Resource Scan
Scan Details
| Site Domain | dealcatcher.com |
| Base Domain | dealcatcher.com |
| Scan Status | Ok |
| Last Scan | 2024-09-15T22:35:27+00:00 |
| Next Scan | 2024-09-22T22:35:27+00:00 |
Last Scan
| Scanned | 2024-09-15T22:35:27+00:00 |
| URL | https://dealcatcher.com/robots.txt |
| Redirect | https://www.dealcatcher.com/robots.txt |
| Redirect Domain | www.dealcatcher.com |
| Redirect Base | dealcatcher.com |
| Domain IPs | 104.26.14.136, 104.26.15.136, 172.67.73.125, 2606:4700:20::681a:e88, 2606:4700:20::681a:f88, 2606:4700:20::ac43:497d |
| Redirect IPs | 104.26.14.136, 104.26.15.136, 172.67.73.125, 2606:4700:20::681a:e88, 2606:4700:20::681a:f88, 2606:4700:20::ac43:497d |
| Response IP | 104.26.15.136 |
| Found | Yes |
| Hash | 398115dd1bbc317c5d4b4229f75988d5f163db19d9aceb166677a8d7b70307c6 |
| SimHash | 7a55d3600f11 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /news.asp |
| Disallow | /m/ |
| Disallow | /*sort/recent |
| Disallow | /*sort/new |
| Disallow | /*sort/price_low |
| Disallow | /*sort/price_high |
| Disallow | /*alert_popup_helper |
| Disallow | /redirect_restaurant |
| Disallow | /redirect_local |
| Disallow | /do/deals/local_division |
| Disallow | /do/deals/send_a_deal |
| Disallow | /do/deals/redirect_merchant_outbound |
| Disallow | /do/deals/coupons_by_merchant |
| Disallow | /do/alerts/confirm_alert |
| Disallow | /*/134* |
| Disallow | /popped_deal/ |
| Disallow | /load-more-content* |
| Disallow | /merchant-id/* |
| Disallow | /deal-alert/* |
| Disallow | /donotvisit |
| Disallow | /search |
| Disallow | /_nuxt |
| Disallow | /~partytown |
| Disallow | /redir |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.dealcatcher.com/sitemap.xml |
Warnings
- 2 invalid lines.