riverbender.com
robots.txt
Robots Exclusion Standard data for riverbender.com
Resource Scan
Scan Details
| Site Domain | riverbender.com |
| Base Domain | riverbender.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-10-24T00:48:12+00:00 |
| Next Scan | 2025-01-22T00:48:12+00:00 |
Last Successful Scan
| Scanned | 2024-06-27T00:44:49+00:00 |
| URL | https://riverbender.com/robots.txt |
| Redirect | https://www.riverbender.com/robots.txt |
| Redirect Domain | www.riverbender.com |
| Redirect Base | riverbender.com |
| Domain IPs | 104.26.2.242, 104.26.3.242, 172.67.74.92, 2606:4700:20::681a:2f2, 2606:4700:20::681a:3f2, 2606:4700:20::ac43:4a5c |
| Redirect IPs | 104.26.2.242, 104.26.3.242, 172.67.74.92, 2606:4700:20::681a:2f2, 2606:4700:20::681a:3f2, 2606:4700:20::ac43:4a5c |
| Response IP | 104.26.3.242 |
| Found | Yes |
| Hash | 0dc952aedae64122545f9d1102edc64dfa89d6291a39de166723117bb4d514c7 |
| SimHash | e40c8e203b0a |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /video/embed/ |
| Disallow | /mobile/ |
| Disallow | /CGI-BIN/ |
| Disallow | /chat/ |
| Disallow | /dailyupdate/ |
| Disallow | /weeklyupdate/ |
| Disallow | /results.cfm |
| Disallow | /weather/weatherpod.cfm |
| Disallow | /shared/inc/globaleventspdf.cfm |
| Disallow | /directory/search.cfm |
| Disallow | /classifieds/nonpayshowlike.cfm |
| Disallow | /classifieds/emailfriend.cfm |
| Disallow | /classifieds/emailad.cfm |
| Disallow | /classifieds/adprint.cfm |
| Disallow | /finance/finance_widget.cfm |
| Disallow | /shopping/site/send-to-friend.cfm |
| Disallow | /finance/finance_homepage.cfm |
| Disallow | /articles/ajaxtracker.cfm |
| Disallow | /video/ajaxtracker.cfm |
| Disallow | /drawing/ |
| Disallow | /emailadmin/ |
| Disallow | /newconstruction/ |
| Disallow | /answers/ |
| Disallow | /api/ |
| Disallow | /apNewsImages/ |
| Disallow | /apps/ |
| Disallow | /deal/ |
| Disallow | /deals/ |
| Disallow | /movietheaters/ |
| Disallow | /movies/ |
| Disallow | /maps/ |
| Disallow | /prizes/ |
| Disallow | /marketing/ |
| Disallow | /linkout/ |
| Disallow | /search/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.riverbender.com/sitemap.xml |
| sitemap | https://www.riverbender.com/articlessitemap.xml |
| sitemap | https://www.riverbender.com/articlessitemap1.xml |
| sitemap | https://www.riverbender.com/articlessitemap2.xml |
| sitemap | https://www.riverbender.com/articlessitemap3.xml |
| sitemap | https://www.riverbender.com/videositemap.xml |
| sitemap | https://www.riverbender.com/classifiedsitemap.xml |
| sitemap | https://www.riverbender.com/realestatesitemap.xml |
| sitemap | https://www.riverbender.com/obitssitemap.xml |
| sitemap | https://www.riverbender.com/obitssitemap1.xml |
| sitemap | https://www.riverbender.com/directorysitemap.xml |
| sitemap | https://www.riverbender.com/eventssitemap.xml |