hollywoodfeed.com
robots.txt
Robots Exclusion Standard data for hollywoodfeed.com
Resource Scan
Scan Details
| Site Domain | hollywoodfeed.com |
| Base Domain | hollywoodfeed.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-07-31T04:46:15+00:00 |
| Next Scan | 2024-10-29T04:46:15+00:00 |
Last Successful Scan
| Scanned | 2022-12-12T17:49:51+00:00 |
| URL | https://hollywoodfeed.com/robots.txt |
| Redirect | http://www.hollywoodfeed.com/robots.txt |
| Redirect Domain | www.hollywoodfeed.com |
| Redirect Base | hollywoodfeed.com |
| Domain IPs | 104.18.14.187, 104.18.15.187, 2606:4700::6812:ebb, 2606:4700::6812:fbb |
| Redirect IPs | 104.18.14.187, 104.18.15.187, 2606:4700::6812:ebb, 2606:4700::6812:fbb |
| Response IP | 104.18.15.187 |
| Found | Yes |
| Hash | 547edb41e7c8c7baf9c30d17a9e0f431aaccdc16ad31b25be8ac6b367ead99d5 |
| SimHash | 33e64af8ca2b |
Groups
etaospider
yandex
moget
ichiro
naverbot
yeti
baiduspider
baiduspider-video
baiduspider-image
sogou spider
youdaobot
ahrefsbot
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /rel/ |
| Disallow | /dev/ |
| Disallow | /search/ |
| Disallow | /search |
| Disallow | /availability/ |
| Disallow | /scripts/ |
| Disallow | /bin/ |
| Disallow | /content/files/ |
| Disallow | /install |
| Disallow | /compareproducts |
| Disallow | /clearcomparelist |
| Disallow | /login |
| Disallow | /logout |
| Disallow | /cart |
| Disallow | /wishlist |
| Disallow | /emailwishlist |
| Disallow | /checkout |
| Disallow | /onepagecheckout |
| Disallow | /checkout/shippingaddress |
| Disallow | /checkout/billingaddress |
| Disallow | /checkout/shippingmethod |
| Disallow | /checkout/paymentmethod |
| Disallow | /checkout/paymentinfo |
| Disallow | /checkout/confirm |
| Disallow | /checkout/completed |
| Disallow | /orderdetails |
| Disallow | /returnrequest |
| Disallow | /passwordrecovery/confirm |
| Disallow | /newsletter/subscriptionactivation |
| Disallow | /customer/activation |
| Disallow | /customer/forumsubscriptions |
| Disallow | /emailwishlist |
| Disallow | /boards/postedit |
| Disallow | /boards/postdelete |
| Disallow | /boards/postcreate |
| Disallow | /boards/topicedit |
| Disallow | /boards/topicdelete |
| Disallow | /boards/topiccreate |
| Disallow | /boards/topicmove |
| Disallow | /boards/topicwatch |
| Disallow | /boards/forumwatch |
| Disallow | /privatemessages |
| Disallow | /inboxupdate |
| Disallow | /sentupdate |
| Disallow | /sendpm |
| Disallow | /viewpm |
| Disallow | /deletepm |
| Disallow | /search/artistid |
| Disallow | /content/community-partner-terms |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.hollywoodfeed.com/sitemapindex.xml |