recipehub.com
robots.txt
Robots Exclusion Standard data for recipehub.com
Resource Scan
Scan Details
| Site Domain | recipehub.com |
| Base Domain | recipehub.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a server error. |
| Last Scan | 2025-12-08T15:34:34+00:00 |
| Next Scan | 2026-03-08T15:34:34+00:00 |
Last Successful Scan
| Scanned | 2024-07-23T16:32:54+00:00 |
| URL | https://recipehub.com/robots.txt |
| Redirect | http://www.recipehub.com/robots.txt |
| Redirect Domain | www.recipehub.com |
| Redirect Base | recipehub.com |
| Domain IPs | 104.21.53.196, 172.67.217.249, 2606:4700:3031::ac43:d9f9, 2606:4700:3033::6815:35c4 |
| Redirect IPs | 104.21.53.196, 172.67.217.249, 2606:4700:3031::ac43:d9f9, 2606:4700:3033::6815:35c4 |
| Response IP | 172.67.217.249 |
| Found | Yes |
| Hash | e22c50c0c32afd022f4de4afe668b656f78f923fe5c6a40fdce54cdc3b27c14d |
| SimHash | 312ad80e2f30 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /news/wp-admin/ |
| Disallow | /news/wp-includes/ |
| Disallow | /news/cgi-bin |
| Disallow | /news/wp-admin |
| Disallow | /news/wp-includes |
| Disallow | /news/wp-content/plugins |
| Disallow | /news/plugins |
| Disallow | /news/wp-content/cache |
| Disallow | /news/wp-content/themes |
| Disallow | /news/trackback |
| Disallow | /news/feed |
| Disallow | /news/comments |
| Disallow | /yaml/ |
| Disallow | /test/ |
| Disallow | /sql/ |
| Disallow | /simplepie/ |
| Disallow | /scopbin/ |
| Disallow | /rssbox/ |
| Disallow | /prettyPhoto/ |
| Disallow | /offline/ |
| Disallow | /nyroModal-1.6.2/ |
| Disallow | /includes/ |
| Disallow | /images/ |
| Disallow | /galleriffic-2.0/ |
| Disallow | /flickr/ |
| Disallow | /cache/ |