recipezaar.com
robots.txt
Robots Exclusion Standard data for recipezaar.com
Resource Scan
Scan Details
Site Domain | recipezaar.com |
Base Domain | recipezaar.com |
Scan Status | Failed |
Failure Reason | Scan timed out. |
Last Scan | 2024-10-05T22:02:56+00:00 |
Next Scan | 2025-01-03T22:02:56+00:00 |
Last Successful Scan
Scanned | 2022-06-05T00:42:12+00:00 |
URL | http://recipezaar.com/robots.txt |
Redirect | https://www.food.com/robots.txt |
Redirect Domain | www.food.com |
Redirect Base | food.com |
Response IP | 23.36.48.71 |
Found | Yes |
Hash | 0cef92a6f155585fb4f2ac00a20f570a8fbc8b0895db27ccc6ecc7ea59be4d62 |
SimHash | 402258c64539 |
Groups
*
Rule | Path |
---|---|
Disallow | /recipeprint.do* |
Disallow | /rssapi.do* |
Disallow | /bb/ |
Disallow | /null/ |
Disallow | /members/subm/ |
Disallow | /mail/compose* |
Disallow | /cp_asset_stats.do |
Disallow | /dpn.do* |
Disallow | /mobile/api/ |
Disallow | /ingredient-finder/ |
Disallow | /cookbook-finder/ |
Disallow | /menu-finder/ |
Disallow | /recipe-finder/ |
Disallow | /photo-finder/ |
Disallow | /member-finder/ |
Disallow | /search/ |
Disallow | /books/ |
Disallow | /community/ |
Disallow | *.zsp* |
Disallow | *.php* |
Disallow | /~asset* |
Other Records
Field | Value |
---|---|
sitemap | https://www.food.com/sitemap.xml |
sitemap | https://www.food.com/news/news-sitemap.xml |
Warnings
- 2 invalid lines.
Comments