justfood.tv
robots.txt
Robots Exclusion Standard data for justfood.tv
Resource Scan
Scan Details
Site Domain | justfood.tv |
Base Domain | justfood.tv |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-05-27T06:35:52+00:00 |
Next Scan | 2024-07-26T06:35:52+00:00 |
Last Successful Scan
Scanned | 2023-11-30T06:33:57+00:00 |
URL | https://justfood.tv/robots.txt |
Redirect | https://www.justfood.tv/robots.txt |
Redirect Domain | www.justfood.tv |
Redirect Base | justfood.tv |
Domain IPs | 104.26.12.12, 104.26.13.12, 172.67.74.251, 2606:4700:20::681a:c0c, 2606:4700:20::681a:d0c, 2606:4700:20::ac43:4afb |
Redirect IPs | 104.26.12.12, 104.26.13.12, 172.67.74.251, 2606:4700:20::681a:c0c, 2606:4700:20::681a:d0c, 2606:4700:20::ac43:4afb |
Response IP | 172.67.74.251 |
Found | Yes |
Hash | 02837b5041dca8e203871572088b7c701c5182c8ba1dd6284f0e9dd2f2038e53 |
SimHash | 911e5404a711 |
Groups
*
Rule | Path |
---|---|
Disallow | /backoffice/ |
Disallow | /search.aspx |
Disallow | /7229/ |
Disallow | /_social_queries/ |
Disallow | /json/ |
Disallow | /nawa3emPics/ |