pt.news.foodtalkdaily.com
robots.txt
Robots Exclusion Standard data for pt.news.foodtalkdaily.com
Resource Scan
Scan Details
| Site Domain | pt.news.foodtalkdaily.com |
| Base Domain | foodtalkdaily.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-04-01T04:35:00+00:00 |
| Next Scan | 2024-06-30T04:35:00+00:00 |
Last Successful Scan
| Scanned | 2023-12-04T02:12:31+00:00 |
| URL | https://pt.news.foodtalkdaily.com/robots.txt |
| Domain IPs | 104.22.26.137, 104.22.27.137, 172.67.40.72, 2606:4700:10::6816:1a89, 2606:4700:10::6816:1b89, 2606:4700:10::ac43:2848 |
| Response IP | 104.22.26.137 |
| Found | Yes |
| Hash | b9bcaa297ba19d06ed98602190284212c8127bda86e7ee4b7123324394a67568 |
| SimHash | 61441960c711 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.news.foodtalkdaily.com/sitemap.xml |