foodstraveller.com
robots.txt

Robots Exclusion Standard data for foodstraveller.com

Resource Scan

Scan Details

Site Domain foodstraveller.com
Base Domain foodstraveller.com
Scan Status Ok
Last Scan6/12/2025, 12:45:17 AM
Next Scan 6/19/2025, 12:45:17 AM

Last Scan

Scanned6/12/2025, 12:45:17 AM
URL https://foodstraveller.com/robots.txt
Domain IPs 104.21.38.37, 172.67.218.191, 2606:4700:3031::6815:2625, 2606:4700:3035::ac43:dabf
Response IP 104.21.38.37
Found Yes
Hash da87b891b3535361df0469c4894899d5fa335d2ea031853345d40be2bbed635b
SimHash 4154dc56c731

Groups

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://foodstraveller.com/sitemap.xml