livecrafteat.com
robots.txt

Robots Exclusion Standard data for livecrafteat.com

Resource Scan

Scan Details

Site Domain livecrafteat.com
Base Domain livecrafteat.com
Scan Status Ok
Last Scan2024-06-12T02:27:18+00:00
Next Scan 2024-06-19T02:27:18+00:00

Last Scan

Scanned2024-06-12T02:27:18+00:00
URL https://livecrafteat.com/robots.txt
Domain IPs 104.21.5.16, 172.67.132.188, 2606:4700:3034::ac43:84bc, 2606:4700:3035::6815:510
Response IP 172.67.132.188
Found Yes
Hash 9b60c266dfb42e5a3160d2c23e50f38d8da35e58d2af0c2a74dc83c21e587868
SimHash 400598640112

Groups

*

Rule Path
Disallow /cgi-bin

googlebot

Rule Path
Allow .js
Allow .css

mediapartners-google

Rule Path
Disallow

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.livecrafteat.com/sitemap_index.xml