tastemade.fr
robots.txt

Robots Exclusion Standard data for tastemade.fr

Resource Scan

Scan Details

Site Domain tastemade.fr
Base Domain tastemade.fr
Scan Status Ok
Last Scan2024-05-29T03:34:55+00:00
Next Scan 2024-06-05T03:34:55+00:00

Last Scan

Scanned2024-05-29T03:34:55+00:00
URL https://tastemade.fr/robots.txt
Redirect https://www.tastemade.fr/robots.txt
Redirect Domain www.tastemade.fr
Redirect Base tastemade.fr
Domain IPs 104.18.28.221, 104.18.29.221, 2606:4700::6812:1cdd, 2606:4700::6812:1ddd
Redirect IPs 13.35.18.113, 13.35.18.118, 13.35.18.36, 13.35.18.57, 2600:9000:20c7:1200:e:5f78:c6c0:93a1, 2600:9000:20c7:1800:e:5f78:c6c0:93a1, 2600:9000:20c7:8400:e:5f78:c6c0:93a1, 2600:9000:20c7:9000:e:5f78:c6c0:93a1, 2600:9000:20c7:9200:e:5f78:c6c0:93a1, 2600:9000:20c7:b800:e:5f78:c6c0:93a1, 2600:9000:20c7:d200:e:5f78:c6c0:93a1, 2600:9000:20c7:e800:e:5f78:c6c0:93a1
Response IP 13.35.18.57
Found Yes
Hash 50e658563dc89e176901819ca855d7c7ab505003a168f863c12ac4b37f720537
SimHash 01144840c1b1

Groups

*

Rule Path
Disallow /playlists/

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.tastemade.fr/sitemap.xml

Warnings

  • `host` is not a known field.