tastemade.co.uk
robots.txt

Robots Exclusion Standard data for tastemade.co.uk

Resource Scan

Scan Details

Site Domain tastemade.co.uk
Base Domain tastemade.co.uk
Scan Status Ok
Last Scan2024-05-26T21:51:39+00:00
Next Scan 2024-06-02T21:51:39+00:00

Last Scan

Scanned2024-05-26T21:51:39+00:00
URL https://tastemade.co.uk/robots.txt
Redirect https://www.tastemade.co.uk/robots.txt
Redirect Domain www.tastemade.co.uk
Redirect Base tastemade.co.uk
Domain IPs 104.18.16.210, 104.18.17.210, 2606:4700::6812:10d2, 2606:4700::6812:11d2
Redirect IPs 18.155.68.119, 18.155.68.4, 18.155.68.65, 18.155.68.70, 2600:9000:23d2:2000:c:f38a:7200:93a1, 2600:9000:23d2:2800:c:f38a:7200:93a1, 2600:9000:23d2:3e00:c:f38a:7200:93a1, 2600:9000:23d2:6c00:c:f38a:7200:93a1, 2600:9000:23d2:7400:c:f38a:7200:93a1, 2600:9000:23d2:ac00:c:f38a:7200:93a1, 2600:9000:23d2:ae00:c:f38a:7200:93a1, 2600:9000:23d2:fa00:c:f38a:7200:93a1
Response IP 18.155.68.65
Found Yes
Hash 89b2e6fce897739c974a4f4fd67b4a1c5cc9935b0bca0135f9d8a4a4780786b9
SimHash 43144944c513

Groups

*

Rule Path
Disallow /playlists/

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.tastemade.co.uk/sitemap.xml

Warnings

  • `host` is not a known field.