godare.se
robots.txt

Robots Exclusion Standard data for godare.se

Resource Scan

Scan Details

Site Domain godare.se
Base Domain godare.se
Scan Status Ok
Last Scan2024-05-14T00:39:55+00:00
Next Scan 2024-05-21T00:39:55+00:00

Last Scan

Scanned2024-05-14T00:39:55+00:00
URL https://godare.se/robots.txt
Redirect https://www.godare.se/robots.txt
Redirect Domain www.godare.se
Redirect Base godare.se
Domain IPs 108.157.254.109, 108.157.254.125, 108.157.254.126, 108.157.254.6, 2600:9000:2753:5200:e:874f:cb40:93a1, 2600:9000:2753:5c00:e:874f:cb40:93a1, 2600:9000:2753:8800:e:874f:cb40:93a1, 2600:9000:2753:9800:e:874f:cb40:93a1, 2600:9000:2753:c400:e:874f:cb40:93a1, 2600:9000:2753:dc00:e:874f:cb40:93a1, 2600:9000:2753:e200:e:874f:cb40:93a1, 2600:9000:2753:fe00:e:874f:cb40:93a1
Redirect IPs 108.157.254.109, 108.157.254.125, 108.157.254.126, 108.157.254.6
Response IP 108.157.254.109
Found Yes
Hash 5afd98751a2d459cdce7ffa6a2aa80b5a872e5b1eef524b96a44eddb8cf02ab5
SimHash a058910ca733

Groups

*

Rule Path
Disallow /recept/test

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.godare.se/sitemap.xml

Comments

  • AI crawler bots
  • Not for training, only for user requests
  • Marker for disabling Bard and Vertex AI
  • Speech synthesis only?
  • Multi-purpose, commercial uses; including LLMs