Log In Sign Up

digitalk.bg
robots.txt

Robots Exclusion Standard data for digitalk.bg

Resource Scan

Scan Details

Site Domain digitalk.bg
Base Domain digitalk.bg
Scan Status Ok
Last Scan2024-06-08T08:05:56+00:00
Next Scan 2024-06-15T08:05:56+00:00

Last Scan

Scanned2024-06-08T08:05:56+00:00
URL https://digitalk.bg/robots.txt
Domain IPs 104.26.2.43, 104.26.3.43, 172.67.75.49, 2606:4700:20::681a:22b, 2606:4700:20::681a:32b, 2606:4700:20::ac43:4b31
Response IP 104.26.3.43
Found Yes
Hash e4ae2849954ed66debee3351574b7ceb1f06832316f4a91f28011b36206b1f4f
SimHash f059911e5537

Groups

*

Rule Path
Disallow /showimg/

*

Rule Path
Disallow /events/archive/

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://digitalk.bg/digitalk_all0.xml
Back to top

Comments

  • https://www.robotstxt.org/
  • https://support.google.com/webmasters/answer/6062608
  • Used for many other (non-commercial) purposes as well
  • For new training only
  • Not for training, only for user requests
  • Marker for disabling Bard and Vertex AI
  • Speech synthesis only?
  • Multi-purpose, commercial uses; including LLMs
Back to top