Log In Sign Up

uniconbg.com
robots.txt

Robots Exclusion Standard data for uniconbg.com

Resource Scan

Scan Details

Site Domain uniconbg.com
Base Domain uniconbg.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-06-04T22:09:47+00:00
Next Scan 2024-07-04T22:09:47+00:00

Last Successful Scan

Scanned2024-05-06T22:00:57+00:00
URL https://uniconbg.com/robots.txt
Domain IPs 104.21.89.194, 172.67.164.143, 2606:4700:3031::ac43:a48f, 2606:4700:3037::6815:59c2
Response IP 104.21.89.194
Found Yes
Hash 1d7ba732243d744f1853aebfe8b465a95c29ad330a49138b87a71834ca36d1a1
SimHash f053b91b1337

Groups

*

Rule Path
Disallow /cache/*
Disallow /components/*
Disallow /core/*
Disallow /static/*

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://uniconbg.com/sitemap
Back to top

Comments

  • www.robotstxt.org/
  • www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449
  • https://developers.google.com/search/reference/robots_txt?csw=1#url-matching-based-on-path-values
  • https://support.google.com/webmasters/answer/6080548?hl=en
  • https://www.searchenginejournal.com/technical-seo/url-parameter-handling/?amp
  • Used for many other (non-commercial) purposes as well
  • For new training only
  • Not for training, only for user requests
  • Marker for disabling Bard and Vertex AI
  • Speech synthesis only?
  • Multi-purpose, commercial uses; including LLMs
Back to top

Warnings

  • 1 invalid line.
Back to top