teams.cloudflare.com
robots.txt

Robots Exclusion Standard data for teams.cloudflare.com

Resource Scan

Scan Details

Site Domain teams.cloudflare.com
Base Domain cloudflare.com
Scan Status Ok
Last Scan2024-05-20T06:16:21+00:00
Next Scan 2024-06-03T06:16:21+00:00

Last Scan

Scanned2024-05-20T06:16:21+00:00
URL https://teams.cloudflare.com/robots.txt
Redirect https://www.cloudflare.com/robots.txt
Redirect Domain www.cloudflare.com
Redirect Base cloudflare.com
Domain IPs 104.17.8.21, 104.17.9.21, 2606:4700::6811:815, 2606:4700::6811:915
Redirect IPs 104.16.123.96, 104.16.124.96, 2606:4700::6810:7b60, 2606:4700::6810:7c60
Response IP 104.16.124.96
Found Yes
Hash 7c67e17fa6f9527d5abd741a91a9460dbbaf7cb94fee832104f37b53e88370a7
SimHash e4402fc28b1a

Groups

twitterbot

Rule Path
Allow /lp
Allow /de-de/lp
Allow /en-au/lp
Allow /en-ca/lp
Allow /en-gb/lp
Allow /en-in/lp
Allow /es-es/lp
Allow /es-la/lp
Allow /fr-fr/lp
Allow /it-it/lp
Allow /ja-jp/lp
Allow /ko-kr/lp
Allow /pt-br/lp
Allow /zh-cn/lp
Allow /zh-tw/lp

*

Rule Path
Disallow pages.www.cloudflare.com/
Disallow en-us.www.cloudflare.com/
Disallow de-de.www.cloudflare.com/
Disallow ja-jp.www.cloudflare.com/
Disallow fr-fr.www.cloudflare.com/
Disallow en-gb.www.cloudflare.com/
Disallow en-ca.www.cloudflare.com/
Disallow en-au.www.cloudflare.com/
Disallow en-in.www.cloudflare.com/
Disallow es-es.www.cloudflare.com/
Disallow it-it.www.cloudflare.com/
Disallow ko-kr.www.cloudflare.com/
Disallow pt-br.www.cloudflare.com/
Disallow zh-cn.www.cloudflare.com/
Disallow zh-tw.www.cloudflare.com/
Disallow nl-nl.www.cloudflare.com/
Disallow id-id.www.cloudflare.com/
Disallow th-th.www.cloudflare.com/
Disallow ru-ru.www.cloudflare.com/
Disallow sv-se.www.cloudflare.com/
Disallow vi-vn.www.cloudflare.com/
Disallow tr-tr.www.cloudflare.com/
Disallow zh-hans-cn.www.cloudflare.com/
Disallow pl-pl.www.cloudflare.com/
Disallow el-gr.www.cloudflare.com/
Disallow nb-no.www.cloudflare.com/
Disallow /cdn-cgi/
Disallow /lp
Disallow /de-de/lp
Disallow /en-au/lp
Disallow /en-ca/lp
Disallow /en-gb/lp
Disallow /en-in/lp
Disallow /es-es/lp
Disallow /es-la/lp
Disallow /fr-fr/lp
Disallow /it-it/lp
Disallow /ja-jp/lp
Disallow /ko-kr/lp
Disallow /pt-br/lp
Disallow /zh-cn/lp
Disallow /zh-tw/lp
Disallow /feedback
Disallow /de-de/feedback
Disallow /en-au/feedback
Disallow /en-ca/feedback
Disallow /en-gb/feedback
Disallow /en-in/feedback
Disallow /es-es/feedback
Disallow /es-la/feedback
Disallow /fr-fr/feedback
Disallow /it-it/feedback
Disallow /ja-jp/feedback
Disallow /ko-kr/feedback
Disallow /pt-br/feedback
Disallow /zh-cn/feedback
Disallow /zh-tw/feedback

Other Records

Field Value
sitemap https://www.cloudflare.com/sitemap.xml
sitemap https://www.cloudflare.com/de-de/sitemap.xml
sitemap https://www.cloudflare.com/en-au/sitemap.xml
sitemap https://www.cloudflare.com/en-ca/sitemap.xml
sitemap https://www.cloudflare.com/en-gb/sitemap.xml
sitemap https://www.cloudflare.com/en-in/sitemap.xml
sitemap https://www.cloudflare.com/es-es/sitemap.xml
sitemap https://www.cloudflare.com/es-la/sitemap.xml
sitemap https://www.cloudflare.com/fr-fr/sitemap.xml
sitemap https://www.cloudflare.com/it-it/sitemap.xml
sitemap https://www.cloudflare.com/ja-jp/sitemap.xml
sitemap https://www.cloudflare.com/ko-kr/sitemap.xml
sitemap https://www.cloudflare.com/pt-br/sitemap.xml
sitemap https://www.cloudflare.com/zh-cn/sitemap.xml
sitemap https://www.cloudflare.com/zh-tw/sitemap.xml

Comments

  • .__________________________.
  • | .___________________. |==|
  • | | ................. | | |
  • | | ::[ Dear robot ]: | | |
  • | | ::::[ be nice ]:: | | |
  • | | ::::::::::::::::: | | |
  • | | ::::::::::::::::: | | |
  • | | ::::::::::::::::: | | |
  • | | ::::::::::::::::: | | ,|
  • | !___________________! |(c|
  • !_______________________!__!
  • / \
  • / [][][][][][][][][][][][][] \
  • / [][][][][][][][][][][][][][] \
  • ( [][][][][____________][][][][] )
  • \ ------------------------------ /
  • \______________________________/
  • _-_
  • /~~ ~~\
  • /~~ ~~\
  • { }
  • \ _- -_ /
  • ~ \\ // ~
  • _- - | | _- _
  • _ - | | -_
  • // \\
  • OUR TREE IS A REDWOOD
  • allow TwitterBot to crawl lp
  • pages testing
  • cdn-cgi
  • lp
  • feedback
  • ________
  • __,_, | |
  • [_|_/ | OK |
  • // |________|
  • _// __ /
  • (_|) |@@|
  • \ \__ \--/ __
  • \o__|----| | __
  • \ }{ /\ )_ / _\
  • /\__/\ \__O (__
  • (--/\--) \__/
  • _)( )(_
  • `---''---`