Log In Sign Up

teams.one
robots.txt

Robots Exclusion Standard data for teams.one

Resource Scan

Scan Details

Site Domain teams.one
Base Domain teams.one
Scan Status Ok
Last Scan2024-09-27T01:39:37+00:00
Next Scan 2024-10-04T01:39:37+00:00

Last Scan

Scanned2024-09-27T01:39:37+00:00
URL https://teams.one/robots.txt
Domain IPs 43.206.202.92, 52.195.239.60, 57.180.95.135
Response IP 43.206.202.92
Found Yes
Hash 26ebd2cd483cfe898e3ff3cbb711907fb8c25d67b0e4800ae6cc2b1e73ed5094
SimHash da8c4dc27230

Groups

*
twitterbot

Rule Path
Allow *

baiduspider

Rule Path
Disallow /

yeti

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

steeler

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

wotbox

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://teams.one/sitemap.xml
Back to top

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • User-agent: *
  • Disallow: /
Back to top

Warnings

  • 2 invalid lines.
Back to top