Log In Sign Up

teams.one
robots.txt

Robots Exclusion Standard data for teams.one

Resource Scan

Scan Details

Site Domain teams.one
Base Domain teams.one
Scan Status Ok
Last Scan2024-11-01T05:50:56+00:00
Next Scan 2024-11-08T05:50:56+00:00

Last Scan

Scanned2024-11-01T05:50:56+00:00
URL https://teams.one/robots.txt
Domain IPs 18.180.56.115, 3.112.160.48, 35.72.156.1
Response IP 35.72.156.1
Found Yes
Hash 26ebd2cd483cfe898e3ff3cbb711907fb8c25d67b0e4800ae6cc2b1e73ed5094
SimHash da8c4dc27230

Groups

*
twitterbot

Rule Path
Allow *

baiduspider

Rule Path
Disallow /

yeti

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

steeler

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

wotbox

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://teams.one/sitemap.xml
Back to top

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • User-agent: *
  • Disallow: /
Back to top

Warnings

  • 2 invalid lines.
Back to top