Log In Sign Up

cargooffice.com
robots.txt

Robots Exclusion Standard data for cargooffice.com

Resource Scan

Scan Details

Site Domain cargooffice.com
Base Domain cargooffice.com
Scan Status Ok
Last Scan2024-09-20T13:14:00+00:00
Next Scan 2024-10-20T13:14:00+00:00

Last Scan

Scanned2024-09-20T13:14:00+00:00
URL https://cargooffice.com/robots.txt
Domain IPs 35.204.169.189
Response IP 35.204.169.189
Found Yes
Hash af09cc7d68c585333e332cbca5f024363cebeca0113497799fdbb421d0faf26f
SimHash 925c0c2379d6

Groups

ahrefsbot

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

datanyze

Rule Path
Disallow /

dataprovider

Rule Path
Disallow /

dataprovider.com

Rule Path
Disallow /

domaincrawler

Rule Path
Disallow /

domainstatsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

exaleadcloudview

Rule Path
Disallow /

googlebot

No rules defined. All paths allowed.

grapeshot

Rule Path
Disallow /

knowledge ai

Rule Path
Disallow /

implisensebot

Rule Path
Disallow /

lightspeedsystemscrawler

Rule Path
Disallow /

linguee bot

Rule Path
Disallow /

lssrocketcrawler

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

nimbostratus-bot

Rule Path
Disallow /

seekbot

Rule Path
Disallow /

seekport crawle

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

semrush

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

sogou

Rule Path
Disallow /

sogou blog

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

sogou spider2

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

the knowledge ai

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /
Back to top

Comments

  • 2018.12.10
  • 2018.12.10
  • 2018.12.05
  • 2018.12.07
  • https://www.aihitdata.com/about
  • 2018.12.05
  • 2018.12.12
  • 2018.12.28
  • 2019.01.03
  • 2018.12.06
  • 2018.12.21
  • 2018.12.13
  • http://moz.com/products
  • 2018.12.05
  • 2018.12.05
  • 2020.09.15
  • 2018.12.07
  • 2018.12.07
  • 2018.12.07
  • 2019.01.03
  • 2019.01.10
  • 2019.01.03
  • 2018.12.18
  • 2018.12.18
  • 2018.12.06: https://megaindex.com/crawler
  • 2018.12.05
  • 2018.12.18
  • 2018.12.06: http://www.seekport.co.uk/seekbot/
  • 2018.12.11
  • 2018.12.11
  • 2018.12.07
  • 2018.12.05 ; same as SEMrushBot?
  • 2018.12.18
  • 2018.12.05
  • 2018.12.20: SEOkicks-Robot werkt niet voor SEOkicks: als deze ook niet werkt, dan verwijderen.
  • 2018.12.07
  • 2018.12.07
  • 2018.12.07
  • 2018.12.07
  • 2018.12.07
  • 2018.12.07
  • 2019.01.03
  • 2018.12.07
Back to top

Warnings

  • 5 invalid lines.
Back to top