connectotransfers.com
robots.txt

Robots Exclusion Standard data for connectotransfers.com

Resource Scan

Scan Details

Site Domain connectotransfers.com
Base Domain connectotransfers.com
Scan Status Ok
Last Scan2024-08-30T14:15:56+00:00
Next Scan 2024-09-29T14:15:56+00:00

Last Scan

Scanned2024-08-30T14:15:56+00:00
URL https://connectotransfers.com/robots.txt
Domain IPs 13.33.28.108, 13.33.28.122, 13.33.28.49, 13.33.28.76
Response IP 13.33.28.76
Found Yes
Hash 5d65826edad061d3594e8cc6125499f8da295fc45c5388fd64018a59b4e96999
SimHash c9bdd022e4f8

Groups

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

linguee

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

hubspot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

*

Rule Path
Disallow /cgi-bin/

Other Records

Field Value
crawl-delay 5

Comments

  • temporary disable all bots
  • User-agent: *
  • good bots: MJ12bot, SeznamBot
  • bad bots: