connecto-secure-payment.com
robots.txt

Robots Exclusion Standard data for connecto-secure-payment.com

Resource Scan

Scan Details

Site Domain connecto-secure-payment.com
Base Domain connecto-secure-payment.com
Scan Status Ok
Last Scan2024-09-30T11:03:34+00:00
Next Scan 2024-10-30T11:03:34+00:00

Last Scan

Scanned2024-09-30T11:03:34+00:00
URL https://connecto-secure-payment.com/robots.txt
Domain IPs 3.122.6.110, 3.73.18.196
Response IP 3.73.18.196
Found Yes
Hash 5d65826edad061d3594e8cc6125499f8da295fc45c5388fd64018a59b4e96999
SimHash c9bdd022e4f8

Groups

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

linguee

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

hubspot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

*

Rule Path
Disallow /cgi-bin/

Other Records

Field Value
crawl-delay 5

Comments

  • temporary disable all bots
  • User-agent: *
  • good bots: MJ12bot, SeznamBot
  • bad bots: