avocatnet.ro
robots.txt

Robots Exclusion Standard data for avocatnet.ro

Resource Scan

Scan Details

Site Domain avocatnet.ro
Base Domain avocatnet.ro
Scan Status Ok
Last Scan2024-06-26T02:42:14+00:00
Next Scan 2024-07-03T02:42:14+00:00

Last Scan

Scanned2024-06-26T02:42:14+00:00
URL https://avocatnet.ro/robots.txt
Redirect https://www.avocatnet.ro/robots.txt
Redirect Domain www.avocatnet.ro
Redirect Base avocatnet.ro
Domain IPs 193.189.98.234
Redirect IPs 193.189.98.234
Response IP 193.189.98.234
Found Yes
Hash 1d340a83735b5b256fba72ee77eb64db56f45fb6beb2472b922a48fc17521815
SimHash 2258da91d131

Groups

googlebot

Rule Path
Disallow

facebot

Rule Path
Disallow

exabot

Rule Path
Disallow /

indy library

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

speedy

Rule Path
Disallow /

yandex

Rule Path
Disallow /

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 120

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 120

ahrefsbot

Rule Path
Disallow /