delfino.gr
robots.txt

Robots Exclusion Standard data for delfino.gr

Resource Scan

Scan Details

Site Domain delfino.gr
Base Domain delfino.gr
Scan Status Ok
Last Scan2024-11-03T12:06:51+00:00
Next Scan 2024-12-03T12:06:51+00:00

Last Scan

Scanned2024-11-03T12:06:51+00:00
URL https://delfino.gr/robots.txt
Redirect https://www.delfino.gr/robots.txt
Redirect Domain www.delfino.gr
Redirect Base delfino.gr
Domain IPs 185.78.221.218
Redirect IPs 185.78.221.218
Response IP 185.78.221.218
Found Yes
Hash 6f95fd5e747c8f1d676718b27c476f5ea71f2aaee61fc7d20532be1284691c74
SimHash 161ecc70ce88

Groups

seekport

Rule Path
Disallow *

petalbot

Rule Path
Disallow *

dotbot

Rule Path
Disallow *

cincraw

Rule Path
Disallow *

yandexbot

Rule Path
Disallow *

ahrefsbot

Rule Path
Disallow *

semrushbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 40

serpstatbot

Rule Path
Disallow /