castoranatomic.gr
robots.txt

Robots Exclusion Standard data for castoranatomic.gr

Resource Scan

Scan Details

Site Domain castoranatomic.gr
Base Domain castoranatomic.gr
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-11-07T04:09:13+00:00
Next Scan 2026-02-05T04:09:13+00:00

Last Successful Scan

Scanned2025-03-19T00:30:50+00:00
URL https://castoranatomic.gr/robots.txt
Domain IPs 94.130.142.153
Response IP 94.130.142.153
Found Yes
Hash 1579ad4d8c3690449c9f8889ef695195db585b6232bad6016c6269bce7f3d96f
SimHash 9ab249122a80

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

scrapy

Rule Path
Allow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

seek

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

crawl

Rule Path
Disallow /

cubot

Rule Path
Disallow /

mixrankbot

Rule Path
Disallow /

survey

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

mail.ru bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

link

Rule Path
Disallow /

spider

Rule Path
Disallow /

Warnings

  • 2 invalid lines.