fifoautoshop.sk
robots.txt

Robots Exclusion Standard data for fifoautoshop.sk

Resource Scan

Scan Details

Site Domain fifoautoshop.sk
Base Domain fifoautoshop.sk
Scan Status Ok
Last Scan2025-05-27T05:25:46+00:00
Next Scan 2025-06-26T05:25:46+00:00

Last Scan

Scanned2025-05-27T05:25:46+00:00
URL https://fifoautoshop.sk/robots.txt
Redirect https://www.fifoautoshop.sk/robots.txt
Redirect Domain www.fifoautoshop.sk
Redirect Base fifoautoshop.sk
Domain IPs 2a00:1169:111:d640::, 92.205.235.18
Redirect IPs 2a00:1169:111:d640::, 92.205.235.18
Response IP 92.205.235.18
Found Yes
Hash 1933d4e6922b4da0dd0526f8c97ac2ce53a5edbd49189668492173db01c026f7
SimHash 585cd960f69b

Groups

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

askjeeves

Rule Path
Disallow /

fastcrawler

Rule Path
Disallow /

infoseek robot 1.0

Rule Path
Disallow /

lycos

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

ravencrawler

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

Comments

  • disable specific bots