alegecazare.ro
robots.txt

Robots Exclusion Standard data for alegecazare.ro

Resource Scan

Scan Details

Site Domain alegecazare.ro
Base Domain alegecazare.ro
Scan Status Ok
Last Scan2024-09-17T22:26:15+00:00
Next Scan 2024-09-24T22:26:15+00:00

Last Scan

Scanned2024-09-17T22:26:15+00:00
URL https://alegecazare.ro/robots.txt
Redirect https://www.alegecazare.ro/robots.txt
Redirect Domain www.alegecazare.ro
Redirect Base alegecazare.ro
Domain IPs 104.21.6.121, 172.67.134.213, 2606:4700:3031::6815:679, 2606:4700:3037::ac43:86d5
Redirect IPs 104.21.6.121, 172.67.134.213, 2606:4700:3031::6815:679, 2606:4700:3037::ac43:86d5
Response IP 172.67.134.213
Found Yes
Hash cf3036eee5e6727a7d9727fe584042cc0ad88ac64c7a27e27a474960b87cdaa2
SimHash 6b3cdd60ee99

Groups

*

Rule Path
Disallow /locfiles/
Disallow /locimg/
Disallow /locimg_thmbnl/
Disallow /fcontact/
Disallow /albumfoto/
Disallow /nws.php
Allow /

Other Records

Field Value
crawl-delay 5

amazonbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

riddler

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

linguee bot

Rule Path
Disallow /