bestmarkt.hu
robots.txt

Robots Exclusion Standard data for bestmarkt.hu

Resource Scan

Scan Details

Site Domain bestmarkt.hu
Base Domain bestmarkt.hu
Scan Status Ok
Last Scan2024-09-16T05:14:33+00:00
Next Scan 2024-10-16T05:14:33+00:00

Last Scan

Scanned2024-09-16T05:14:33+00:00
URL https://bestmarkt.hu/robots.txt
Redirect https://www.bestmarkt.hu/robots.txt
Redirect Domain www.bestmarkt.hu
Redirect Base bestmarkt.hu
Domain IPs 185.43.206.166
Redirect IPs 185.43.206.166
Response IP 185.43.206.166
Found Yes
Hash 1110ff184acb1af7994d3dcbcbe69600b087a3a38d6f6ff146e07cee263f3bfa
SimHash 31289f000718

Groups

*

Rule Path
Disallow /index.php/
Disallow /webaruhaz/
Disallow /images/
Allow /images/promo/
Allow /webaruhaz/auto-gps/navigacio-gps-pna-708
Allow /webaruhaz/kereses/?k=evolveo

mj12bot

Rule Path
Disallow /

httrack

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

bizinformaciok

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

lcc

Rule Path
Disallow /

heritrix

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /