Log In Sign Up

f64.ro
robots.txt

Robots Exclusion Standard data for f64.ro

Resource Scan

Scan Details

Site Domain f64.ro
Base Domain f64.ro
Scan Status Ok
Last Scan2024-09-18T16:36:03+00:00
Next Scan 2024-10-18T16:36:03+00:00

Last Scan

Scanned2024-09-18T16:36:03+00:00
URL https://f64.ro/robots.txt
Redirect https://www.f64.ro:443/robots.txt
Redirect Domain www.f64.ro
Redirect Base f64.ro
Domain IPs 3.160.196.110, 3.160.196.127, 3.160.196.33, 3.160.196.89
Redirect IPs 186.195.65.65
Response IP 186.195.65.65
Found Yes
Hash 92573c0a20cf5aa659e2de56cd99c3514067adead050614d5825599e6f454081
SimHash 283cffca2c11

Groups

*

Rule Path
Disallow /img/*
Disallow /account/*
Disallow /login/*
Disallow /checkout/*
Disallow /busca/*
Disallow /quick-view/*
Disallow /espiar/*
Disallow /productotherpaymentsystems
Disallow /productotherpaymentsystems/*
Disallow *productLinkNotFound*
Disallow /frontend/*
Disallow *?order=*
Disallow /*2pau
Disallow /*2ptt
Disallow /*2ptu
Disallow /*2prp
Disallow /*2pdlst

semrushbot
semrushbot-sa
megaindex.ru/2.0
megaindex.ru
megaindex.ru
mj12bot
yandex
baiduspider
ahrefsbot
synthesio
riddler
linguee bot
petalbot/aspiegelbot
dotbot
yandex bot
webreaper
webcopier
offline explorer
httrack
microsoft.url.control
emailcollector
penthesilea

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.f64.ro/sitemap.xml
Back to top

Comments

  • Disallow all crawlers access to certain pages.
Back to top

Warnings

  • 1 invalid line.
  • `noindex` is not a known field.
Back to top