rapidauto.ro
robots.txt

Robots Exclusion Standard data for rapidauto.ro

Resource Scan

Scan Details

Site Domain rapidauto.ro
Base Domain rapidauto.ro
Scan Status Ok
Last Scan2026-01-15T16:16:00+00:00
Next Scan 2026-02-14T16:16:00+00:00

Last Scan

Scanned2026-01-15T16:16:00+00:00
URL https://rapidauto.ro/robots.txt
Redirect https://www.rapidauto.ro/robots.txt
Redirect Domain www.rapidauto.ro
Redirect Base rapidauto.ro
Domain IPs 104.21.10.154, 172.67.163.160, 2606:4700:3031::ac43:a3a0, 2606:4700:3033::6815:a9a
Redirect IPs 104.21.10.154, 172.67.163.160, 2606:4700:3031::ac43:a3a0, 2606:4700:3033::6815:a9a
Response IP 104.21.10.154
Found Yes
Hash 0990be38aa2be39be6bcef483fcd34c383f84d956ee3921479bb29d4c25cd384
SimHash 6c3c9dc1eca3

Groups

heritrix

Rule Path
Disallow /

incywincy

Rule Path
Disallow /

larbin

Rule Path
Disallow /

mobilegate-spider

Rule Path
Disallow /

psbot

Rule Path
Disallow /

seekbot

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

x-tractor

Rule Path
Disallow /

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

googlebot

Rule Path
Disallow /*/checkout*
Disallow /*/customer*
Disallow /*/notepad*
Disallow /*/basket*
Disallow /ro/also_purchased.html
Disallow *PageSpeed%3Dnoscript*
Disallow *?manufacturerId=*
Disallow *%26manufacturerId%3D*
Disallow *?vehicleManufacturer=*
Disallow *%26vehicleManufacturer%3D*
Disallow *?vehicleModels=*
Disallow *%26vehicleModels%3D*
Disallow /servlets/ajax

googlebot-image

Rule Path
Disallow /*/checkout*
Disallow /*/customer*
Disallow /*/notepad*
Disallow /*/basket*
Disallow /ro/also_purchased.html
Disallow *PageSpeed%3Dnoscript*
Disallow *?manufacturerId=*
Disallow *%26manufacturerId%3D*
Disallow *?vehicleManufacturer=*
Disallow *%26vehicleManufacturer%3D*
Disallow *?vehicleModels=*
Disallow *%26vehicleModels%3D*
Disallow /servlets/ajax

googlebot-mobile

Rule Path
Disallow /*/checkout*
Disallow /*/customer*
Disallow /*/notepad*
Disallow /*/basket*
Disallow /ro/also_purchased.html
Disallow *PageSpeed%3Dnoscript*
Disallow *?manufacturerId=*
Disallow *%26manufacturerId%3D*
Disallow *?vehicleManufacturer=*
Disallow *%26vehicleManufacturer%3D*
Disallow *?vehicleModels=*
Disallow *%26vehicleModels%3D*
Disallow /servlets/ajax

bingbot

Rule Path
Disallow /*/checkout*
Disallow /*/customer*
Disallow /*/notepad*
Disallow /*/basket*
Disallow /ro/also_purchased.html
Disallow *PageSpeed%3Dnoscript*
Disallow *?manufacturerId=*
Disallow *%26manufacturerId%3D*
Disallow *?vehicleManufacturer=*
Disallow *%26vehicleManufacturer%3D*
Disallow *?vehicleModels=*
Disallow *%26vehicleModels%3D*
Disallow /servlets/ajax

semrushbot

Rule Path
Disallow /*/checkout*
Disallow /*/customer*
Disallow /*/notepad*
Disallow /*/basket*
Disallow /ro/also_purchased.html
Disallow *PageSpeed%3Dnoscript*
Disallow *?manufacturerId=*
Disallow *%26manufacturerId%3D*
Disallow *?vehicleManufacturer=*
Disallow *%26vehicleManufacturer%3D*
Disallow *?vehicleModels=*
Disallow *%26vehicleModels%3D*
Disallow /servlets/ajax

*

Rule Path
Disallow /*/checkout*
Disallow /*/customer*
Disallow /*/notepad*
Disallow /*/basket*
Disallow /ro/also_purchased.html
Disallow *PageSpeed%3Dnoscript*
Disallow *?manufacturerId=*
Disallow *%26manufacturerId%3D*
Disallow *?vehicleManufacturer=*
Disallow *%26vehicleManufacturer%3D*
Disallow *?vehicleModels=*
Disallow *%26vehicleModels%3D*
Disallow /servlets/ajax

Other Records

Field Value
sitemap https://www.rapidauto.ro/sitemap.xml

Comments

  • Block unwanted crawlers entirely