roadelepamantului.ro
robots.txt

Robots Exclusion Standard data for roadelepamantului.ro

Resource Scan

Scan Details

Site Domain roadelepamantului.ro
Base Domain roadelepamantului.ro
Scan Status Ok
Last Scan2024-09-04T01:44:57+00:00
Next Scan 2024-10-04T01:44:57+00:00

Last Scan

Scanned2024-09-04T01:44:57+00:00
URL https://roadelepamantului.ro/robots.txt
Redirect https://www.roadelepamantului.ro/robots.txt
Redirect Domain www.roadelepamantului.ro
Redirect Base roadelepamantului.ro
Domain IPs 104.21.40.11, 172.67.173.216, 2606:4700:3030::ac43:add8, 2606:4700:3035::6815:280b
Redirect IPs 104.21.40.11, 172.67.173.216, 2606:4700:3030::ac43:add8, 2606:4700:3035::6815:280b
Response IP 172.67.173.216
Found Yes
Hash b40e33f7aafff92bf40cc2f5651696074cc7b2076878bd5459fdf7554d9e8639
SimHash 4e18d4c0efb2

Groups

*

Rule Path
Allow /
Disallow /admin/
Disallow /redisman/
Disallow /awb/
Disallow /catalog/
Disallow /cgi-bin/
Disallow /download/
Disallow /system/
Disallow /vqmod/
Disallow /config.php/
Disallow /index.php/
Disallow /*route%3Daccount/
Disallow /*route%3Daffiliate/
Disallow /*route%3Dcheckout/
Disallow /*route%3Dproduct/search
Disallow /index.php?route=product%2Fproduct*&manufacturer_id=
Disallow /finalizare-comanda
Disallow /finalizare-comanda-rapida
Disallow /cos-cumparaturi
Disallow /index.php?route=account%2Fsuccess
Disallow /comenzi
Disallow /contul-meu
Disallow /compara-produse
Disallow /tranzactii
Disallow /descarcari
Disallow /favorite
Disallow /index.php?route=checkout%2Fsuccess
Disallow /*?product_list
Disallow /*?sort=
Disallow /*%26sort%3D
Disallow /*?order=
Disallow /*%26order%3D
Disallow /*?limit=
Disallow /*%26limit%3D
Disallow /*?format=
Disallow /*%26format%3D
Disallow /*?tracking=
Disallow /*%26tracking%3D
Disallow /*?filter=
Disallow /*%26filter%3D
Disallow /*?filter_name=
Disallow /*%26filter_name%3D
Disallow /*?filter_sub_category=
Disallow /*%26filter_sub_category%3D
Disallow /*?filter_description=
Disallow /*%26filter_description%3D
Disallow /*popularitate-mare
Disallow /*pret-mic
Disallow /*pret-mare
Disallow /*discount-mare
Disallow /*?search=
Disallow /*%26search%3D
Disallow /*?search_term=
Disallow /*%26search_term%3D
Disallow /*?ref=filtru
Disallow /*%26ref%3Dfiltru
Disallow /*?fmin=
Disallow /*%26fmin%3D
Disallow /*?fmax=
Disallow /*%26fmax%3D
Disallow /*?fc=
Disallow /*%26fc%3D
Disallow /*?fm=
Disallow /*%26fm%3D
Disallow /*?fq=
Disallow /*%26fq%3D
Disallow /*?fr=
Disallow /*%26fr%3D
Disallow /*?ft=
Disallow /*%26ft%3D
Disallow /*?fa*=
Disallow /*%26fa*%3D
Disallow /*?fo*=
Disallow /*%26fo*%3D
Disallow /*?ff*=
Disallow /*%26ff*%3D

linguee

Rule Path
Disallow /

deusu

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

proximic
bizinformation
blexbot
riddler
ltx71
magpie-crawler
grapeshot
grapeshotcrawler
gigablastopensource
bubing
linkdexbot
linkdexbot/2.2
seokicks
seokicks-robot
panscient.com
webdatastats
zoominfobot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

synthesio

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.roadelepamantului.ro/sitemap.xml
sitemap https://www.roadelepamantului.ro/categorii.xml
sitemap https://www.roadelepamantului.ro/produse.xml
sitemap https://www.roadelepamantului.ro/producatori.xml
sitemap https://www.roadelepamantului.ro/informatii.xml
sitemap https://www.roadelepamantului.ro/articole.xml

Comments

  • Crawler
  • Linguee ----> Block https://www.linguee.com/bot
  • DeuSu ----> Block Documentation https://deusu.de/robot.html
  • TurnitinBot ----> Block Documentation https://turnitin.com/robot/crawlerinfo.html
  • Bad bots ------> BLOCK
  • proximic Documentation https://www.comscore.com/proximic-spider
  • BLEXBot (very bad bot) Documentation http://webmeup-crawler.com/
  • Common Crawl ----> Block Documentation http://commoncrawl.org/faq/

Warnings

  • 2 invalid lines.