Log In Sign Up

computer-world.pro
robots.txt

Robots Exclusion Standard data for computer-world.pro

Resource Scan

Scan Details

Site Domain computer-world.pro
Base Domain computer-world.pro
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-12-18T13:22:46+00:00
Next Scan 2026-01-01T13:22:46+00:00

Last Successful Scan

Scanned2025-12-01T00:23:16+00:00
URL https://computer-world.pro/robots.txt
Redirect https://www.computer-world.pro/robots.txt
Redirect Domain www.computer-world.pro
Redirect Base computer-world.pro
Domain IPs 172.66.40.201, 172.66.43.55, 2606:4700:3108::ac42:28c9, 2606:4700:3108::ac42:2b37
Redirect IPs 172.66.40.201, 172.66.43.55, 2606:4700:3108::ac42:28c9, 2606:4700:3108::ac42:2b37
Response IP 172.66.43.55
Found Yes
Hash d8df0a906009b4d61bcb3de859d4ba33b7f3fce5382eb515c79b424bc047b4ad
SimHash 527805490534

Groups

*

Rule Path
Allow */modules/*.css
Allow */modules/*.js
Disallow /*?orderby=
Disallow /*?orderway=
Disallow /panier?add=*
Disallow /*?tag=
Disallow /*?id_currency=
Disallow /*?search_query=
Disallow /*?back=
Disallow /*?n=
Disallow /*%26orderby%3D
Disallow /*%26orderway%3D
Disallow /*%26tag%3D
Disallow /*%26id_currency%3D
Disallow /*%26search_query%3D
Disallow /*%26back%3D
Disallow /*%26n%3D
Disallow /*controller%3Daddresses
Disallow /*controller%3Daddress
Disallow /*controller%3Dauthentication
Disallow /*controller%3Dcart
Disallow /*controller%3Ddiscount
Disallow /*controller%3Dfooter
Disallow /*controller%3Dget-file
Disallow /*controller%3Dheader
Disallow /*controller%3Dhistory
Disallow /*controller%3Didentity
Disallow /*controller%3Dimages.inc
Disallow /*controller%3Dinit
Disallow /*controller%3Dmy-account
Disallow /*controller%3Dorder
Disallow /*controller%3Dorder-opc
Disallow /*controller%3Dorder-slip
Disallow /*controller%3Dorder-detail
Disallow /*controller%3Dorder-follow
Disallow /*controller%3Dorder-return
Disallow /*controller%3Dorder-confirmation
Disallow /*controller%3Dpagination
Disallow /*controller%3Dpassword
Disallow /*controller%3Dpdf-invoice
Disallow /*controller%3Dpdf-order-return
Disallow /*controller%3Dpdf-order-slip
Disallow /*controller%3Dproduct-sort
Disallow /*controller%3Dsearch
Disallow /*controller%3Dstatistics
Disallow /*controller%3Dattachment
Disallow /*controller%3Dguest-tracking
Disallow */classes/
Disallow */config/
Disallow */download/
Disallow */mails/
Disallow */modules/
Disallow */translations/
Disallow */tools/
Disallow /*adresse
Disallow /*adresses
Disallow /*connexion
Disallow /*panier
Disallow /*reduction
Disallow /*suivi-commande-invite
Disallow /*historique-commandes
Disallow /*identite
Disallow /*mon-compte
Disallow /*commande
Disallow /*confirmation-commande
Disallow /*suivi-commande
Disallow /*commande-rapide
Disallow /*avoirs
Disallow /*recuperation-mot-de-passe
Disallow /*recherche

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

discobot

Rule Path
Disallow /

blekkobot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

sistrix crawler

Rule Path
Disallow /

uptimerobot/2.0

Rule Path
Disallow /

ezooms robot

Rule Path
Disallow /

perl lwp

Rule Path
Disallow /

netestate ne crawler

Rule Path
Disallow /

wiseguys robot

Rule Path
Disallow /

turnitin robot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

babya discoverer

Rule Path
Disallow /
Back to top

Comments

  • robots.txt automaticaly generated by PrestaShop e-commerce open-source solution
  • http://www.prestashop.com - http://www.prestashop.com/forums
  • This file is to prevent the crawling and indexing of certain parts
  • of your site by web crawlers and spiders run by sites like Yahoo!
  • and Google. By telling these "robots" where not to go on your site,
  • you save bandwidth and server resources.
  • For more information about the robots.txt standard, see:
  • http://www.robotstxt.org/robotstxt.html
  • Allow Directives
  • Private pages
  • Directories
  • Files
  • Block MJ12bot as it is just noise
  • Block Ahrefs
  • Block SEOkicks
  • SEOkicks
  • Dicoveryengine.com
  • Blekkobot
  • Block BlexBot
  • Block SISTRIX
  • Block Uptime robot
  • Block Ezooms Robot
  • Block Perl LWP
  • Block netEstate NE Crawler
  • Block WiseGuys Robot
  • Block Turnitin Robot
  • Exabot
  • Babya Discoverer
Back to top

Warnings

  • 1 invalid line.
Back to top