Log In Sign Up

statista.com
robots.txt

Robots Exclusion Standard data for statista.com

Resource Scan

Scan Details

Site Domain statista.com
Base Domain statista.com
Scan Status Ok
Last Scan2024-05-18T19:07:53+00:00
Next Scan 2024-05-25T19:07:53+00:00

Last Scan

Scanned2024-05-18T19:07:53+00:00
URL https://statista.com/robots.txt
Domain IPs 108.157.254.115, 108.157.254.125, 108.157.254.27, 108.157.254.7
Response IP 108.157.254.7
Found Yes
Hash a59feb35bed321b4fdc23b99e78af47da0d2d2748768a3c4c92a194ae13a431f
SimHash f8133b018726

Groups

*
ahrefsbot

Rule Path
Disallow /ads/
Disallow /xml/
Disallow /berichte/
Disallow /blog/
Disallow /data/
Disallow /download/
Disallow /hinweis/datenleck/
Disallow /important/dataleak/
Disallow /important/fuite-donnees/
Disallow /importante/fuga-de-datos/
Disallow /favorit-hinzufuegen/
Disallow /add-favorite/
Disallow /ajouter-favoris/
Disallow /anadir-busqueda/
Disallow /favorit-loeschen/
Disallow /remove-favorite/
Disallow /supprimer-favoris/
Disallow /eliminar-busqueda/
Disallow /eliminar-favoritos/
Disallow /statistik/report-content/
Disallow /statistics/report-content/
Disallow /statistiques/report-content/
Disallow /estadisticas/report-content/
Disallow /companies/c/
Allow /companies/o/
Disallow /unternehmen/c/
Allow /unternehmen/o/
Disallow /compagnie/
Disallow /empresa/
Disallow /companydb/suche
Disallow /companydb/search
Disallow /unternehmen/suche
Disallow /companies/search
Disallow /companydb/buscar
Disallow /companydb/recherche
Disallow /perspectiva/
Disallow /perspective/
Disallow /statistics/popular/p/
Disallow /statistik/top/p/
Disallow /statistiques/populaires/p/
Disallow /estadisticas/populares/p/
Disallow /statistik/aktuell/p/
Disallow /statistics/recent/p/
Disallow /statistiques/recentes/p/
Disallow /estadisticas/recientes/p/
Disallow /studies-and-reports/*?q=
Disallow /studies-and-reports/*%26q%3D
Disallow /studien-und-reports/*?q=
Disallow /studien-und-reports/*%26q%3D
Disallow /profile/
Disallow /profil/
Disallow /perfil/
Disallow /profil/
Disallow /login/password/
Disallow /login/passwort_vergessen/
Disallow /acceso/contrasena/
Disallow /login/resend-confirmation-link
Disallow /login/bestaetigungslink-erneut-senden
Disallow /login/reenviar-enlace-de-confirmacion
Disallow /login/renvoyer-le-lien-de-confirmation
Disallow /direct/purchase/
Disallow /request/custom-solution/
Disallow /search/
Disallow /statistik/suche/
Disallow /buscar/
Disallow /recherche/
Disallow /research-ai/
Disallow /research-ai$
Disallow /research/

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

sitecheck.internetseer.com
zealbot
msiecrawler
sitesnagger
webstripper
webcopier
fetch
offline explorer
teleport
teleportpro
webzip
linko
httrack
microsoft.url.control
xenu
larbin
libwww
zyborg
download ninja

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.statista.com/sitemap/
sitemap https://de.statista.com/sitemap/
sitemap https://es.statista.com/sitemap/
sitemap https://fr.statista.com/sitemap/
Back to top

Comments

  • Automated access to this website by web crawlers is allowed only for the use in public search engines (e.g. Google or Bing).
  • Automated data collection, data mining or mirroring (“scraping”) of any content on this website for any other purpose than public search engines without explicit authorization is strictly prohibited.
  • Irresponsible or illegal access may be blocked at any time, and we reserve the right to take legal action against such activities.
  • Legacy URLs
  • Forms
  • Products (08/22 Update)
  • Pagination (04/22)
  • Editors (08/23 opened for crawler)
  • Study search (04/22)
  • Personal information
  • Internal search (04/22)
  • Research AI (04/24)
  • Sitemaps all languages
  • Ahrefs Slowdown
  • Scraping protection
Back to top