vansite.eu
robots.txt

Robots Exclusion Standard data for vansite.eu

Resource Scan

Scan Details

Site Domain vansite.eu
Base Domain vansite.eu
Scan Status Ok
Last Scan2024-11-08T05:54:14+00:00
Next Scan 2024-11-22T05:54:14+00:00

Last Scan

Scanned2024-11-08T05:54:14+00:00
URL https://vansite.eu/robots.txt
Domain IPs 108.157.254.70, 108.157.254.78, 108.157.254.88, 108.157.254.95
Response IP 108.157.254.88
Found Yes
Hash c0ed20549f0f647b603fbfc63f2d3d24f63880df7047d45e07154d94849c8757
SimHash 68411b68e930

Groups

*

Rule Path
Disallow /de/de/
Disallow /en/en/
Disallow /fr/fr/
Disallow /it/it/
Disallow /es/es/
Disallow /sv/sv/
Disallow /no/no/
Disallow /de/en/
Disallow /de/fr/
Disallow /de/it/
Disallow /de/es/
Disallow /de/sv/
Disallow /de/no/
Disallow /en/de/
Disallow /en/fr/
Disallow /en/it/
Disallow /en/es/
Disallow /en/sv/
Disallow /en/no/
Disallow /fr/de/
Disallow /fr/en/
Disallow /fr/it/
Disallow /fr/es/
Disallow /fr/sv/
Disallow /fr/no/
Disallow /it/de/
Disallow /it/en/
Disallow /it/fr/
Disallow /it/es/
Disallow /it/sv/
Disallow /it/no/
Disallow /es/de/
Disallow /es/en/
Disallow /es/fr/
Disallow /es/it/
Disallow /es/sv/
Disallow /es/no/
Disallow /sv/de/
Disallow /sv/en/
Disallow /sv/fr/
Disallow /sv/it/
Disallow /sv/es/
Disallow /sv/no/
Disallow /no/de/
Disallow /no/en/
Disallow /no/fr/
Disallow /no/it/
Disallow /no/es/
Disallow /no/sv/
Disallow /en/blog/
Disallow /fr/blog/
Disallow /it/blog/
Disallow /es/blog/
Disallow /sv/blog/
Disallow /no/blog/
Disallow /l/new
Disallow /l/draft

Other Records

Field Value
sitemap https://vansite.eu/static/sitemap.xml
sitemap https://vansite.eu/sitemap.xml

Comments

  • Disallow double language directories
  • Disallow combinations of different languages
  • Disallow language-specific blog directories
  • Disallow listing creation and draft pages
  • Sitemaps