arcor.de
robots.txt

Robots Exclusion Standard data for arcor.de

Resource Scan

Scan Details

Site Domain arcor.de
Base Domain arcor.de
Scan Status Ok
Last Scan2024-05-23T18:09:16+00:00
Next Scan 2024-05-30T18:09:16+00:00

Last Scan

Scanned2024-05-23T18:09:16+00:00
URL https://arcor.de/robots.txt
Redirect https://live.vodafone.de/robots.txt
Redirect Domain live.vodafone.de
Redirect Base vodafone.de
Domain IPs 45.60.74.50
Redirect IPs 45.60.74.50
Response IP 45.60.74.50
Found Yes
Hash 80f2a3386a1d5c762c78202475d8ab716d9629c90c98c07d1a3ba14d4f86fc6c
SimHash 6101218684f2

Groups

*

Rule Path
Disallow /promotion/
Disallow /en/music/
Disallow /music/tracks/
Disallow /music/albums/
Disallow /music/artists/

slysearch

Rule Path
Disallow /

smartdownload

Rule Path
Disallow /

spankbot

Rule Path
Disallow /

spanner

Rule Path
Disallow /

superbot

Rule Path
Disallow /

supperhttp

Rule Path
Disallow /

surfbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

Other Records

Field Value
sitemap https://live.vodafone.de/sitemapindex.xml

Comments

  • robots.txt for live.vodafone.de 16.02.2024
  • Sitemap