discounto.de
robots.txt

Robots Exclusion Standard data for discounto.de

Resource Scan

Scan Details

Site Domain discounto.de
Base Domain discounto.de
Scan Status Ok
Last Scan2024-05-22T08:47:42+00:00
Next Scan 2024-05-29T08:47:42+00:00

Last Scan

Scanned2024-05-22T08:47:42+00:00
URL https://discounto.de/robots.txt
Redirect https://www.discounto.de/robots.txt
Redirect Domain www.discounto.de
Redirect Base discounto.de
Domain IPs 104.26.8.169, 104.26.9.169, 172.67.75.241, 2606:4700:20::681a:8a9, 2606:4700:20::681a:9a9, 2606:4700:20::ac43:4bf1
Redirect IPs 104.26.8.169, 104.26.9.169, 172.67.75.241, 2606:4700:20::681a:8a9, 2606:4700:20::681a:9a9, 2606:4700:20::ac43:4bf1
Response IP 172.67.75.241
Found Yes
Hash c93e575dba80fa28cb4ad9dc029c8ede7361d531629ff75f4f4a8739a7bdc305
SimHash 43055934bf1b

Groups

*

Rule Path
Disallow /rpg/
Disallow /go/
Disallow /Suche/
Disallow /*/Angebote/Discounter%3A*
Disallow /*/Angebote/Angebot-Gruppe%3A*
Disallow /*/Angebote/Schlagwort%3A*
Disallow /*/Angebote/Angebot-Datum%3A*
Disallow /Prospekte/Branche%3A*
Disallow /Prospekte/Angebot-Datum%3A*
Disallow /Angebot-Kategorie/*/Discounter%3A*
Disallow /Angebot-Kategorie/*/Schlagwort%3A*
Disallow /Angebot-Kategorie/*/Angebot-Datum%3A*
Disallow /Aktuelle-Angebote/*/Discounter%3A*
Disallow /Aktuelle-Angebote/*/Angebot-Datum%3A*
Disallow /*/?offset=*
Disallow /*/Sortierung%3A*
Disallow /Externe-Angebote/

nutch

Rule Path
Disallow /

proximic

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.discounto.de/sitemap.xml

Comments

  • www.robotstxt.org/
  • www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449