discounto.de
robots.txt

Robots Exclusion Standard data for discounto.de

Resource Scan

Scan Details

Site Domain discounto.de
Base Domain discounto.de
Scan Status Ok
Last Scan2024-11-14T01:19:58+00:00
Next Scan 2024-11-21T01:19:58+00:00

Last Scan

Scanned2024-11-14T01:19:58+00:00
URL https://discounto.de/robots.txt
Redirect https://www.discounto.de/robots.txt
Redirect Domain www.discounto.de
Redirect Base discounto.de
Domain IPs 104.26.8.169, 104.26.9.169, 172.67.75.241, 2606:4700:20::681a:8a9, 2606:4700:20::681a:9a9, 2606:4700:20::ac43:4bf1
Redirect IPs 104.26.8.169, 104.26.9.169, 172.67.75.241, 2606:4700:20::681a:8a9, 2606:4700:20::681a:9a9, 2606:4700:20::ac43:4bf1
Response IP 172.67.75.241
Found Yes
Hash 3aa2e7055f5097b5bd6577af6764788e9349d7fad2f215771591060d6812c312
SimHash 430d50649f33

Groups

*

Rule Path
Disallow /rpg/
Disallow /Suche/
Disallow /*/Angebote/Discounter%3A*
Disallow /*/Angebote/Angebot-Gruppe%3A*
Disallow /*/Angebote/Schlagwort%3A*
Disallow /*/Angebote/Angebot-Datum%3A*
Disallow /Prospekte/Branche%3A*
Disallow /Prospekte/Angebot-Datum%3A*
Disallow /Angebot-Kategorie/*/Discounter%3A*
Disallow /Angebot-Kategorie/*/Schlagwort%3A*
Disallow /Angebot-Kategorie/*/Angebot-Datum%3A*
Disallow /Aktuelle-Angebote/*/Discounter%3A*
Disallow /Aktuelle-Angebote/*/Angebot-Datum%3A*
Disallow /*/?offset=*
Disallow /*/Sortierung%3A*
Allow /Prospekte/Angebot-Datum%3Aletzte-woche
Allow /Prospekte/Angebot-Datum%3Anaechste-woche

nutch

Rule Path
Disallow /

proximic

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.discounto.de/sitemap.xml

Comments

  • www.robotstxt.org/
  • www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449