Log In Sign Up

augsburger-allgemeine.de
robots.txt

Robots Exclusion Standard data for augsburger-allgemeine.de

Resource Scan

Scan Details

Site Domain augsburger-allgemeine.de
Base Domain augsburger-allgemeine.de
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-11-09T18:02:19+00:00
Next Scan 2025-02-07T18:02:19+00:00

Last Successful Scan

Scanned2024-07-13T10:57:15+00:00
URL https://augsburger-allgemeine.de/robots.txt
Redirect https://www.augsburger-allgemeine.de/robots.txt
Redirect Domain www.augsburger-allgemeine.de
Redirect Base augsburger-allgemeine.de
Domain IPs 62.245.237.200
Redirect IPs 2600:9000:20fe:1c00:1d:9160:380:93a1, 2600:9000:20fe:2c00:1d:9160:380:93a1, 2600:9000:20fe:3a00:1d:9160:380:93a1, 2600:9000:20fe:5600:1d:9160:380:93a1, 2600:9000:20fe:7400:1d:9160:380:93a1, 2600:9000:20fe:c400:1d:9160:380:93a1, 2600:9000:20fe:d600:1d:9160:380:93a1, 2600:9000:20fe:f200:1d:9160:380:93a1, 52.222.144.101, 52.222.144.13, 52.222.144.16, 52.222.144.48
Response IP 3.160.246.124
Found Yes
Hash 82e8fef874a44dfa0a69962d2968d011ef99cb0b2e03b3f232e485eafd1f2329
SimHash 09881d05dcf0

Groups

*
gptbot disallow: /
chatgpt-user disallow: /
ccbot disallow: /
mmetest disallow: /
mybot disallow: /

Rule Path
Disallow /*.ece*
Disallow /titelseiten/
Disallow /verwaltung/
Disallow /werbung/
Disallow /meine*
Disallow /community*
Disallow /*?wt_*
Disallow /*?utm_campaign*
Back to top

Other Records

Field Value
sitemap https://www.augsburger-allgemeine.de/sitemap.xml
sitemap https://www.augsburger-allgemeine.de/sitemap-image.xml
sitemap https://www.augsburger-allgemeine.de/sitemap-video.xml
sitemap https://www.augsburger-allgemeine.de/news.xml
Back to top

Comments

  • Sitemaps
Back to top