augsburger-allgemeine.de
robots.txt

Robots Exclusion Standard data for augsburger-allgemeine.de

Resource Scan

Scan Details

Site Domain augsburger-allgemeine.de
Base Domain augsburger-allgemeine.de
Scan Status Ok
Last Scan2024-05-17T10:54:06+00:00
Next Scan 2024-05-24T10:54:06+00:00

Last Scan

Scanned2024-05-17T10:54:06+00:00
URL https://augsburger-allgemeine.de/robots.txt
Redirect https://www.augsburger-allgemeine.de/robots.txt
Redirect Domain www.augsburger-allgemeine.de
Redirect Base augsburger-allgemeine.de
Domain IPs 62.245.237.200
Redirect IPs 62.245.237.200
Response IP 62.245.237.200
Found Yes
Hash 6b39018ee316b5368d1dc73bbde87fb2af7cd3b7516b2c00b7a94d4cb4d56988
SimHash 098417410910

Groups

*

Rule Path
Disallow /*.ece*
Disallow /hfs/
Disallow /titelseiten/
Disallow /verwaltung/
Disallow /werbung/
Disallow /mein-profil/
Disallow /*?wt_*
Disallow /*?comment*
Disallow /*?bu=*
Disallow /*?utm_campaign*

gptbot disallow: /
chatgpt-user disallow: /
ccbot disallow: /

No rules defined. All paths allowed.

Other Records

Field Value
sitemap https://www.augsburger-allgemeine.de/sitemap.xml
sitemap https://www.augsburger-allgemeine.de/sitemap-section.xml
sitemap https://www.augsburger-allgemeine.de/sitemap-video.xml
sitemap https://www.augsburger-allgemeine.de/news.xml

Comments

  • Sitemaps