heise.de
robots.txt
Robots Exclusion Standard data for heise.de
Resource Scan
Scan Details
| Site Domain | heise.de |
| Base Domain | heise.de |
| Scan Status | Ok |
| Last Scan | 2024-04-25T18:56:19+00:00 |
| Next Scan | 2024-05-02T18:56:19+00:00 |
Last Scan
| Scanned | 2024-04-25T18:56:19+00:00 |
| URL | https://www.heise.de/robots.txt |
| Domain IPs | 193.99.144.85, 2a02:2e0:3fe:1001:7777:772e:2:85 |
| Response IP | 193.99.144.85 |
| Found | Yes |
| Hash | 08077f29b0db7aa3f9df2efb6b14ee01d6dfac6d00614d4c355bf33e9c1ecccd |
| SimHash | 0b145910e537 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /avw-bin/ |
| Disallow | /api/ |
| Disallow | /bilderstrecke/ |
| Disallow | /*/bilderstrecke/ |
| Disallow | /ct/daily/?* |
| Disallow | /ct/test/ |
| Disallow | /ct/praxis/ |
| Disallow | /ct/wissen/ |
| Disallow | /ct/trends/ |
| Disallow | /ct/ctmagazin/ |
| Disallow | /download/feed/ |
| Disallow | /extras/evileye/ |
| Disallow | /fastbin/ |
| Disallow | /forum/* |
| Disallow | /foto/galerie/* |
| Allow | /foto/galerie/ |
| Disallow | /home/ |
| Disallow | /ivw-bin/ |
| Disallow | /netze/netzwerk-tools/imonitor-internet-stoerungen/feed/ |
| Disallow | /netze/tools/whois/ |
| Disallow | /plus/abonnieren.html* |
| Disallow | /preisvergleich/eu/ |
| Disallow | /select/api/ |
| Disallow | /sso/ |
| Disallow | /userdb/ |
| Disallow | /suche |
| Disallow | /download/search |
| Disallow | /netze/netzwerk-tools/imonitor-internet-stoerungen/stoerungsmeldungen-suchen/?* |
| Disallow | /netze/netzwerk-tools/imonitor-internet-stoerungen/schnellsuche/?* |
| Disallow | /preisvergleich/redir.cgi |
| Disallow | /preisvergleich/redir/ |
| Disallow | /preisvergleich/?fs= |
| Disallow | /preisvergleich/?pg= |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.heise.de/sitemapindex.xml |
Comments