merkur-online.de
robots.txt
Robots Exclusion Standard data for merkur-online.de
Resource Scan
Scan Details
Site Domain | merkur-online.de |
Base Domain | merkur-online.de |
Scan Status | Ok |
Last Scan | 2024-06-26T01:23:14+00:00 |
Next Scan | 2024-07-03T01:23:14+00:00 |
Last Scan
Scanned | 2024-06-26T01:23:14+00:00 |
URL | https://merkur-online.de/robots.txt |
Domain IPs | 193.218.202.88 |
Response IP | 193.218.202.88 |
Found | Yes |
Hash | 6638ec4bedc0351d59927ec36e79a0f6025420668ba49c82a81c45eaa61a0850 |
SimHash | 2b21171c8f75 |
Groups
*
Rule | Path |
---|---|
Disallow | /lightweight-ajax |
Disallow | /*?trafficsource |
Disallow | /suche/ |
Disallow | /*?cmp=defrss |
Disallow | /test/ |
Disallow | /west/ |
Disallow | /fdn/bootstrap/ |
Disallow | /bi/bootstrap/ |
Disallow | /bi/doop/ |
Disallow | /sso/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.merkur.de/news.xml |
Comments