unicef.de
robots.txt

Robots Exclusion Standard data for unicef.de

Resource Scan

Scan Details

Site Domain unicef.de
Base Domain unicef.de
Scan Status Ok
Last Scan2024-09-18T22:21:58+00:00
Next Scan 2024-10-18T22:21:58+00:00

Last Scan

Scanned2024-09-18T22:21:58+00:00
URL https://unicef.de/robots.txt
Redirect https://www.unicef.de/robots.txt
Redirect Domain www.unicef.de
Redirect Base unicef.de
Domain IPs 20.234.190.90
Redirect IPs 13.107.246.59, 2620:1ec:bdf::59
Response IP 13.107.246.59
Found Yes
Hash d55f5d8903332d7dbb0144d4877b5cbff49c348f78215310d8bd0a54629663dc
SimHash bb4dd254cdb2

Groups

*

Rule Path
Disallow /suche
Disallow /suche/
Disallow /start
Disallow /action/unicef/bsearch/
Disallow /action/unicef/nsearch/
Disallow /action/unicef/comment/
Disallow /api/comments/
Disallow /image/177924/teaser/302/140/982f7e12ad4b6afc04f10a0bcbdbbb47/qX/lydia-wiesmann-jpg.jpg
Disallow /*submitAndConfirmDonation

emailcollector

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

dataforseo

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.unicef.de/_cae/action/unicef/sitemap/googlenews.xml
sitemap https://www.unicef.de/sitemap_index.xml

Warnings

  • `noindex` is not a known field.