cntraveller.de
robots.txt

Robots Exclusion Standard data for cntraveller.de

Resource Scan

Scan Details

Site Domain cntraveller.de
Base Domain cntraveller.de
Scan Status Ok
Last Scan2024-09-15T22:43:29+00:00
Next Scan 2024-09-22T22:43:29+00:00

Last Scan

Scanned2024-09-15T22:43:29+00:00
URL https://cntraveller.de/robots.txt
Domain IPs 13.33.88.105, 13.33.88.5, 13.33.88.51, 13.33.88.65, 2600:9000:223b:2400:16:25:f6c0:93a1, 2600:9000:223b:3800:16:25:f6c0:93a1, 2600:9000:223b:4000:16:25:f6c0:93a1, 2600:9000:223b:6800:16:25:f6c0:93a1, 2600:9000:223b:7600:16:25:f6c0:93a1, 2600:9000:223b:8800:16:25:f6c0:93a1, 2600:9000:223b:c400:16:25:f6c0:93a1, 2600:9000:223b:ec00:16:25:f6c0:93a1
Response IP 13.33.88.65
Found Yes
Hash 4c9d5aaef9072db3eeb95e773e4d16750c770971e0ff87724b25200d40c2d9f1
SimHash 459cd1638f91

Groups

*

Rule Path
Disallow /preview/
Disallow /search
Disallow /*%7B%7Bsection%7D%7D
Disallow /*%7B%7Bsection%7D%7D
Disallow /product/
Disallow /auth/*
Disallow /account/*
Disallow /*?redirectURL=
Disallow /user-context?referrer
Disallow /services.min.js?_=

google-inspectiontool

Rule Path
Allow /

ccbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

youbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.cntraveller.de/sitemap.xml
sitemap https://www.cntraveller.de/feed/google-latest-news/sitemap-google-news
sitemap https://www.cntraveller.de/feed/rss
sitemap https://www.cntraveller.de/categories-sitemap.xml
sitemap https://www.cntraveller.de/contributors-sitemap.xml
sitemap https://www.cntraveller.de/bundles-sitemap.xml