rogator.de
robots.txt
Robots Exclusion Standard data for rogator.de
Resource Scan
Scan Details
| Site Domain | rogator.de |
| Base Domain | rogator.de |
| Scan Status | Ok |
| Last Scan | 2025-11-08T07:58:31+00:00 |
| Next Scan | 2025-12-08T07:58:31+00:00 |
Last Scan
| Scanned | 2025-11-08T07:58:31+00:00 |
| URL | https://rogator.de/robots.txt |
| Redirect | https://www.rogator.de/robots.txt |
| Redirect Domain | www.rogator.de |
| Redirect Base | rogator.de |
| Domain IPs | 46.165.219.241 |
| Redirect IPs | 3.68.6.165, 52.28.111.176 |
| Response IP | 52.28.111.176 |
| Found | Yes |
| Hash | 28d3fca60be9dd8606cc655d5f65bbb41fb323072ab7a9c8d64d8e0e382390fd |
| SimHash | 451c5b75e2f5 |
Groups
googlebot
googlebot-video
googlebot-news
googlebot-image
adsbot-google
adsbot-google-mobile
apis-google
google-inspectiontool
googleother
googleother-image
googleother-video
google-extended
google-cloudvertexbot
googleagent-mariner
bingbot
adidxbot
bingpreview
duckduckbot
yandexbot
facebot
facebookexternalhit/1.1
facebookexternalhit/1.0 (+http://www.facebook.com/externalhit_uatext.php)
facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)
baiduspider
baiduspider-image
baiduspider-video
baiduspider-news
mozilla/5.0 (compatible; qwantify/bleriot/1.1; +https://help.qwant.com/bot)
qwantbot
bleriot
qwantify
applebot
exabot
chatgpt-user
gptbot
amazonbot
slurp
hubspot crawler
semrushbot
rsiteauditor
seobility
mozilla/5.0 (windows nt 10.0; win64; x64) applewebkit/537.36 (khtml, wie gecko) chrome/125.0.6422.142 safari/537.36 eye-able®-report/1.0
popetech-crawlbot
popetech-scanbot
mistralai-user
perplexity-user
perplexitybot
oai-searchbot
anthropic-ai
claudebot
claude-web
applebot-extended
facebookbot
meta-externalagent
bytespider
duckassistbot
cohere-ai
ccbot
youbot
timpibot
diffbot
novaact
gemini-deep-research
chatgpt agent
claude-searchbot
oai-searchbot
| Rule | Path |
|---|---|
| Disallow | */wp-admin/ |
| Allow | */wp-admin/*.css$ |
| Allow | */wp-admin/*.js$ |
| Disallow | */category/ |
| Disallow | */tag/ |
| Disallow | */trackback/ |
| Disallow | */feed/ |
| Disallow | */comments/ |
*
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.rogator.de/sitemap.xml |