prreport.de
robots.txt

Robots Exclusion Standard data for prreport.de

Resource Scan

Scan Details

Site Domain prreport.de
Base Domain prreport.de
Scan Status Ok
Last Scan2024-10-01T22:23:46+00:00
Next Scan 2024-10-31T22:23:46+00:00

Last Scan

Scanned2024-10-01T22:23:46+00:00
URL https://prreport.de/robots.txt
Redirect https://www.prreport.de/robots.txt
Redirect Domain www.prreport.de
Redirect Base prreport.de
Domain IPs 194.6.194.40
Redirect IPs 194.6.194.40
Response IP 194.6.194.40
Found Yes
Hash 505056ec028308d31a7e80b2a63028b22dbe7d79ad7a6e303e7d728e2481ec9c
SimHash 4034c462c101

Groups

*

Rule Path
Disallow /suche/
Disallow /suchergebnisse.html

baiduspider

Rule Path
Disallow /

applebot

Rule Path
Allow /
Disallow /cre-1.0/

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

omgili

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

sirdatabot

Rule Path
Disallow /

lcc

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://prreport.de/sitemap.xml