newratings.de
robots.txt

Robots Exclusion Standard data for newratings.de

Resource Scan

Scan Details

Site Domain newratings.de
Base Domain newratings.de
Scan Status Ok
Last Scan2024-10-04T17:19:24+00:00
Next Scan 2024-10-11T17:19:24+00:00

Last Scan

Scanned2024-10-04T17:19:24+00:00
URL https://newratings.de/robots.txt
Domain IPs 82.97.136.83, 82.97.160.83
Response IP 82.97.136.83
Found Yes
Hash 6f77cdc6090ffc6873d23022da534479eeb81b28f6c497ae0d0cc0736c1a9aad
SimHash 6016c949c096

Groups

bytespider

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

*

Rule Path
Disallow /cgi-bin/
Disallow /user/
Disallow /de/user/
Disallow /en/user/
Disallow /du/user/
Disallow /add/
Disallow /de/add/
Disallow /en/add/
Disallow /du/add/