unknowns.de
robots.txt

Robots Exclusion Standard data for unknowns.de

Resource Scan

Scan Details

Site Domain unknowns.de
Base Domain unknowns.de
Scan Status Ok
Last Scan2024-09-17T05:22:22+00:00
Next Scan 2024-10-17T05:22:22+00:00

Last Scan

Scanned2024-09-17T05:22:22+00:00
URL https://unknowns.de/robots.txt
Domain IPs 213.133.121.40, 2a01:4f8:d0a:115f::2
Response IP 213.133.121.40
Found Yes
Hash 65a851dfc96429478dc8a7d3036fccf15a42f7ac03d826bb90aad8b951ebdc2c
SimHash 505614225e13

Groups

*

Rule Path
Disallow /marketplace/entry-edit/
Disallow /marketplace/entry-add/
Disallow /notification-list/
Disallow /forum/user-post-list/
Disallow /forum/unread-thread-list/
Disallow /forum/unresolved-thread-list/

semrushbot

Rule Path
Disallow /

bytedance

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

nimbostratus-bot

Rule Path
Disallow /

semrush

Rule Path
Disallow /

ahrefs

Rule Path
Disallow /

aspiegelbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

sogou

Rule Path
Disallow /

Other Records

Field Value
sitemap https://unknowns.de/sitemaps/sitemap.xml

Warnings

  • 2 invalid lines.