Log In Sign Up

greven.net
robots.txt

Robots Exclusion Standard data for greven.net

Resource Scan

Scan Details

Site Domain greven.net
Base Domain greven.net
Scan Status Ok
Last Scan2025-08-28T09:37:59+00:00
Next Scan 2025-09-27T09:37:59+00:00

Last Scan

Scanned2025-08-28T09:37:59+00:00
URL https://greven.net/robots.txt
Domain IPs 195.202.44.20
Response IP 195.202.44.20
Found Yes
Hash 89989ce4b2d9ca839b4f6cbb05cf2ce02e719a626bbc14aa9ac311b7a2c6f212
SimHash fd1c5340bc91

Groups

twitterbot

Rule Path
Disallow

semrushbot

Rule Path
Disallow /

siteauditbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /

ltx71 - (http://ltx71.com/)

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

crowdtanglebot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

bitlybot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

semanticscholarbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

infotigerbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

neevabot

Rule Path
Disallow /

wi job roboter spider version 3

Rule Path
Disallow /

job roboter spider

Rule Path
Disallow /

adsbot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

seobilitybot

Rule Path
Disallow /

elisabot

Rule Path
Disallow /

deepnoc

Rule Path
Disallow /

yak

Rule Path
Disallow /

molokaibot

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

*

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://www.greven.net/index.php?sp%3Aout=sitemap
Back to top