witze.net
robots.txt

Robots Exclusion Standard data for witze.net

Resource Scan

Scan Details

Site Domain witze.net
Base Domain witze.net
Scan Status Ok
Last Scan2024-09-19T14:22:43+00:00
Next Scan 2024-09-26T14:22:43+00:00

Last Scan

Scanned2024-09-19T14:22:43+00:00
URL https://witze.net/robots.txt
Domain IPs 144.76.91.233
Response IP 144.76.91.233
Found Yes
Hash d11b9532517b7b536ec763c8b6d7c5ecdd60502d4e7b5adfc541c09ce555a0ef
SimHash 5a1ed570a911

Groups

ahrefsbot

Rule Path
Disallow /

amazon

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

applebot

Rule Path
Disallow /

awariobot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

*

Rule Path
Disallow /~ping