scifiscene.de
robots.txt

Robots Exclusion Standard data for scifiscene.de

Resource Scan

Scan Details

Site Domain scifiscene.de
Base Domain scifiscene.de
Scan Status Ok
Last Scan2024-10-05T03:50:54+00:00
Next Scan 2024-10-12T03:50:54+00:00

Last Scan

Scanned2024-10-05T03:50:54+00:00
URL https://scifiscene.de/robots.txt
Redirect https://www.scifiscene.de/robots.txt
Redirect Domain www.scifiscene.de
Redirect Base scifiscene.de
Domain IPs 87.118.120.48
Redirect IPs 87.118.120.48
Response IP 87.118.120.48
Found Yes
Hash 7a9891badcdad23eb25fffcb63a7a884017b4c7cb06897b69795967cd4e3b343
SimHash 59405500d430

Groups

*

Rule Path
Disallow /go/
Disallow /movie/*/stream/*
Disallow /serie/*/stream/*
Allow /

gptbot

Rule Path
Disallow /

linkdexbot/2.0

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

spbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

seoscanners.net

Rule Path
Disallow /

vebidoo

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

Comments

  • Block MegaIndex.ru