documaniatv.com
robots.txt

Robots Exclusion Standard data for documaniatv.com

Resource Scan

Scan Details

Site Domain documaniatv.com
Base Domain documaniatv.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-03-23T17:11:18+00:00
Next Scan 2025-04-06T17:11:18+00:00

Last Successful Scan

Scanned2025-01-11T17:09:14+00:00
URL https://documaniatv.com/robots.txt
Domain IPs 104.21.76.153, 172.67.196.156, 2606:4700:3035::6815:4c99, 2606:4700:3035::ac43:c49c
Response IP 172.67.196.156
Found Yes
Hash ca7029109edce6fa405901c3ec00aa7f4b104191b218dbc3ca351b3ba07fc109
SimHash 37b6c8566a95

Groups

*

Rule Path
Allow /ads.txt
Allow /app-ads.txt

blexbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

the knowledge ai

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

musobot

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

everyonesocialbot

Rule Path
Disallow /

gnowitnewsbot

Rule Path
Disallow /

leikibot

Rule Path
Disallow /

outclicksbot

Rule Path
Disallow /

sudorlybot

Rule Path
Disallow /

woobot

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

epicbot

Rule Path
Disallow /

tweetmemebot

Rule Path
Disallow /

obot

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

yoozbot

Rule Path
Disallow /

msn-bot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

mauibot (crawler.feedback+wc@gmail.com)

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

uipbot/1.0 (uipbot@semasio.net)

Rule Path
Disallow /

domainstatsbot

Rule Path
Disallow /

zoombot

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

linguee

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

*

Rule Path
Disallow /admin/
Disallow /ads/
Disallow /aserver/
Disallow /users/
Disallow /user/
Disallow /yt.swf
Disallow /fpembed.php
Disallow /drelated.swf
Disallow /relatedclips.php
Disallow /eyeblaster/
Disallow /anuncios/
Disallow /players/
Disallow /play/
Disallow /plays/
Disallow /include/
Disallow /playlist/
Disallow /list/
Disallow /vidplay/
Disallow /pub/
Disallow /documental-aleatorio.html
Disallow /documentales-*-rating.html
Disallow /documentales-*-views.html
Disallow /documentales-*-title.html
Disallow /documentales-nuevos.html?d=today
Disallow /documentales-nuevos.html?d=yesterday
Disallow /documentales-nuevos.html?d=month
Disallow /OpenInviter/
Disallow /dosearch.php
Disallow /search.php
Disallow /buscar.php
Disallow /memberlist.php
Disallow /memberlist.html
Disallow /profile.php
Disallow /profile.html
Disallow /cgi-sys/
Disallow /cdn-cgi/

Other Records

Field Value
sitemap https://www.documaniatv.com/sitemap-index.xml
sitemap https://www.documaniatv.com/video-sitemap-index.xml