forums.jokersupdates.com
robots.txt

Robots Exclusion Standard data for forums.jokersupdates.com

Resource Scan

Scan Details

Site Domain forums.jokersupdates.com
Base Domain jokersupdates.com
Scan Status Ok
Last Scan2024-09-22T12:38:21+00:00
Next Scan 2024-10-22T12:38:21+00:00

Last Scan

Scanned2024-09-22T12:38:21+00:00
URL https://forums.jokersupdates.com/robots.txt
Domain IPs 169.61.62.206
Response IP 169.61.62.206
Found Yes
Hash 92a0e233b3a7a3e27e1ff0818c47a3be50e39452039daaa69b59e80c1ec8290c
SimHash 525884780d33

Groups

redditbot/1.0

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

weborama-fetcher

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

user-agent: ltx71 - (http://ltx71.com/)

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

bomborabot

Rule Path
Disallow /

omgili/0.5

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

exabot

Rule Path
Disallow /

discobot

Rule Path
Disallow /

boardreader

Rule Path
Disallow /

seekportbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

*

Rule Path
Disallow /ubbthreads/pages/
Disallow /ubbthreads/jgames/*
Disallow /chat/*
Disallow /ubbthreads/contact.php
Disallow /ubbthreads/showflat.php
Disallow /ubbthreads/showprofile.php
Disallow /ubbthreads/postlist.php
Disallow /ubbthreads/search.php
Disallow /ubbthreads/dosearch.php
Disallow /ubbthreads/dotagsearch.php
Disallow /ubbthreads/online.php
Disallow /ubbthreads/gotothread.php
Disallow /ubbthreads/gotonpthread.php
Disallow /ubbthreads/addfavforum.php
Disallow /ubbthreads/markallread.php
Disallow /ubbthreads/domarkallreadanon.php
Disallow /ubbthreads/domarkcatallreadanon.php
Disallow /ubbthreads/ubbthreads.php
Disallow /ubbthreads/doreply.php
Disallow /ubbthreads/newreply.php
Disallow /ubbthreads/printthread.php
Disallow /ubbthreads/markthreadread.php
Disallow /ubbthreads/domarkthreadread.php
Disallow /ubbthreads/showmembers.php
Disallow /ubbthreads/litepostlist.php
Disallow /ubbthreads/jmap/map.php
Disallow /ubbthreads/links.php
Disallow /index_test.php

mediapartners-google

Rule Path
Allow /ubbthreads/postlist.php

Comments

  • Robots.txt for www.jokersupdates.com and UBBThreads forums

Warnings

  • 2 invalid lines.