1001file.ru
robots.txt

Robots Exclusion Standard data for 1001file.ru

Resource Scan

Scan Details

Site Domain 1001file.ru
Base Domain 1001file.ru
Scan Status Ok
Last Scan2024-06-15T19:56:34+00:00
Next Scan 2024-06-22T19:56:34+00:00

Last Scan

Scanned2024-06-15T19:56:34+00:00
URL https://1001file.ru/robots.txt
Domain IPs 87.236.16.91
Response IP 87.236.16.91
Found Yes
Hash 436c63a82ddb7c2a4870320200fb0c8ec429a3a2d82b70dabdde8fa75bd447ae
SimHash 62c6ae73c939

Groups

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 100

twiceler

Rule Path
Disallow /

w3c-checklink

Rule Path
Disallow /

disco pump, wget, webzip, teleport pro, websnake, offline explorer, web-by-mail, teleport pro/1.29, scooter-w3-1.0

Rule Path
Disallow /

mediapartners-google

Rule Path
Disallow

*

Rule Path Comment
Disallow /home/ -
Disallow /apanel/ -
Disallow /*go/ -
Disallow /*redir/ -
Disallow /base/ -
Disallow /block/ -
Disallow /cache/ -
Disallow /mod/ -
Disallow /temp/ -
Disallow /error/ -
Disallow /loader/ -
Disallow /print/ -
Disallow /file/ -
Disallow /info/ -
Disallow /all/ -
Disallow /commentit/ -
Disallow *commentit-* -
Disallow /*letter -
Disallow /news/print-* -
Disallow *dn%3Dload* -
Disallow /*down/load -
Disallow /*article/a-* -
Disallow /*article/r-* -
Disallow *dn%3Darticle* -
Disallow *dn%3Dnews* -
Disallow *dn%3Ddown* -
Disallow /*down/o- -
Disallow /*down/r- -
Disallow *-1.html -
Disallow *-2.html -
Disallow *p-3.html -
Disallow *p-4.html -
Disallow /rating.php -
Disallow /article/view/* -
Disallow /down/view/* -
Disallow /news/read/article/read/* -
Disallow /link/view/* -
Disallow /stat/_nome -
Disallow /article/*search* -
Disallow /news/*search* -
Disallow /down/*search* -
Disallow /gsearch* -
Disallow *prev_next%3Dnext new*
Disallow /down/wmultimedia/$ -
Disallow /down/wgraphics/$ -
Disallow /down/winternet/$ -
Disallow /down/wsecurity/$ -
Disallow /down/wall/$ -
Disallow /down/wgame/$ -
Disallow /down/woffice/$ -
Disallow /down/wfinance/$ -
Disallow /down/wmaking/$ -
Disallow /down/wprogramming/$ -
Disallow /down/wsystem/$ -
Disallow /down/wdriver/$ -
Disallow /down/mmultimedia/$ -
Disallow /down/moffice/$ -
Disallow /down/minternet/$ -
Disallow /down/mgraphics/$ -
Disallow /down/wpsoft/$ -
Disallow /down/wmall/$ -
Disallow /down/ainternet/$ -
Disallow /down/amultimedia/$ -
Disallow /down/asecurity/$ -
Disallow /down/msystem/$ -
Disallow /down/wmreadtext/$ -
Disallow /down/aall/$ -
Disallow /down/agraphics/$ -
Disallow /down/atools/$ -
Disallow /down/areadtext/$ -
Disallow /down/agame/$ -
Disallow /down/awallpapper/$ -
Disallow /down/abusiness/$ -
Disallow /down/igame/$ -
Disallow /down/iosgraphics/$ -
Disallow /down/aoffice/$ -
Disallow /down/logic-game/$ -
Disallow /down/arcade-online/$ -
Disallow /down/online-quests/$ -
Disallow /down/online-gonki/$ -
Disallow /down/online-fly/$ -
Disallow /down/online-sport/$ -
Disallow /down/andobrazovanie/$ -
Disallow /down/asport/$ -
Disallow /down/wpgame/$ -
Disallow /down/wpinternet/$ -
Disallow /down/wpmultimedia/$ -
Disallow /down/awidget/$ -
Disallow /down/ibusiness/$ -
Disallow /down/pleery/$ -
Disallow /down/online/$ -
Disallow /down/converter/$ -
Disallow /down/redaktory/$ -
Disallow /down/kodeki/$ -
Disallow /down/all/$ -
Disallow /down/wgredaktory/$ -
Disallow /down/wgviewer/$ -
Disallow /down/wgkonvertery/$ -
Disallow /down/wgall/$ -
Disallow /down/wibrowser/$ -
Disallow /down/wichat/$ -
Disallow /down/wimail/$ -
Disallow /down/wiftpmanager/$ -
Disallow /down/wirss/$ -
Disallow /down/wiserver/$ -
Disallow /down/widownload/$ -
Disallow /down/witraffic/$ -
Disallow /down/wiall/$ -
Disallow /down/wsantivirus/$ -
Disallow /down/wsdataprotect/$ -
Disallow /down/wsbeckup/$ -
Disallow /down/wsall/$ -
Disallow /down/wioblako/$ -
Disallow /down/wgscreen/$ -
Disallow /down/wcddvd/$ -
Disallow /down/wcdburn/$ -
Disallow /down/wcdvirtualdisc/$ -
Disallow /down/wcdall/$ -
Disallow /down/wsreestr/$ -
Disallow /down/wsmonitor/$ -
Disallow /down/wsdefrag/$ -
Disallow /down/wsaudit/$ -
Disallow /down/wssynchro/$ -
Disallow /down/wsfilemanager/$ -
Disallow /down/wsfilefolder/$ -
Disallow /down/wsarchive/$ -
Disallow /down/wslib/$ -
Disallow /down/wscatalog/$ -
Disallow /down/wsysall/$ -
Disallow /down/wotextedit/$ -
Disallow /down/wotranslate/$ -
Disallow /down/woorganizer/$ -
Disallow /down/woviewer/$ -
Disallow /down/wopdf/$ -
Disallow /down/woclipboard/$ -
Disallow /down/woall/$ -
Disallow /down/wplang/$ -
Disallow /down/wpinstall/$ -
Disallow /down/wpedit/$ -
Disallow /down/wdprinter/$ -
Disallow /down/wdcamera/$ -
Disallow /down/wdmobile/$ -
Disallow /down/wdmonitor/$ -
Disallow /down/wfforex/$ -
Disallow /down/wfmonitor/$ -
Disallow /down/woscreen/$ -
Disallow /down/wodesktop/$ -
Disallow /down/wpall/$ -
Disallow /down/macall/$ -
Disallow /down/macibrowser/$ -
Disallow /down/macmedit/$ -
Disallow /down/macsoptimization/$ -
Disallow /down/macgviewer/$ -
Disallow /down/macichat/$ -
Disallow /down/macotextedit/$ -
Disallow /down/macsmonitor/$ -
Disallow /down/macorganizer/$ -
Disallow /down/macsall/$ -
Disallow /down/agarcade/$ -
Disallow /down/agviktorina/$ -
Disallow /down/agrace/$ -
Disallow /down/agtable/$ -
Disallow /down/agadvent/$ -
Disallow /down/agsimulator/$ -
Disallow /down/agsport/$ -
Disallow /down/agstrategy/$ -
Disallow /down/agaction/$ -
Disallow /down/agfamily/$ -
Disallow /down/agrole/$ -
Disallow /down/agpuzzles/$ -
Disallow /down/aglearn/$ -
Disallow /down/agwgames/$ -
Disallow /down/agcard/$ -
Disallow /down/agdrugoe/$ -
Disallow /down/agkazino/$ -
Disallow /down/lmultimedia/$ -
Disallow /down/lprogramming/$ -
Disallow /down/ldriver/$ -
Disallow /down/lsystem/$ -
Disallow /down/lgraphics/$ -
Disallow /down/lmconverter/$ -
Disallow /down/lmplayer/$ -
Disallow /down/linternet/$ -
Disallow /down/librowser/$ -
Disallow /down/lichat/$ -
Disallow /down/lgredaktory/$ -
Disallow /down/lpredaktory/$ -
Disallow /down/loffice/$ -
Disallow /down/loredaktory/$ -
Disallow /down/lsoptimization/$ -
Disallow /down/lslib/$ -
Disallow /down/lsfilemanager/$ -
Disallow /down/lsserver/$ -
Disallow /down/ldprinter/$ -
Disallow /down/lall/$ -
Disallow /down/wphgaction/$ -
Disallow /down/wphgstrategy/$ -
Disallow /down/wphgpuzzle/$ -
Disallow /down/wphgrace/$ -
Disallow /down/wphgclassic/$ -
Disallow /down/wgnastolnye-igry/$ -
Disallow /down/wgcard/$ -
Disallow /down/aichat/$ -
Disallow /down/aibrowser/$ -
Disallow /down/aimail/$ -
Disallow /down/amplayer/$ -
Disallow /down/amonline/$ -
Disallow /down/aidownload/$ -
Disallow /down/awork/$ -
Disallow /down/atravel/$ -
Disallow /down/afoto/$ -
Disallow /down/wgpuzzles/$ -
Disallow /down/wgameall/$ -
Disallow /down/wgarcade/$ -
Disallow /down/wgsimulator/$ -
Disallow /down/wgstrategy/$ -
Disallow /down/wggirl/$ -
Disallow /down/wgsport/$ -
Disallow /down/wgshooter/$ -
Disallow /down/wsfirewall/$ -
Disallow /down/wphbrowser/$ -
Disallow /down/wphplayer/$ -
Disallow /down/amall/$ -
Disallow /down/amconverter/$ -
Disallow /down/amedit/$ -
Disallow /down/asantivirus/$ -
Disallow /down/asall/$ -
Disallow /down/radio-tele-veshchanie/$ -
Allow /forum/*sitemap -
Allow /forum/*sitemap/*rss -
Disallow /forum/attachments*/ -
Disallow /forum/avatars/ -
Disallow /forum/avatars_users/ -
Disallow /forum/cache/ -
Disallow /forum/Packages/ -
Disallow /forum/Smileys/ -
Disallow /forum/Sources/ -
Disallow /forum/Themes/ -
Disallow /forum/*.msg -
Disallow /forum/*.new -
Disallow /forum/*sort -
Disallow /forum/*topicseen -
Disallow /forum/*wap -
Disallow /forum/*imode -
Disallow /forum/*action -
Disallow /forum/index.php?*%3B* -
Disallow /forum/*all -
Disallow /forum/*go.php -
Disallow /forum/*prev_next -
Disallow /forum/*all -
Disallow /forum/*PHPSESSID -
Disallow /message_for_oss.pdf -

Other Records

Field Value
sitemap https://1001file.ru/sitemap.xml

Warnings

  • `host` is not a known field.