mega-mult.org
robots.txt

Robots Exclusion Standard data for mega-mult.org

Resource Scan

Scan Details

Site Domain mega-mult.org
Base Domain mega-mult.org
Scan Status Ok
Last Scan2024-11-09T23:00:27+00:00
Next Scan 2024-11-16T23:00:27+00:00

Last Scan

Scanned2024-11-09T23:00:27+00:00
URL https://mega-mult.org/robots.txt
Domain IPs 104.21.49.69, 172.67.159.242, 2606:4700:3030::ac43:9ff2, 2606:4700:3037::6815:3145
Response IP 172.67.159.242
Found Yes
Hash 0cfa89a166dfcbfa6d0e6e4886ac3451b638f9f31d00a10c72e28b30ec2f4a3f
SimHash d915ac53e432

Groups

ia_archiver

Rule Path
Disallow /

ia_archiver-web.archive.org

Rule Path
Disallow /

*

Rule Path
Allow /*.js
Allow /*.css
Allow /engine/classes/js/
Allow /engine/classes/min/index.php
Allow /engine/data/emoticons/
Disallow /engine/*
Disallow */page/*/
Disallow */page/
Disallow /emoticon/
Disallow /emoticon/*
Disallow */emoticon/
Disallow /user/*
Disallow /?*
Disallow /engine/go.php
Disallow /user/
Disallow /*orderdesc
Disallow /*orderdesc*
Disallow /orderdesc/*
Disallow /orderdesc
Disallow */characters
Disallow */peoples
Disallow /lastnews/*
Disallow /catalog/*
Disallow /newposts/*
Disallow /xfsearch/*
Disallow /selections/*
Disallow /rules.html
Disallow /registration.html
Disallow /statistics.html
Disallow /rulescom.html
Disallow /lastviewed.tpl
Disallow /vip.tpl
Disallow /top.tpl
Disallow /allnews.tpl
Disallow /genres.tpl
Disallow /playlists.tpl
Disallow /youwatch.tpl
Disallow /index.php?do=*
Disallow /*print
Disallow /*print%3A*
Disallow /*rss.xml
Disallow /addnews.html
Disallow /favorites/*
Disallow /review/
Disallow /xfsearch/
Disallow /review/*
Disallow /mylists/*
Disallow /character/
Disallow /character/*
Disallow /people/
Disallow /people/*
Disallow /actor/
Disallow /collections/*
Disallow /year/*
Disallow */page/*
Disallow /actor/*
Disallow */characters
Disallow */peoples
Disallow /f/*
Disallow /f/
Disallow /%26*

yandex

Rule Path
Allow /*.js
Allow /*.css
Allow /engine/classes/js/
Allow /engine/classes/min/index.php
Allow /engine/data/emoticons/
Disallow /engine/*
Disallow */page/*/
Disallow */page/
Disallow /emoticon/
Disallow /emoticon/*
Disallow */emoticon/
Disallow /?*
Disallow /engine/go.php
Disallow /user/
Disallow /user/*
Disallow /*orderdesc
Disallow /*orderdesc*
Disallow /orderdesc/*
Disallow /orderdesc
Disallow /lastnews/*
Disallow /catalog/*
Disallow /xfsearch/*
Disallow /newposts/*
Disallow /selections/*
Disallow /rules.html
Disallow /statistics.html
Disallow /registration.html
Disallow /rulescom.html
Disallow /lastviewed.tpl
Disallow /vip.tpl
Disallow /top.tpl
Disallow /allnews.tpl
Disallow /genres.tpl
Disallow /playlists.tpl
Disallow /youwatch.tpl
Disallow /collections/*
Disallow /year/*
Disallow /index.php?do=*
Disallow /*print
Disallow /xfsearch/
Disallow /*print%3A*
Disallow /*rss.xml
Disallow /addnews.html
Disallow /favorites/*
Disallow /mylists/*
Disallow /review/
Disallow /review/*
Disallow /character/
Disallow /character/*
Disallow /people/
Disallow /people/*
Disallow */characters
Disallow */peoples
Disallow /actor/
Disallow */page/*
Disallow /actor/*
Disallow /f/*
Disallow /f/
Disallow /%26*

googlebot

Rule Path
Allow /*.js
Allow /*.css
Allow /engine/classes/js/
Allow /engine/classes/min/index.php
Allow /engine/data/emoticons/
Disallow /engine/*
Disallow */page/*/
Disallow */page/
Disallow /emoticon/
Disallow /emoticon/*
Disallow */emoticon/
Disallow /?*
Disallow /engine/go.php
Disallow /user/
Disallow /user/*
Disallow /*orderdesc
Disallow /*orderdesc
Disallow /*orderdesc*
Disallow /orderdesc/*
Disallow /orderdesc
Disallow /lastnews/*
Disallow /xfsearch/*
Disallow /catalog/*
Disallow */characters
Disallow */peoples
Disallow /newposts/*
Disallow /xfsearch/
Disallow /selections/*
Disallow /rules.html
Disallow /registration.html
Disallow /rulescom.html
Disallow /lastviewed.tpl
Disallow /allnews.tpl
Disallow /vip.tpl
Disallow /year/*
Disallow /collections/*
Disallow /top.tpl
Disallow /genres.tpl
Disallow /playlists.tpl
Disallow /youwatch.tpl
Disallow /statistics.html
Disallow /index.php?do=*
Disallow /*print
Disallow /*print%3A*
Disallow /*rss.xml
Disallow /addnews.html
Disallow /favorites/*
Disallow /mylists/*
Disallow /review/
Disallow /review/*
Disallow /character/
Disallow */page/*
Disallow /character/*
Disallow /people/
Disallow /people/*
Disallow /actor/
Disallow /actor/*
Disallow /f/*
Disallow /f/
Disallow /%26*

Other Records

Field Value
sitemap https://mega-mult.org/sitemap.xml

Warnings

  • `host` is not a known field.