moregirls.org
robots.txt
Robots Exclusion Standard data for moregirls.org
Resource Scan
Scan Details
| Site Domain | moregirls.org |
| Base Domain | moregirls.org |
| Scan Status | Ok |
| Last Scan | 5/22/2025, 12:58:42 AM |
| Next Scan | 6/21/2025, 12:58:42 AM |
Last Scan
| Scanned | 5/22/2025, 12:58:42 AM |
| URL | https://moregirls.org/robots.txt |
| Domain IPs | 104.21.61.253, 172.67.217.118, 2606:4700:3036::6815:3dfd, 2606:4700:3036::ac43:d976 |
| Response IP | 172.67.217.118 |
| Found | Yes |
| Hash | 6bd237d45dd7b60581ac44f1a78d98be27757d5e11c777e6da3d57924954bebc |
| SimHash | 4364c8f48234 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
yandex
| Rule | Path |
|---|---|
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Disallow | /components/ |
| Disallow | /editor/ |
| Disallow | /help/ |
| Disallow | /includes/ |
| Disallow | /language/ |
| Disallow | /mambots/ |
| Disallow | /media/ |
| Disallow | /modules/ |
| Disallow | /templates/ |
| Disallow | /installation/ |
| Disallow | /links.html/ |
| Disallow | /search.php/ |
| Disallow | /category/law/ |
| Disallow | /ssilki.php* |
| Disallow | /*.zip$ |
| Disallow | /*.php?*sessionid= |
| Disallow | /*.php?*mode= |
| Disallow | /download.php* |
| Disallow | /search.php* |
| Disallow | /member.php* |
| Disallow | /article* |
| Disallow | /sitemap.php* |
| Disallow | /chclick.php* |
| Disallow | /data/media/19 |
| Disallow | /data/media/21 |
| Disallow | /data/media/36 |
| Disallow | /data/media/39 |
| Disallow | /data/media/41 |
| Disallow | /data/media/42 |
| Disallow | /data/media/47 |
| Disallow | /data/media/23 |
| Disallow | /data/media/24 |
| Disallow | /data/media/37 |
| Disallow | /data/media/35 |
| Disallow | /data/media/40 |
| Disallow | /data/media/25 |
| Disallow | /data/media/29 |
| Disallow | /data/thumbnails/19 |
| Disallow | /data/thumbnails/21 |
| Disallow | /data/thumbnails/36 |
| Disallow | /data/thumbnails/39 |
| Disallow | /data/thumbnails/41 |
| Disallow | /data/thumbnails/42 |
| Disallow | /data/thumbnails/47 |
| Disallow | /data/thumbnails/23 |
| Disallow | /data/thumbnails/24 |
| Disallow | /data/thumbnails/37 |
| Disallow | /data/thumbnails/35 |
| Disallow | /data/thumbnails/40 |
| Disallow | /data/thumbnails/25 |
| Disallow | /data/thumbnails/29 |
| Disallow | /categories.php?cat_id=60&page=1$ |
| Disallow | /categories.php?cat_id=59&page=1$ |
| Disallow | /categories.php?cat_id=48&page=1$ |
| Disallow | /categories.php?cat_id=57&page=1$ |
| Disallow | /categories.php?cat_id=56&page=1$ |
| Disallow | /categories.php?cat_id=55&page=1$ |
| Disallow | /categories.php?cat_id=54&page=1$ |
| Disallow | /categories.php?cat_id=53&page=1$ |
| Disallow | /categories.php?cat_id=52&page=1$ |
| Disallow | /categories.php?cat_id=68&page=1$ |
| Disallow | /categories.php?cat_id=61&page=1$ |
| Disallow | /categories.php?cat_id=62&page=1$ |
| Disallow | /categories.php?cat_id=33&page=1$ |
| Disallow | /categories.php?cat_id=32&page=1$ |
| Disallow | /categories.php?cat_id=22&page=1$ |
| Disallow | /categories.php?cat_id=51&page=1$ |
| Disallow | /categories.php?cat_id=30&page=1$ |
| Disallow | /categories.php?cat_id=63&page=1$ |
| Disallow | /categories.php?cat_id=64&page=1$ |
| Disallow | /categories.php?cat_id=65&page=1$ |
| Disallow | /categories.php?cat_id=66&page=1$ |
| Disallow | /index.php |
| Disallow | /*?sessionid= |
| Disallow | /*?l=english |
| Disallow | /*?l=vietnam |
| Disallow | /*?l=russian |
| Disallow | /*?l=nederlands |
| Disallow | /*?l=swedish |
| Disallow | /*?l=korean |
| Disallow | /*?l=french |
| Disallow | /*?l=indonesian |
| Disallow | /*?l=portuguese |
| Disallow | /*?l=greek |
| Disallow | /*?l=kurdish |
| Disallow | /*?l=Taiwan |
| Disallow | /*?l=magyar |
| Disallow | /*?l=chinese |
| Disallow | /*?l=polish |
| Disallow | /*?l=spanish |
| Disallow | /*?l=hebrew |
| Disallow | /*?l=farsi |
| Disallow | /*?l=turkey |
| Disallow | /*?l=bulgarian |
| Disallow | /*?l=Arabic |
| Disallow | /*?l=brazilian |
| Disallow | /*?l=slovensko |
| Disallow | /*?l=italian |
| Disallow | /*?l=srpski |
| Disallow | /*?l=deutsch |
| Disallow | /*%26mode%3Dsearch%28%26%7C%24%29 |
| Disallow | /search.php |
| Disallow | /temp/ |
| Disallow | /logfiles/ |
| Disallow | /cgi-bin/ |
| Disallow | /member.php |
| Disallow | /*.search.htm |
| Disallow | /rss.php |
| Allow | /templates/Iceberg/ |
| Allow | /Googlebot-Image |
| Allow | /data/media/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 15 |
googlebot
| Rule | Path |
|---|---|
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Disallow | /components/ |
| Disallow | /editor/ |
| Disallow | /help/ |
| Disallow | /includes/ |
| Disallow | /language/ |
| Disallow | %26mode%3Dsearch |
| Disallow | /mambots/ |
| Disallow | /media/ |
| Disallow | /modules/ |
| Disallow | /templates/ |
| Disallow | /installation/ |
| Disallow | /links.html/ |
| Disallow | /search.php/ |
| Disallow | /category/law/ |
| Disallow | /ssilki.php* |
| Disallow | /*.zip$ |
| Disallow | /*.php?*sessionid= |
| Disallow | /*.php?*mode= |
| Disallow | /download.php* |
| Disallow | /search.php* |
| Disallow | /member.php* |
| Disallow | /article* |
| Disallow | /sitemap.php* |
| Disallow | /chclick.php* |
| Disallow | /data/media/19 |
| Disallow | /data/media/21 |
| Disallow | /data/media/36 |
| Disallow | /data/media/39 |
| Disallow | /data/media/41 |
| Disallow | /data/media/42 |
| Disallow | /data/media/47 |
| Disallow | /data/media/23 |
| Disallow | /data/media/24 |
| Disallow | /data/media/37 |
| Disallow | /data/media/35 |
| Disallow | /data/media/40 |
| Disallow | /data/media/25 |
| Disallow | /data/media/29 |
| Disallow | /data/thumbnails/19 |
| Disallow | /data/thumbnails/21 |
| Disallow | /data/thumbnails/36 |
| Disallow | /data/thumbnails/39 |
| Disallow | /data/thumbnails/41 |
| Disallow | /data/thumbnails/42 |
| Disallow | /data/thumbnails/47 |
| Disallow | /data/thumbnails/23 |
| Disallow | /data/thumbnails/24 |
| Disallow | /data/thumbnails/37 |
| Disallow | /data/thumbnails/35 |
| Disallow | /data/thumbnails/40 |
| Disallow | /data/thumbnails/25 |
| Disallow | /data/thumbnails/29 |
| Disallow | /categories.php?cat_id=60&page=1$ |
| Disallow | /categories.php?cat_id=59&page=1$ |
| Disallow | /categories.php?cat_id=48&page=1$ |
| Disallow | /categories.php?cat_id=57&page=1$ |
| Disallow | /categories.php?cat_id=56&page=1$ |
| Disallow | /categories.php?cat_id=55&page=1$ |
| Disallow | /categories.php?cat_id=54&page=1$ |
| Disallow | /categories.php?cat_id=53&page=1$ |
| Disallow | /categories.php?cat_id=52&page=1$ |
| Disallow | /categories.php?cat_id=68&page=1$ |
| Disallow | /categories.php?cat_id=61&page=1$ |
| Disallow | /categories.php?cat_id=62&page=1$ |
| Disallow | /categories.php?cat_id=33&page=1$ |
| Disallow | /categories.php?cat_id=32&page=1$ |
| Disallow | /categories.php?cat_id=22&page=1$ |
| Disallow | /categories.php?cat_id=51&page=1$ |
| Disallow | /categories.php?cat_id=30&page=1$ |
| Disallow | /categories.php?cat_id=63&page=1$ |
| Disallow | /categories.php?cat_id=64&page=1$ |
| Disallow | /categories.php?cat_id=65&page=1$ |
| Disallow | /categories.php?cat_id=66&page=1$ |
| Disallow | /index.php |
| Disallow | /*?sessionid= |
| Disallow | /*?l=english |
| Disallow | /*?l=vietnam |
| Disallow | /*?l=russian |
| Disallow | /*?l=nederlands |
| Disallow | /*?l=swedish |
| Disallow | /*?l=korean |
| Disallow | /*?l=french |
| Disallow | /*?l=indonesian |
| Disallow | /*?l=portuguese |
| Disallow | /*?l=greek |
| Disallow | /*?l=kurdish |
| Disallow | /*?l=Taiwan |
| Disallow | /*?l=magyar |
| Disallow | /*?l=chinese |
| Disallow | /*?l=polish |
| Disallow | /*?l=spanish |
| Disallow | /*?l=hebrew |
| Disallow | /*?l=farsi |
| Disallow | /*?l=turkey |
| Disallow | /*?l=bulgarian |
| Disallow | /*?l=Arabic |
| Disallow | /*?l=brazilian |
| Disallow | /*?l=slovensko |
| Disallow | /*?l=italian |
| Disallow | /*?l=srpski |
| Disallow | /*?l=deutsch |
| Disallow | /*%26mode%3Dsearch%28%26%7C%24%29 |
| Disallow | /search.php |
| Disallow | /temp/ |
| Disallow | /logfiles/ |
| Disallow | /cgi-bin/ |
| Disallow | /member.php |
| Disallow | /*.search.htm |
| Disallow | /rss.php |
| Allow | /templates/Iceberg/ |
| Allow | /Googlebot-Image |
| Allow | /data/media/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 15 |
mail.ru
| Rule | Path |
|---|---|
| Allow | /templates/Iceberg/images/style.css |
| Allow | /Googlebot-Image |
| Allow | /data/media/ |
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Disallow | /components/ |
| Disallow | /editor/ |
| Disallow | /help/ |
| Disallow | /includes/ |
| Disallow | /language/ |
| Disallow | /mambots/ |
| Disallow | /media/ |
| Disallow | /modules/ |
| Disallow | /templates/ |
| Disallow | /installation/ |
| Disallow | /links.html/ |
| Disallow | /search.php/ |
| Disallow | /category/law/ |
| Disallow | /ssilki.php* |
| Disallow | /*.zip$ |
| Disallow | /*.php?*sessionid= |
| Disallow | /*.php?*mode= |
| Disallow | /download.php* |
| Disallow | /search.php* |
| Disallow | /member.php* |
| Disallow | /article* |
| Disallow | /sitemap.php* |
| Disallow | /chclick.php* |
| Disallow | /data/media/19 |
| Disallow | /data/media/21 |
| Disallow | /data/media/36 |
| Disallow | /data/media/39 |
| Disallow | /data/media/41 |
| Disallow | /data/media/42 |
| Disallow | /data/media/47 |
| Disallow | /data/media/23 |
| Disallow | /data/media/24 |
| Disallow | /data/media/37 |
| Disallow | /data/media/35 |
| Disallow | /data/media/40 |
| Disallow | /data/media/25 |
| Disallow | /data/media/29 |
| Disallow | /data/thumbnails/19 |
| Disallow | /data/thumbnails/21 |
| Disallow | /data/thumbnails/36 |
| Disallow | /data/thumbnails/39 |
| Disallow | /data/thumbnails/41 |
| Disallow | /data/thumbnails/42 |
| Disallow | /data/thumbnails/47 |
| Disallow | /data/thumbnails/23 |
| Disallow | /data/thumbnails/24 |
| Disallow | /data/thumbnails/37 |
| Disallow | /data/thumbnails/35 |
| Disallow | /data/thumbnails/40 |
| Disallow | /data/thumbnails/25 |
| Disallow | /data/thumbnails/29 |
| Disallow | /categories.php?cat_id=60&page=1$ |
| Disallow | /categories.php?cat_id=59&page=1$ |
| Disallow | /categories.php?cat_id=48&page=1$ |
| Disallow | /categories.php?cat_id=57&page=1$ |
| Disallow | /categories.php?cat_id=56&page=1$ |
| Disallow | /categories.php?cat_id=55&page=1$ |
| Disallow | /categories.php?cat_id=54&page=1$ |
| Disallow | /categories.php?cat_id=53&page=1$ |
| Disallow | /categories.php?cat_id=52&page=1$ |
| Disallow | /categories.php?cat_id=68&page=1$ |
| Disallow | /categories.php?cat_id=61&page=1$ |
| Disallow | /categories.php?cat_id=62&page=1$ |
| Disallow | /categories.php?cat_id=33&page=1$ |
| Disallow | /categories.php?cat_id=32&page=1$ |
| Disallow | /categories.php?cat_id=22&page=1$ |
| Disallow | /categories.php?cat_id=51&page=1$ |
| Disallow | /categories.php?cat_id=30&page=1$ |
| Disallow | /categories.php?cat_id=63&page=1$ |
| Disallow | /categories.php?cat_id=64&page=1$ |
| Disallow | /categories.php?cat_id=65&page=1$ |
| Disallow | /categories.php?cat_id=66&page=1$ |
| Disallow | /index.php |
| Disallow | /*?sessionid= |
| Disallow | /*?l=english |
| Disallow | /*?l=vietnam |
| Disallow | /*?l=russian |
| Disallow | /*?l=nederlands |
| Disallow | /*?l=swedish |
| Disallow | /*?l=korean |
| Disallow | /*?l=french |
| Disallow | /*?l=indonesian |
| Disallow | /*?l=portuguese |
| Disallow | /*?l=greek |
| Disallow | /*?l=kurdish |
| Disallow | /*?l=Taiwan |
| Disallow | /*?l=magyar |
| Disallow | /*?l=chinese |
| Disallow | /*?l=polish |
| Disallow | /*?l=spanish |
| Disallow | /*?l=hebrew |
| Disallow | /*?l=farsi |
| Disallow | /*?l=turkey |
| Disallow | /*?l=bulgarian |
| Disallow | /*?l=Arabic |
| Disallow | /*?l=brazilian |
| Disallow | /*?l=slovensko |
| Disallow | /*?l=italian |
| Disallow | /*?l=srpski |
| Disallow | /*?l=deutsch |
| Disallow | /*%26mode%3Dsearch%28%26%7C%24%29 |
| Disallow | /search.php |
| Disallow | /temp/ |
| Disallow | /logfiles/ |
| Disallow | /cgi-bin/ |
| Disallow | /member.php |
| Disallow | /*.search.htm |
| Disallow | /rss.php |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 15 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://moregirls.org/sitemap.xml |
| sitemap | http://moregirls.org/sitemap.xml |
| sitemap | http://moregirls.org/sitemap.xml |
| sitemap | http://moregirls.org/sitemap.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.
Comments