foreverdreaming.org
robots.txt
Robots Exclusion Standard data for foreverdreaming.org
Resource Scan
Scan Details
| Site Domain | foreverdreaming.org |
| Base Domain | foreverdreaming.org |
| Scan Status | Ok |
| Last Scan | 2024-11-09T02:27:21+00:00 |
| Next Scan | 2024-11-16T02:27:21+00:00 |
Last Scan
| Scanned | 2024-11-09T02:27:21+00:00 |
| URL | https://foreverdreaming.org/robots.txt |
| Domain IPs | 216.37.42.25 |
| Response IP | 216.37.42.25 |
| Found | Yes |
| Hash | 5d82acbc295e22b2ca789aeb7dd33be8e6bd8220ac27275942120c2a4fc2991a |
| SimHash | 6e5c4bc042b5 |
Groups
acoon
ahrefsbot
baiduspider
baiduspider-video
baiduspider-image
butterfly
discobot
dotbot
ezooms
googlebot-image
magpie-crawler
mj12bot
msnbot-media
panscient.com
psbot
semrushbot
semrushbot-sa
seokicks-robot
seznambot
sistrix
sogou spider
sosospider
xovibot
yahoo-mmcrawler
yandex
yodaobot
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /posting.php |
| Disallow | /search.php |
| Disallow | /ucp.php |
| Disallow | /mcp.php |
| Disallow | /memberlist.php |
| Disallow | /login.php |
| Disallow | /faq.php |
| Disallow | /feed.php |
| Disallow | /viewonline.php |
| Disallow | /*%26view%3Dprevious |
| Disallow | /*%26view%3Dnext |
| Disallow | /*%26sid%3D |
| Disallow | /*?p= |
| Disallow | /*%26p%3D |
| Disallow | /*%26sd%3Da |
| Disallow | /*%26start%3D0 |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 30 |
mediapartners-google
| Rule | Path |
|---|---|
| Disallow | /posting.php |
| Disallow | /search.php |
| Disallow | /ucp.php |
| Disallow | /mcp.php |
| Disallow | /memberlist.php |
| Disallow | /login.php |
| Disallow | /faq.php |
| Disallow | /feed.php |
| Disallow | /viewonline.php |
googlebot
| Rule | Path |
|---|---|
| Disallow | /posting.php |
| Disallow | /search.php |
| Disallow | /ucp.php |
| Disallow | /mcp.php |
| Disallow | /memberlist.php |
| Disallow | /login.php |
| Disallow | /faq.php |
| Disallow | /feed.php |
| Disallow | /viewonline.php |
| Disallow | /*%26view%3Dprevious |
| Disallow | /*%26view%3Dnext |
| Disallow | /*%26sid%3D |
| Disallow | /*?p= |
| Disallow | /*%26p%3D |
| Disallow | /*%26sd%3Da |
| Disallow | /*%26start%3D0 |
bingbot
| Rule | Path |
|---|---|
| Disallow | /posting.php |
| Disallow | /search.php |
| Disallow | /ucp.php |
| Disallow | /mcp.php |
| Disallow | /memberlist.php |
| Disallow | /login.php |
| Disallow | /faq.php |
| Disallow | /feed.php |
| Disallow | /viewonline.php |
| Disallow | /viewtopic.php?t= |
| Disallow | /*%26view%3Dprevious |
| Disallow | /*%26view%3Dnext |
| Disallow | /*%26sid%3D |
| Disallow | /*?p= |
| Disallow | /*%26p%3D |
| Disallow | /*%26sd%3Da |
| Disallow | /*%26start%3D0 |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 30 |