bigdreams.com
robots.txt
Robots Exclusion Standard data for bigdreams.com
Resource Scan
Scan Details
| Site Domain | bigdreams.com |
| Base Domain | bigdreams.com |
| Scan Status | Ok |
| Last Scan | 2024-06-17T09:11:54+00:00 |
| Next Scan | 2024-07-17T09:11:54+00:00 |
Last Scan
| Scanned | 2024-06-17T09:11:54+00:00 |
| URL | http://bigdreams.com/robots.txt |
| Redirect | http://www.bigdreams.com/robots.txt |
| Redirect Domain | www.bigdreams.com |
| Redirect Base | bigdreams.com |
| Domain IPs | 198.185.159.176, 198.185.159.177, 198.49.23.176, 198.49.23.177 |
| Redirect IPs | 198.185.159.176, 198.185.159.177, 198.49.23.176, 198.49.23.177 |
| Response IP | 198.49.23.176 |
| Found | Yes |
| Hash | 26b19050f73af101a830443482570a1de8fa4a965771435877f0425093bf637c |
| SimHash | 5a5d73e02ff4 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /display/admin/ |
| Disallow | /display/Search |
| Disallow | /display/Login |
| Disallow | /display/RecoverPassword |
| Disallow | /login |
| Disallow | /contributor |
| Disallow | /big-dreams/category |
| Disallow | /big-dreams/week |
| Disallow | /big-dreams/month |
| Disallow | /big-dreams/recommend |
| Disallow | /big-dreams/author |
| Disallow | /login |
| Disallow | /divine-elements/category |
| Disallow | /divine-elements/week |
| Disallow | /divine-elements/month |
| Disallow | /divine-elements/recommend |
| Disallow | /divine-elements/author |
| Disallow | /god-for-engineers/category |
| Disallow | /god-for-engineers/week |
| Disallow | /god-for-engineers/month |
| Disallow | /god-for-engineers/recommend |
| Disallow | /god-for-engineers/author |
| Disallow | /evil-8/category |
| Disallow | /evil-8/week |
| Disallow | /evil-8/month |
| Disallow | /evil-8/recommend |
| Disallow | /evil-8/author |
| Disallow | /pumpkin-pancakes/category |
| Disallow | /pumpkin-pancakes/week |
| Disallow | /pumpkin-pancakes/month |
| Disallow | /pumpkin-pancakes/recommend |
| Disallow | /pumpkin-pancakes/author |
| Disallow | /amazing-bagels/category |
| Disallow | /amazing-bagels/week |
| Disallow | /amazing-bagels/month |
| Disallow | /amazing-bagels/recommend |
| Disallow | /amazing-bagels/author |
| Disallow | /factor-table/category |
| Disallow | /factor-table/week |
| Disallow | /factor-table/month |
| Disallow | /factor-table/recommend |
| Disallow | /factor-table/author |
| Disallow | /pad-computing/category |
| Disallow | /pad-computing/week |
| Disallow | /pad-computing/month |
| Disallow | /pad-computing/recommend |
| Disallow | /pad-computing/author |
| Disallow | /true-freedoms/category |
| Disallow | /true-freedoms/week |
| Disallow | /true-freedoms/month |
| Disallow | /true-freedoms/recommend |
| Disallow | /true-freedoms/author |
| Disallow | /fine-wines/category |
| Disallow | /fine-wines/week |
| Disallow | /fine-wines/month |
| Disallow | /fine-wines/recommend |
| Disallow | /fine-wines/author |
Comments