indiawebonline.com
robots.txt
Robots Exclusion Standard data for indiawebonline.com
Resource Scan
Scan Details
| Site Domain | indiawebonline.com |
| Base Domain | indiawebonline.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 4/10/2025, 11:54:44 PM |
| Next Scan | 7/9/2025, 11:54:44 PM |
Last Successful Scan
| Scanned | 3/23/2023, 8:55:33 PM |
| URL | https://indiawebonline.com/robots.txt |
| Redirect | https://www.indiawebonline.com/robots.txt |
| Redirect Domain | www.indiawebonline.com |
| Redirect Base | indiawebonline.com |
| Domain IPs | 104.21.3.195, 172.67.131.34, 2606:4700:3031::6815:3c3, 2606:4700:3037::ac43:8322 |
| Redirect IPs | 104.21.3.195, 172.67.131.34, 2606:4700:3031::6815:3c3, 2606:4700:3037::ac43:8322 |
| Response IP | 104.21.3.195 |
| Found | Yes |
| Hash | 45c3d0968bfb015151d00bcae24992be9a7ab28740606d11ca94043f10837fcc |
| SimHash | 055bcc66e511 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /account/ |
| Disallow | /admin.php |
| Disallow | /conversations/ |
| Disallow | /find-threads/ |
| Disallow | /forums/*/create-thread |
| Disallow | /forums/*/post-thread |
| Disallow | /goto/ |
| Disallow | /job.php |
| Disallow | /login/ |
| Disallow | /logout/ |
| Disallow | /lost-password/ |
| Disallow | /members/ |
| Disallow | /misc/ |
| Disallow | /online/ |
| Disallow | /posts/ |
| Disallow | /profile-posts/ |
| Disallow | /register/ |
| Disallow | /search/ |
| Disallow | /threads/*/add-reply |
| Disallow | /threads/*/approve |
| Disallow | /threads/*/draft |
| Disallow | /threads/*/reply |
| Disallow | /help/* |
| Disallow | /threads/*/unread |
| Disallow | /whats-new/ |
| Disallow | /data/avatars/* |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.indiawebonline.com/sitemap.xml |