crowds.idrowiki.org
robots.txt
Robots Exclusion Standard data for crowds.idrowiki.org
Resource Scan
Scan Details
| Site Domain | crowds.idrowiki.org |
| Base Domain | idrowiki.org |
| Scan Status | Ok |
| Last Scan | 2025-12-02T06:59:35+00:00 |
| Next Scan | 2025-12-09T06:59:35+00:00 |
Last Scan
| Scanned | 2025-12-02T06:59:35+00:00 |
| URL | https://crowds.idrowiki.org/robots.txt |
| Domain IPs | 104.21.52.29, 172.67.194.156, 2606:4700:3031::6815:341d, 2606:4700:3032::ac43:c29c |
| Response IP | 172.67.194.156 |
| Found | Yes |
| Hash | 5dcdc7389d1bbf48edfa1ec3cc89a1bec83827717306aff4c3a3b383cde7dee2 |
| SimHash | c015c9c47277 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /site.html |
| Disallow | /cgi-bin/ |
| Disallow | /system/ |
| Disallow | /backend/* |
| Disallow | /welcome/* |
| Disallow | /index.php/backend/* |
| Disallow | /index.php/welcome/* |
| Disallow | /*/backend/* |
| Disallow | /*/welcome/* |
Other Records
| Field | Value |
|---|---|
| sitemap | http://crowds.idrowiki.org/sitemap-server.xml |
| sitemap | http://crowds.idrowiki.org/sitemap-tag.xml |
| sitemap | http://crowds.idrowiki.org/sitemap-group.xml |
| sitemap | http://crowds.idrowiki.org/sitemap-user.xml |
| sitemap | http://crowds.idrowiki.org/sitemap-msg.xml |
Comments