grouple.co
robots.txt
Robots Exclusion Standard data for grouple.co
Resource Scan
Scan Details
| Site Domain | grouple.co |
| Base Domain | grouple.co |
| Scan Status | Ok |
| Last Scan | 2024-11-09T10:27:01+00:00 |
| Next Scan | 2024-11-16T10:27:01+00:00 |
Last Scan
| Scanned | 2024-11-09T10:27:01+00:00 |
| URL | https://grouple.co/robots.txt |
| Redirect | https://1.grouple.co/robots.txt |
| Redirect Domain | 1.grouple.co |
| Redirect Base | grouple.co |
| Domain IPs | 82.118.242.218 |
| Redirect IPs | 82.118.242.218 |
| Response IP | 82.118.242.218 |
| Found | Yes |
| Hash | f7fba0290bc65e7c9aa3d2d548bbe0677b5548fca2f521bdb5f5b5ab66809fc6 |
| SimHash | 26069a63c030 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /private/ajax/* |
| Disallow | /forum/rss/* |
| Disallow | /user/rss/* |
| Disallow | /forum/posts/preList/* |
| Disallow | /forum/posts/listByUser/* |
| Disallow | /forum/recentTopics/showTopicsByUser/* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://1.grouple.co/sitemap_index.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.
- `request-rate` is not a known field.
- `visit-time` is not a known field.