itclub.me
robots.txt
Robots Exclusion Standard data for itclub.me
Resource Scan
Scan Details
| Site Domain | itclub.me |
| Base Domain | itclub.me |
| Scan Status | Ok |
| Last Scan | 2024-06-08T14:50:00+00:00 |
| Next Scan | 2024-07-08T14:50:00+00:00 |
Last Scan
| Scanned | 2024-06-08T14:50:00+00:00 |
| URL | https://itclub.me/robots.txt |
| Domain IPs | 104.21.36.214, 172.67.199.193, 2606:4700:3034::6815:24d6, 2606:4700:3037::ac43:c7c1 |
| Response IP | 104.21.36.214 |
| Found | Yes |
| Hash | 869244cf392d7272b597b60cf0666baa99a2943b953ace4d3f4d41bfa32267f4 |
| SimHash | 7cd9cc4242a5 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /register.html |
| Disallow | /account/ |
| Disallow | /roscomsos/ |
| Disallow | /DUMPER/ |
| Disallow | /admin.php |
| Disallow | /attachments/ |
| Disallow | /birthdays/ |
| Disallow | /conversations/ |
| Disallow | /find-new/ |
| Disallow | /*/?direction |
| Disallow | /*/?order |
| Disallow | /*/mark-read?date |
| Disallow | /*/page-*?order |
| Disallow | /help/ |
| Disallow | /js/ |
| Disallow | /logout/ |
| Disallow | /login/ |
| Disallow | /lost-password/ |
| Disallow | /goto/ |
| Disallow | /members/ |
| Disallow | /moderation-queue/ |
| Disallow | /misc/ |
| Disallow | /online/ |
| Disallow | /pages/privacy/ |
| Disallow | /posts/ |
| Disallow | /recent-activity/ |
| Disallow | /register |
| Disallow | /resources/?order |
| Disallow | /resources/*/download?version |
| Disallow | /resources/*/history |
| Disallow | /resources/*/update?resource_update_id |
| Disallow | /resources/authors/ |
| Disallow | /resources/categories/*/?order |
| Disallow | /search |
| Disallow | /search.php |
| Disallow | /threads/*/poll |
| Disallow | /threads/*/reply |
| Disallow | /watched/ |
| Disallow | /WhoHasVisited/ |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://itclub.me/sitemap.php |
Warnings
- `host` is not a known field.