arbusers.com
robots.txt
Robots Exclusion Standard data for arbusers.com
Resource Scan
Scan Details
| Site Domain | arbusers.com |
| Base Domain | arbusers.com |
| Scan Status | Ok |
| Last Scan | 2026-02-13T02:11:25+00:00 |
| Next Scan | 2026-03-15T02:11:25+00:00 |
Last Scan
| Scanned | 2026-02-13T02:11:25+00:00 |
| URL | https://arbusers.com/robots.txt |
| Domain IPs | 104.26.6.92, 104.26.7.92, 172.67.70.173, 2606:4700:20::681a:65c, 2606:4700:20::681a:75c, 2606:4700:20::ac43:46ad |
| Response IP | 104.26.7.92 |
| Found | Yes |
| Hash | 976f575fcb50cba194612fbda94506f1f343970edfc17e5659398c5b0adff8a2 |
| SimHash | 0a7490840114 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /adm/ |
| Disallow | /cache/ |
| Disallow | /files/ |
| Disallow | /includes/ |
| Disallow | /language/ |
| Disallow | /store/ |
| Disallow | /common.php |
| Disallow | /config.php |
| Disallow | /cron.php |
| Disallow | /*faq |
| Disallow | /mcp.php |
| Disallow | /memberlist.php |
| Disallow | /memberlist_fields.php |
| Disallow | /thankslist.php |
| Disallow | /posting.php |
| Disallow | /recent.php |
| Disallow | /report.php |
| Disallow | /search.php |
| Disallow | /style.php |
| Disallow | /ucp.php |
| Disallow | /go.php |
| Disallow | /viewonline.php |
| Disallow | /*%26st%3D |
| Disallow | /*%26sk%3D* |
| Disallow | /*%26sd%3D* |
| Disallow | /*%26hilit%3D* |
| Disallow | /*%26view%3D* |
| Disallow | /viewtopic.php* |
| Disallow | /reputation/* |
| Disallow | /member/* |
| Disallow | /viewtopic.php |
| Disallow | /viewforum.php |
| Disallow | /viewforum.php* |
| Disallow | /view*%26start%3D0$ |
| Disallow | /redirect.php |
Other Records
| Field | Value |
|---|---|
| sitemap | https://arbusers.com/sitemap.xml |
Warnings
- `host` is not a known field.