a-parser.com
robots.txt
Robots Exclusion Standard data for a-parser.com
Resource Scan
Scan Details
| Site Domain | a-parser.com |
| Base Domain | a-parser.com |
| Scan Status | Ok |
| Last Scan | 2026-01-29T21:11:44+00:00 |
| Next Scan | 2026-02-28T21:11:44+00:00 |
Last Scan
| Scanned | 2026-01-29T21:11:44+00:00 |
| URL | https://a-parser.com/robots.txt |
| Domain IPs | 104.26.6.13, 104.26.7.13, 172.67.72.246, 2606:4700:20::681a:60d, 2606:4700:20::681a:70d, 2606:4700:20::ac43:48f6 |
| Response IP | 104.26.7.13 |
| Found | Yes |
| Hash | 010fc8820cf522e7342ef4b6a6a9b22f5d059dafa30dd47c4c12468c0bbec1e5 |
| SimHash | 1d10ef64e98a |
Groups
*
| Rule | Path |
|---|---|
| Disallow | */authors |
| Disallow | *.rss |
| Disallow | */embed |
| Disallow | *utm*%3D |
| Disallow | */users |
| Disallow | */files |
| Disallow | */download |
| Disallow | */conversations |
| Disallow | */account |
| Disallow | */members-area |
| Disallow | */attachments |
| Disallow | *openstat%3D |
| Disallow | /online/ |
| Disallow | /goto/ |
| Disallow | /tags |
| Disallow | /search |
| Disallow | /misc/quick-navigation-menu |
| Disallow | /recent-activity |
| Disallow | *order*%3D |
| Disallow | */update-likes |
| Disallow | */like |
| Disallow | /posts/ |
| Disallow | *?prefix_id |
| Disallow | *?direction |
| Disallow | */poll |
| Disallow | /proxy.php* |
Warnings
- `host` is not a known field.