agar-io.ru
robots.txt
Robots Exclusion Standard data for agar-io.ru
Resource Scan
Scan Details
| Site Domain | agar-io.ru |
| Base Domain | agar-io.ru |
| Scan Status | Ok |
| Last Scan | 2024-10-20T23:42:14+00:00 |
| Next Scan | 2024-11-19T23:42:14+00:00 |
Last Scan
| Scanned | 2024-10-20T23:42:14+00:00 |
| URL | https://agar-io.ru/robots.txt |
| Domain IPs | 104.21.29.37, 172.67.148.83, 2606:4700:3030::ac43:9453, 2606:4700:3035::6815:1d25 |
| Response IP | 104.21.29.37 |
| Found | Yes |
| Hash | 64f4b3be71a28224317aceefdd86296bf502a72a9499c0f901be8b8173ee139d |
| SimHash | 71045f17dc78 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /tags/* |
| Disallow | /tags$ |
| Disallow | /taxanomy/* |
| Disallow | /taxanomy$ |
| Disallow | /user/* |
| Disallow | /*?quicktabs_* |
| Disallow | /*%26quicktabs_* |
| Disallow | /database/ |
| Disallow | /includes/ |
| Disallow | /misc/ |
| Disallow | /modules/ |
| Disallow | /sites/ |
| Disallow | /themes/ |
| Disallow | /scripts/ |
| Disallow | /updates/ |
| Disallow | /profiles/ |
| Disallow | /xmlrpc.php |
| Disallow | /cron.php |
| Disallow | /update.php |
| Disallow | /install.php |
| Disallow | /index.php |
| Disallow | /admin/ |
| Disallow | /comment/reply/ |
| Disallow | /comment/* |
| Disallow | /contact/ |
| Disallow | /logout/ |
| Disallow | /search/ |
| Disallow | /user/register/ |
| Disallow | /user/password/ |
| Disallow | /user/login/ |
| Disallow | /user/logout/ |
| Disallow | /messages/ |
| Disallow | /book/export/ |
| Disallow | /user2userpoints/ |
| Disallow | /myuserpoints/ |
| Disallow | /tagadelic/ |
| Disallow | /referral/ |
| Disallow | /aggregator/ |
| Disallow | /files/pin/ |
| Disallow | /your-votes |
| Disallow | /comments/recent |
| Disallow | /*/edit/ |
| Disallow | /*/delete/ |
| Disallow | /*/export/html/ |
| Disallow | /taxonomy/term/*/0$ |
| Disallow | /*/edit$ |
| Disallow | /*/outline$ |
| Disallow | /*/revisions$ |
| Disallow | /*/contact$ |
| Disallow | /*downloadpipe |
| Disallow | /guides/cata$ |
| Disallow | /guides/lich$ |
| Disallow | /bugs/cata$ |
| Disallow | /bugs/lich$ |
| Disallow | /shoutbox |
| Disallow | /events/$ |
| Disallow | /shout/* |
| Disallow | /shout$ |
| Disallow | /node/*/track$ |
| Disallow | /*%26 |
| Disallow | /*% |
| Disallow | /*?page=0 |
| Disallow | /*?page= |
| Disallow | /*? |
| Disallow | /node$ |
| Disallow | /node/* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | http://agar-io.ru/sitemap.xml |
Warnings
- `host` is not a known field.