grabo.bg
robots.txt
Robots Exclusion Standard data for grabo.bg
Resource Scan
Scan Details
| Site Domain | grabo.bg |
| Base Domain | grabo.bg |
| Scan Status | Ok |
| Last Scan | 2024-09-22T00:58:50+00:00 |
| Next Scan | 2024-09-29T00:58:50+00:00 |
Last Scan
| Scanned | 2024-09-22T00:58:50+00:00 |
| URL | https://grabo.bg/robots.txt |
| Domain IPs | 78.128.9.49 |
| Response IP | 78.128.9.49 |
| Found | Yes |
| Hash | 3980431257a8cfa6104fb5ca6ad4b140ae58aad26f4addec4d631932f880d2d3 |
| SimHash | 1b48cc7be572 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /ajax/ |
| Disallow | /flybox/ |
| Disallow | /check/ |
| Disallow | /banners/ |
| Disallow | /cart/ |
| Disallow | /deal/buy/ |
| Disallow | /deal/choosevariant/ |
| Disallow | /vouchers/ |
| Disallow | /grabons/ |
| Disallow | /discussions/ |
| Disallow | /externallinkscounter/ |
| Disallow | /exit/ |
| Disallow | /like/ |
| Disallow | /api/ |
| Disallow | /places/ajax/ |
| Disallow | /business/ajax/ |
| Disallow | /rss/ |
| Disallow | /members/getusertipinfo/ |
| Disallow | /terms/ |
| Disallow | /searchredir/ |
| Disallow | /places/flyboxpricelist/ |
| Allow | / |