netbarg.com
robots.txt
Robots Exclusion Standard data for netbarg.com
Resource Scan
Scan Details
| Site Domain | netbarg.com |
| Base Domain | netbarg.com |
| Scan Status | Ok |
| Last Scan | 2025-11-05T03:08:21+00:00 |
| Next Scan | 2025-12-05T03:08:21+00:00 |
Last Scan
| Scanned | 2025-11-05T03:08:21+00:00 |
| URL | https://netbarg.com/robots.txt |
| Domain IPs | 185.143.232.201, 185.143.235.201 |
| Response IP | 185.143.232.201 |
| Found | Yes |
| Hash | be6bc5adbfb516ca5b6826cbd777a7619cdf562e1df43544b60cb343ebc13383 |
| SimHash | ed67d8140c90 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | */auth |
| Disallow | */baskets |
| Disallow | */buy |
| Disallow | */cat%3A* |
| Disallow | */deal/* |
| Disallow | */subscribe |
| Disallow | */users |
| Disallow | /*city_slug%3D* |
| Disallow | /*data-value%3D* |
| Disallow | /*type%3D* |
| Disallow | /*site1 |
| Disallow | /*site2 |
| Disallow | /*site3 |
| Disallow | /*v3.backup |
| Disallow | /cgi-bin |
| Disallow | /dev* |
| Disallow | /dev3* |
| Disallow | /junk |
| Disallow | /nbmap |
| Disallow | /tmp |
| Disallow | /blog |
| Disallow | */topic_discussions/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://netbarg.com/sitemap-index.xml |