agrotrader.pl
robots.txt
Robots Exclusion Standard data for agrotrader.pl
Resource Scan
Scan Details
| Site Domain | agrotrader.pl |
| Base Domain | agrotrader.pl |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-10-28T15:57:42+00:00 |
| Next Scan | 2025-11-27T15:57:42+00:00 |
Last Successful Scan
| Scanned | 2025-09-29T06:52:46+00:00 |
| URL | https://agrotrader.pl/robots.txt |
| Domain IPs | 188.210.222.2 |
| Response IP | 188.210.222.2 |
| Found | Yes |
| Hash | 62813e6287ab18071650d56d17af15f079b4957f8b49bf4fa28a8f6d4a8a050c |
| SimHash | 2004ca12c0b2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /nowe-ogloszenie |
| Disallow | /aktywacja-ogloszenia |
| Disallow | /moje-konto |
| Disallow | /moje-konto/* |
| Disallow | /api/v1/* |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | http://agrotrader.pl/sitemaps/index.xml |
| sitemap | http://agrotrader.pl/sitemaps/towns-categories-brands-index.xml |
| sitemap | http://agrotrader.pl/sitemaps/regions-categories-brands-index.xml |
| sitemap | http://agrotrader.pl/sitemaps/towns-categories-index.xml |