cargo.pl
robots.txt
Robots Exclusion Standard data for cargo.pl
Resource Scan
Scan Details
| Site Domain | cargo.pl |
| Base Domain | cargo.pl |
| Scan Status | Ok |
| Last Scan | 2024-06-16T00:44:32+00:00 |
| Next Scan | 2024-06-30T00:44:32+00:00 |
Last Scan
| Scanned | 2024-06-16T00:44:32+00:00 |
| URL | https://cargo.pl/robots.txt |
| Redirect | https://www.cargo.pl/robots.txt |
| Redirect Domain | www.cargo.pl |
| Redirect Base | cargo.pl |
| Domain IPs | 104.26.12.40, 104.26.13.40, 172.67.69.201, 2606:4700:20::681a:c28, 2606:4700:20::681a:d28, 2606:4700:20::ac43:45c9 |
| Redirect IPs | 104.26.12.40, 104.26.13.40, 172.67.69.201, 2606:4700:20::681a:c28, 2606:4700:20::681a:d28, 2606:4700:20::ac43:45c9 |
| Response IP | 104.26.12.40 |
| Found | Yes |
| Hash | d8c03973662c4ad4527d6a3dee2c4f7d88c9e895dfefc5c97d24e755468ea649 |
| SimHash | c2bb59a42d96 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /api/ |
| Disallow | /bills/ |
| Disallow | /certificates_files/ |
| Disallow | /cnt_contracts/ |
| Disallow | /cnt_stampsigns/ |
| Disallow | /companies_debts_files/ |
| Disallow | /companies_documents/ |
| Disallow | /companies_bills_pp/ |
| Disallow | /companies_incasso/ |
| Disallow | /account_passports/ |
| Disallow | /kurs/ |
| Disallow | /manage/ |
| Disallow | /manager/ |
| Disallow | /import_files/ |
| Disallow | /import_offers_files/ |
| Disallow | /voip/ |
| Disallow | /asp/compinfo.asp |
| Disallow | /blacklist_files/ |
| Disallow | /forum/ |
| Disallow | /timocom/ |
| Disallow | /payments/ |
| Disallow | /ratenotes_files/ |
| Disallow | /forum_files/ |
| Disallow | /jadvice_files/ |
| Disallow | /?* |
| Disallow | /asp/index.asp?* |
| Disallow | /asp/cargoslist.asp?* |
| Disallow | /asp/translist.asp?* |
| Disallow | /manage/addcargo.asp?* |
| Disallow | /manage/addtrans.asp?* |
| Disallow | /asp/catalog.asp?* |
| Disallow | /asp/blacklist.asp?* |
| Disallow | /asp/classified.asp?* |
| Disallow | /asp/sales_list.asp?* |
| Disallow | /asp/legals.asp?* |
| Disallow | /asp/advert10.asp?* |
| Disallow | /manage/sales_add.asp?* |
| Disallow | /manage/sales_list.asp?* |
| Disallow | /asp/crts_* |
| Disallow | /routes/* |
| Allow | /manage/addcargo.asp |
| Allow | /manage/addtrans.asp |
Other Records
| Field | Value |
|---|---|
| sitemap | https://cargo.lt/sitemap.xml |
| sitemap | https://cargo.lt/sitemap_1_forum_LT.xml |
| sitemap | https://cargo.lt/sitemap_1_forum_PL.xml |
| sitemap | https://cargo.lt/sitemap_1_forum_RU.xml |
| sitemap | https://cargo.lt/sitemap_pl.xml |
| sitemap | https://cargo.lt/sitemap_15_forum_PL.xml |
| sitemap | https://cargo.lt/sitemap_lv.xml |
| sitemap | https://cargo.lt/sitemap_es.xml |
| sitemap | https://cargo.lt/sitemap_kz.xml |