cargo.pl
robots.txt

Robots Exclusion Standard data for cargo.pl

Resource Scan

Scan Details

Site Domain cargo.pl
Base Domain cargo.pl
Scan Status Ok
Last Scan2024-06-16T00:44:32+00:00
Next Scan 2024-06-30T00:44:32+00:00

Last Scan

Scanned2024-06-16T00:44:32+00:00
URL https://cargo.pl/robots.txt
Redirect https://www.cargo.pl/robots.txt
Redirect Domain www.cargo.pl
Redirect Base cargo.pl
Domain IPs 104.26.12.40, 104.26.13.40, 172.67.69.201, 2606:4700:20::681a:c28, 2606:4700:20::681a:d28, 2606:4700:20::ac43:45c9
Redirect IPs 104.26.12.40, 104.26.13.40, 172.67.69.201, 2606:4700:20::681a:c28, 2606:4700:20::681a:d28, 2606:4700:20::ac43:45c9
Response IP 104.26.12.40
Found Yes
Hash d8c03973662c4ad4527d6a3dee2c4f7d88c9e895dfefc5c97d24e755468ea649
SimHash c2bb59a42d96

Groups

*

Rule Path
Disallow /api/
Disallow /bills/
Disallow /certificates_files/
Disallow /cnt_contracts/
Disallow /cnt_stampsigns/
Disallow /companies_debts_files/
Disallow /companies_documents/
Disallow /companies_bills_pp/
Disallow /companies_incasso/
Disallow /account_passports/
Disallow /kurs/
Disallow /manage/
Disallow /manager/
Disallow /import_files/
Disallow /import_offers_files/
Disallow /voip/
Disallow /asp/compinfo.asp
Disallow /blacklist_files/
Disallow /forum/
Disallow /timocom/
Disallow /payments/
Disallow /ratenotes_files/
Disallow /forum_files/
Disallow /jadvice_files/
Disallow /?*
Disallow /asp/index.asp?*
Disallow /asp/cargoslist.asp?*
Disallow /asp/translist.asp?*
Disallow /manage/addcargo.asp?*
Disallow /manage/addtrans.asp?*
Disallow /asp/catalog.asp?*
Disallow /asp/blacklist.asp?*
Disallow /asp/classified.asp?*
Disallow /asp/sales_list.asp?*
Disallow /asp/legals.asp?*
Disallow /asp/advert10.asp?*
Disallow /manage/sales_add.asp?*
Disallow /manage/sales_list.asp?*
Disallow /asp/crts_*
Disallow /routes/*
Allow /manage/addcargo.asp
Allow /manage/addtrans.asp

Other Records

Field Value
sitemap https://cargo.lt/sitemap.xml
sitemap https://cargo.lt/sitemap_1_forum_LT.xml
sitemap https://cargo.lt/sitemap_1_forum_PL.xml
sitemap https://cargo.lt/sitemap_1_forum_RU.xml
sitemap https://cargo.lt/sitemap_pl.xml
sitemap https://cargo.lt/sitemap_15_forum_PL.xml
sitemap https://cargo.lt/sitemap_lv.xml
sitemap https://cargo.lt/sitemap_es.xml
sitemap https://cargo.lt/sitemap_kz.xml