it.kompass.com
robots.txt

Robots Exclusion Standard data for it.kompass.com

Resource Scan

Scan Details

Site Domain it.kompass.com
Base Domain kompass.com
Scan Status Ok
Last Scan2025-10-10T21:40:26+00:00
Next Scan 2025-11-09T21:40:26+00:00

Last Scan

Scanned2025-10-10T21:40:26+00:00
URL https://it.kompass.com/robots.txt
Domain IPs 98.64.137.26
Response IP 98.64.137.26
Found Yes
Hash 366b40c2cb593799d7e9deccaf56d43400f997cb6ad1f3eecaf6de436c66032c
SimHash 0a7ccc22ae73

Groups

*

Rule Path
Disallow /en/
Disallow /searchCompanies
Disallow /logCompanyView
Disallow /logAdvertisements
Disallow /getAdvertisements
Disallow /getTop3CompanyDataList
Disallow /getTop3CompanyData
Disallow /buy-company-list/activityCode/*
Disallow /buy-company-list/localizationCode/*
Disallow /login
Disallow /cart
Disallow /checkout
Disallow /selectcountry
Disallow /sendReferrer
Disallow /ebol*
Disallow /ip
Disallow /referrer
Disallow /transfer*
Disallow /search*
Disallow /getRegions*
Disallow /*?_nfbsp*
Disallow /*?_redirectState*
Disallow /*?_id_souchaine*
Disallow /ar/
Disallow /cs/
Disallow /da/
Disallow /de/
Disallow /es/
Disallow /fi/
Disallow /fr/
Disallow /hr/
Disallow /hu/
Disallow /ja/
Disallow /lv/
Disallow /nl/
Disallow /no/
Disallow /pl/
Disallow /pt/
Disallow /ro/
Disallow /ru/
Disallow /sk/
Disallow /sl/
Disallow /sr/
Disallow /sv/
Disallow /tr/
Disallow /zh/
Disallow /v/
Disallow */v/
Disallow /*?

ahrefsbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

Comments

  • https://megaindex.com/crawler