kompass.com
robots.txt

Robots Exclusion Standard data for kompass.com

Resource Scan

Scan Details

Site Domain kompass.com
Base Domain kompass.com
Scan Status Ok
Last Scan2024-09-19T13:11:12+00:00
Next Scan 2024-09-26T13:11:12+00:00

Last Scan

Scanned2024-09-19T13:11:12+00:00
URL https://www.kompass.com/robots.txt
Domain IPs 98.64.137.26
Response IP 98.64.137.26
Found Yes
Hash cc4152171369c8be6c07d17fbc45a22e8daa67a9a10bd09296ac21d9cf95bb4e
SimHash ca1cd460ef73

Groups

*

Rule Path
Disallow /o/
Disallow /searchCompanies
Disallow /logCompanyView
Disallow /logAdvertisements
Disallow /getAdvertisements
Disallow /getTop3CompanyDataList
Disallow /getTop3CompanyData
Disallow /buy-company-list/activityCode/*
Disallow /buy-company-list/localizationCode/*
Disallow /about/
Disallow /c/
Disallow */z/*/news/
Disallow /sendReferrer
Disallow /ebol*
Disallow /ip
Disallow /referrer
Disallow /transfer*
Disallow /search*
Disallow /getRegions*
Disallow /*?_nfbsp*
Disallow /*?_redirectState*
Disallow /*?_id_souchaine*
Disallow /*?

ahrefsbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

Comments

  • https://megaindex.com/crawler