us.kompass.com
robots.txt

Robots Exclusion Standard data for us.kompass.com

Resource Scan

Scan Details

Site Domain us.kompass.com
Base Domain kompass.com
Scan Status Ok
Last Scan2024-09-01T19:40:15+00:00
Next Scan 2024-10-01T19:40:15+00:00

Last Scan

Scanned2024-09-01T19:40:15+00:00
URL https://us.kompass.com/robots.txt
Domain IPs 98.64.137.26
Response IP 98.64.137.26
Found Yes
Hash e2c6b8818cd6cefecf9a00f853267e862e11a98f62d71de98aa1393d04524055
SimHash 0a7ccc22ae73

Groups

*

Rule Path
Disallow /searchCompanies
Disallow /logCompanyView
Disallow /logAdvertisements
Disallow /getAdvertisements
Disallow /getTop3CompanyDataList
Disallow /getTop3CompanyData
Disallow /buy-company-list/activityCode/*
Disallow /buy-company-list/localizationCode/*
Disallow /login
Disallow /cart
Disallow /checkout
Disallow /selectcountry
Disallow /sendReferrer
Disallow /ebol*
Disallow /ip
Disallow /referrer
Disallow /transfer*
Disallow /search*
Disallow /getRegions*
Disallow /*?_nfbsp*
Disallow /*?_redirectState*
Disallow /*?_id_souchaine*
Disallow /ar/
Disallow /cs/
Disallow /da/
Disallow /de/
Disallow /es/
Disallow /fi/
Disallow /fr/
Disallow /hr/
Disallow /hu/
Disallow /it/
Disallow /ja/
Disallow /lv/
Disallow /nl/
Disallow /no/
Disallow /pl/
Disallow /pt/
Disallow /ro/
Disallow /ru/
Disallow /sk/
Disallow /sl/
Disallow /sr/
Disallow /sv/
Disallow /tr/
Disallow /zh/
Disallow /v/
Disallow */v/
Disallow /*?

ahrefsbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

Comments

  • https://megaindex.com/crawler