ads.kompass.com
robots.txt

Robots Exclusion Standard data for ads.kompass.com

Resource Scan

Scan Details

Site Domain ads.kompass.com
Base Domain kompass.com
Scan Status Ok
Last Scan2024-09-06T02:21:38+00:00
Next Scan 2024-10-06T02:21:38+00:00

Last Scan

Scanned2024-09-06T02:21:38+00:00
URL https://ads.kompass.com/robots.txt
Domain IPs 98.64.137.26
Response IP 98.64.137.26
Found Yes
Hash 8fc7e88987ad6fd64759fb524e84ec736bde2b6e339ef8aa2cd7f48aa6e26230
SimHash c81c95606fb1

Groups

*

Rule Path
Allow /

ahrefsbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

Comments

  • https://megaindex.com/crawler