carousell.com.my
robots.txt

Robots Exclusion Standard data for carousell.com.my

Resource Scan

Scan Details

Site Domain carousell.com.my
Base Domain carousell.com.my
Scan Status Ok
Last Scan2024-11-14T07:59:30+00:00
Next Scan 2024-11-21T07:59:30+00:00

Last Scan

Scanned2024-11-14T07:59:30+00:00
URL https://carousell.com.my/robots.txt
Redirect https://www.carousell.com.my/robots.txt
Redirect Domain www.carousell.com.my
Redirect Base carousell.com.my
Domain IPs 104.18.33.104, 172.64.154.152, 2606:4700:4400::6812:2168, 2606:4700:4400::ac40:9a98
Redirect IPs 104.18.33.104, 172.64.154.152, 2606:4700:4400::6812:2168, 2606:4700:4400::ac40:9a98
Response IP 172.64.154.152
Found Yes
Hash c35f776248411652721c42cbf60aab9a23440390dc6d2cc3621e4d5d3c8c3803
SimHash e0118ae24e21

Groups

*

Rule Path
Disallow /activity/
Disallow /archive/
Disallow /inbox/
Disallow /join/
Disallow /myprofile/
Disallow /search/*?
Disallow /*?
Disallow /*/review/
Allow /*hl%3Den$
Allow /api-service/*?

grapeshot

Rule Path
Disallow /activity/
Disallow /archive/
Disallow /inbox/
Disallow /likes/
Disallow /sell/
Disallow /followers/
Disallow /following/

petalbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.carousell.com.my/sitemap.xml