Log In Sign Up

cosmeticsnow.ca
robots.txt

Robots Exclusion Standard data for cosmeticsnow.ca

Resource Scan

Scan Details

Site Domain cosmeticsnow.ca
Base Domain cosmeticsnow.ca
Scan Status Ok
Last Scan6/5/2025, 10:03:51 AM
Next Scan 6/12/2025, 10:03:51 AM

Last Scan

Scanned6/5/2025, 10:03:51 AM
URL https://cosmeticsnow.ca/robots.txt
Domain IPs 104.21.31.86, 172.67.175.129, 2606:4700:3031::6815:1f56, 2606:4700:3035::ac43:af81
Response IP 104.21.31.86
Found Yes
Hash e338964cd3aeeb99308219f8c1c04da3d177a91dd715c4131f7fd2ef7b47593e
SimHash e03ed462ebb9

Groups

blexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

*

Rule Path
Disallow /track/

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

applebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5
Back to top