cosmeticsnow.ph
robots.txt

Robots Exclusion Standard data for cosmeticsnow.ph

Resource Scan

Scan Details

Site Domain cosmeticsnow.ph
Base Domain cosmeticsnow.ph
Scan Status Ok
Last Scan2025-10-14T17:17:15+00:00
Next Scan 2025-11-13T17:17:15+00:00

Last Scan

Scanned2025-10-14T17:17:15+00:00
URL https://cosmeticsnow.ph/robots.txt
Domain IPs 104.21.82.221, 172.67.164.71, 2606:4700:3030::ac43:a447, 2606:4700:3036::6815:52dd
Response IP 172.67.164.71
Found Yes
Hash e338964cd3aeeb99308219f8c1c04da3d177a91dd715c4131f7fd2ef7b47593e
SimHash e03ed462ebb9

Groups

blexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

*

Rule Path
Disallow /track/

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

applebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5