ollipops.com
robots.txt

Robots Exclusion Standard data for ollipops.com

Resource Scan

Scan Details

Site Domain ollipops.com
Base Domain ollipops.com
Scan Status Ok
Last Scan2025-11-26T03:19:04+00:00
Next Scan 2025-12-26T03:19:04+00:00

Last Scan

Scanned2025-11-26T03:19:04+00:00
URL https://ollipops.com/robots.txt
Redirect https://www.ollipops.com/robots.txt
Redirect Domain www.ollipops.com
Redirect Base ollipops.com
Domain IPs 104.21.17.95, 172.67.175.109, 2606:4700:3031::6815:115f, 2606:4700:3031::ac43:af6d
Redirect IPs 104.21.17.95, 172.67.175.109, 2606:4700:3031::6815:115f, 2606:4700:3031::ac43:af6d
Response IP 104.21.17.95
Found Yes
Hash 0231473747d62758c7895adf0ab7c77ba575668a88077995879cdb179fc9b9c8
SimHash 244cd9b0c112

Groups

baiduspider

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-news

Rule Path
Disallow /

baiduspider-favo

Rule Path
Disallow /

baiduspider-cpro

Rule Path
Disallow /

baiduspider-ads

Rule Path
Disallow /

baidu

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

*

Rule Path
Allow /
Disallow /shopcustadminlogin.asp
Disallow /shoptellafriend.asp
Disallow /shopquestion.asp
Disallow /shopcomparisonadd.asp
Disallow /shopcomparison.asp
Disallow /shopcustadmin.asp
Disallow /shopcurrency.asp

Other Records

Field Value
sitemap http://www.ollipops.com/sitemap.xml

Comments

  • Others