colorlib.com
robots.txt

Robots Exclusion Standard data for colorlib.com

Resource Scan

Scan Details

Site Domain colorlib.com
Base Domain colorlib.com
Scan Status Ok
Last Scan2024-11-06T18:15:30+00:00
Next Scan 2024-11-13T18:15:30+00:00

Last Scan

Scanned2024-11-06T18:15:30+00:00
URL https://colorlib.com/robots.txt
Domain IPs 104.22.20.226, 104.22.21.226, 172.67.26.100, 2606:4700:10::6816:14e2, 2606:4700:10::6816:15e2, 2606:4700:10::ac43:1a64
Response IP 104.22.21.226
Found Yes
Hash 6b8c18088d759dfc121fd4a84fdd9152c481866c04a5f2e8d2d5cbdcbe023c6d
SimHash c0791494eff0

Groups

*

Rule Path
Disallow */feed/
Disallow /wp-admin/
Disallow /wp/wp-admin/
Disallow /wp-login.php
Disallow /wp/wp-login.php
Disallow */wp/?s=*
Disallow */wp/search/*
Disallow /*?s=
Disallow */search/*

Comments

  • feed urls
  • login urls
  • block access to internal search result pages