ng.clicbye.com
robots.txt

Robots Exclusion Standard data for ng.clicbye.com

Resource Scan

Scan Details

Site Domain ng.clicbye.com
Base Domain clicbye.com
Scan Status Ok
Last Scan2025-12-15T09:50:38+00:00
Next Scan 2026-01-14T09:50:38+00:00

Last Scan

Scanned2025-12-15T09:50:38+00:00
URL https://ng.clicbye.com/robots.txt
Domain IPs 104.21.19.75, 172.67.185.160, 2606:4700:3031::ac43:b9a0, 2606:4700:3034::6815:134b
Response IP 172.67.185.160
Found Yes
Hash 0626d6a0fadaf11db46e63eddc7fb306cfb383a056c245ddb71763b89e97283e
SimHash 23181b2174d1

Groups

*

Rule Path
Disallow /system/
Disallow /uploads/
Disallow /assets/
Disallow /database/
Disallow /logsandredirect/

Other Records

Field Value
sitemap https://ng.clicbye.com/nigeria_sitemap.xml

Comments

  • Clicbye robots.txt file
  • list of directories robots are not allowed to index
  • disable search engin filters
  • Disallow: /*?location=
  • Disallow: /*?category=
  • sitemap index
  • End of robots.txt file