cnds.info
robots.txt

Robots Exclusion Standard data for cnds.info

Resource Scan

Scan Details

Site Domain cnds.info
Base Domain cnds.info
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-12-03T05:12:51+00:00
Next Scan 2026-03-03T05:12:51+00:00

Last Successful Scan

Scanned2024-10-17T04:42:32+00:00
URL https://cnds.info/robots.txt
Redirect https://www.cnds.info/robots.txt
Redirect Domain www.cnds.info
Redirect Base cnds.info
Domain IPs 104.21.26.236, 172.67.168.152, 2606:4700:3031::ac43:a898, 2606:4700:3034::6815:1aec
Redirect IPs 104.21.26.236, 172.67.168.152, 2606:4700:3031::ac43:a898, 2606:4700:3034::6815:1aec
Response IP 104.21.26.236
Found Yes
Hash 46272357331b1d9067f1aafcac66a83f2e7097154d68cf2e3cf4422d30294ae2
SimHash 587142d0eab3

Groups

ia_archiver

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

majestic-12

Rule Path
Disallow /

scoutjet

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

*

Rule Path
Disallow /cgi-bin/
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-content/plugins/
Disallow /wp-content/cache/
Disallow /wp-content/themes/
Disallow /trackback/
Disallow */category/
Disallow /feed/
Disallow /comments/
Disallow */trackback/
Disallow /trackback*/
Disallow */feed/
Disallow /feed*/
Disallow */comments/
Disallow /comments*/
Disallow /*?*
Disallow /*?
Disallow /wp-login.php
Disallow /go/
Allow /wp-content/uploads/