code-learner.com
robots.txt

Robots Exclusion Standard data for code-learner.com

Resource Scan

Scan Details

Site Domain code-learner.com
Base Domain code-learner.com
Scan Status Ok
Last Scan2025-07-11T03:56:40+00:00
Next Scan 2025-07-18T03:56:40+00:00

Last Scan

Scanned2025-07-11T03:56:40+00:00
URL https://code-learner.com/robots.txt
Domain IPs 104.21.22.127, 172.67.205.9, 2606:4700:3030::6815:167f, 2606:4700:3031::ac43:cd09
Response IP 104.21.22.127
Found Yes
Hash b9e7f047e7eb92187227a78321b3ca5e81b2144e2f8eec1fdedce5e4d193d604
SimHash 482d5e60a093

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-content/plugins/
Disallow /*?p=
Disallow /*?s=
Disallow /*?author=
Disallow /search/

baiduspider

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.code-learner.com/sitemap_index.xml