Log In Sign Up

clearskin.in
robots.txt

Robots Exclusion Standard data for clearskin.in

Resource Scan

Scan Details

Site Domain clearskin.in
Base Domain clearskin.in
Scan Status Ok
Last Scan2025-12-02T19:12:57+00:00
Next Scan 2026-01-01T19:12:57+00:00

Last Scan

Scanned2025-12-02T19:12:57+00:00
URL https://clearskin.in/robots.txt
Domain IPs 104.21.2.149, 172.67.129.83, 2606:4700:3031::6815:295, 2606:4700:3035::ac43:8153
Response IP 104.21.2.149
Found Yes
Hash 1fbcbee357371ed2e8112c0933ba300871d72f67b0be7e9d16c0ae774f948291
SimHash 6860c942e52b

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-login.php
Disallow /wp-includes/
Disallow /cgi-bin/
Disallow /xmlrpc.php
Disallow /wp-content/plugins/
Disallow /wp-content/themes/
Disallow /wp-content/uploads/*.php
Allow /wp-content/uploads/
Disallow /?*
Disallow /*?
Disallow /*%26*
Disallow /*?s=
Disallow /*?et_blog=
Disallow /feed/
Disallow /trackback/
Disallow /comments/
Disallow /?author=
Disallow /search/
Disallow /tag/
Disallow /category/
Disallow /author/
Allow /wp-admin/admin-ajax.php

gptbot

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

claudebot

Rule Path
Allow /

google-extended

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://www.clearskin.in/sitemap_index.xml
Back to top

Comments

  • START YOAST BLOCK
  • ---------------------------
  • Disallow sensitive WordPress admin and login pages
  • Disallow WordPress system directories
  • Disallow plugin and theme directories
  • Prevent direct access to PHP files inside uploads, but allow image indexing
  • Allow access to the uploads folder for media files
  • Block query parameters and unnecessary duplicate content
  • Block indexing of feeds, trackbacks, and comments
  • Disallow indexing of author, category, tag, and search pages
  • Prevent indexing of WebP images (optional)
  • Disallow: *.webp
  • AJAX functionality in WordPress
  • Sitemap for search engines
  • ---------------------------
  • END YOAST BLOCK
Back to top