Log In Sign Up

smikar.com
robots.txt

Robots Exclusion Standard data for smikar.com

Resource Scan

Scan Details

Site Domain smikar.com
Base Domain smikar.com
Scan Status Ok
Last Scan2025-10-31T06:58:55+00:00
Next Scan 2025-11-30T06:58:55+00:00

Last Scan

Scanned2025-10-31T06:58:55+00:00
URL https://smikar.com/robots.txt
Domain IPs 104.21.54.90, 172.67.137.81, 2606:4700:3031::ac43:8951, 2606:4700:3036::6815:365a
Response IP 172.67.137.81
Found Yes
Hash 7b42da6e3bc1416e4c5e388b1baeb1cb8acf07d4cb8db117dbe1e67cc4244a21
SimHash 766c587aadb9

Groups

*

Rule Path
Allow /
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /wp-includes/
Allow /wp-includes/js/
Allow /wp-includes/images/
Disallow /trackback/
Disallow /wp-login.php
Disallow /*/wp-login.php/
Disallow /wp-register.php
Disallow /feed/
Disallow /?swcfpc=1
Disallow /*?et_blog
Disallow /*?swcfpc
Disallow /*?ref=PitchWall
Disallow /*?__im
Disallow /wp-json/
Disallow /wp-content/plugins/
Disallow /1000
Back to top

Other Records

Field Value
sitemap https://www.smikar.com/sitemap.xml
Back to top

Comments

  • Sitemap (Ensure it's HTTPS, not HTTP)
  • Disallow unnecessary WordPress paths
  • Block unnecessary tracking and login pages
  • Block URL parameters that cause duplicate indexing issues
  • Block WordPress API and plugin files
  • Exclude specific unnecessary pages (if applicable)
Back to top