Log In Sign Up

ejobsitesoftware.com
robots.txt

Robots Exclusion Standard data for ejobsitesoftware.com

Resource Scan

Scan Details

Site Domain ejobsitesoftware.com
Base Domain ejobsitesoftware.com
Scan Status Ok
Last Scan2026-02-22T22:01:47+00:00
Next Scan 2026-03-24T22:01:47+00:00

Last Scan

Scanned2026-02-22T22:01:47+00:00
URL https://ejobsitesoftware.com/robots.txt
Domain IPs 66.42.92.65
Response IP 66.42.92.65
Found Yes
Hash 73f9a29f5b1bbedf48d5c0c48fbc572ec4e7427b3060cdcdc4c96e9ac11023c1
SimHash 7e655c568534

Groups

*

Rule Path
Allow /
Disallow /img/jobsite-templates/
Disallow /demo/
Disallow /wp-content/themes/theme*/
Disallow /wp-content/themes/jobboard/
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-content/plugins/
Disallow /xmlrpc.php
Disallow /wp-json/
Disallow /?s=
Disallow /search/
Disallow /author/
Disallow /users/
Disallow /tag/
Disallow /admin/
Disallow /dashboard/
Back to top

Other Records

Field Value
sitemap https://ejobsitesoftware.com/sitemap.xml
Back to top

Comments

  • Allow crawling of all pages by default
  • ----------------------------------------------------------------------
  • CRITICAL DISALLOWS (To block indexed junk/demo content)
  • ----------------------------------------------------------------------
  • 1. Blocks the entire demo template directory (Crucial for blocking indexed themes)
  • 2. Blocks the general demo area where test applications may live
  • ----------------------------------------------------------------------
  • STANDARD WORDPRESS DISALLOWS
  • ----------------------------------------------------------------------
  • Blocks standard WP admin/management paths
  • Blocks JSON API/REST routes which can cause index bloat
  • Blocks common internal search and user-related pages
  • ----------------------------------------------------------------------
  • SPECIFIC CONTENT DISALLOWS (Block potentially thin content)
  • ----------------------------------------------------------------------
  • Blocks the admin area of the software itself if it's under an easy path
  • ----------------------------------------------------------------------
  • SITEMAP DECLARATION
  • ----------------------------------------------------------------------
Back to top