Log In Sign Up

sire-search.com
robots.txt

Robots Exclusion Standard data for sire-search.com

Resource Scan

Scan Details

Site Domain sire-search.com
Base Domain sire-search.com
Scan Status Ok
Last Scan2025-09-21T13:52:08+00:00
Next Scan 2025-10-21T13:52:08+00:00

Last Scan

Scanned2025-09-21T13:52:08+00:00
URL https://sire-search.com/robots.txt
Domain IPs 162.159.134.42, 2a01:7c8:e100:1::50a0
Response IP 162.159.134.42
Found Yes
Hash 3954ec527796917b00d069d555e77aa621076214284f06d42de0d98b48a1c219
SimHash 4bee48caa4b3

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-content/plugins/
Disallow /wp-content/cache/
Disallow /wp-content/uploads/
Disallow /cgi-bin/
Disallow /xmlrpc.php
Disallow /wp-login.php
Disallow /wp-signup.php
Disallow /readme.html
Disallow /license.txt
Disallow /?s=
Disallow /*?ver=

googlebot

Rule Path
Allow /*.js
Allow /*.css

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.sire-search.com/sitemap_index.xml
Back to top

Comments

  • START YOAST BLOCK
  • ---------------------------
  • Allow Googlebot to crawl CSS and JS files
  • Block specific bots to save crawl budget
  • ---------------------------
  • END YOAST BLOCK
Back to top