edithbeauty.com
robots.txt

Robots Exclusion Standard data for edithbeauty.com

Resource Scan

Scan Details

Site Domain edithbeauty.com
Base Domain edithbeauty.com
Scan Status Ok
Last Scan2026-02-07T00:25:14+00:00
Next Scan 2026-03-09T00:25:14+00:00

Last Scan

Scanned2026-02-07T00:25:14+00:00
URL https://edithbeauty.com/robots.txt
Domain IPs 179.61.189.25, 2a02:4780:15:7ed7:36af:1c:134b:8428, 2a02:4780:16:2a01:ba61:897f:7d4c:5542, 91.108.100.172
Response IP 93.127.187.90
Found Yes
Hash 270a625821c86117a5e53485ff9c9193cdf6207336fe7c0f423e0d49ed027432
SimHash 622470e222a1

Groups

*

Rule Path Comment
Disallow /wp-admin/ -
Disallow /wp-login.php -
Disallow /?host=www.www -
Allow /wp-admin/admin-ajax.php -
Disallow /*?* -
Disallow /*%* Encoded characters like %2F, %3D, etc.
Disallow /*?a2f6product* -
Disallow /*?ajax-request* -
Disallow /*?brand* -
Disallow /*?avxyl* -
Disallow /*?bsydm* -
Disallow /*?cvaqp* -
Disallow /*?nwpgn* -
Disallow /*?rphzc* -
Disallow /*?oeyox* -
Disallow /*.phtml$ -
Disallow /*.shtml$ -
Disallow /*.htm$ -
Disallow /*.html$ -
Disallow /*/*/*.html$ -
Disallow /*/*/*/*.html$ -
Disallow /wp-content/plugins/ -
Disallow /wp-content/cache/ -
Disallow /wp-content/themes/ -
Disallow /wp-includes/ -
Disallow /a2f6product/ -
Disallow /config/entry/review/add/ -
Disallow /product/*?id= -
Disallow /bnket/ -
Disallow /cxtmc/ -
Disallow /dxexv/ -
Disallow /ebpto/ -
Disallow /jojas/ -

*

Rule Path
Disallow /?s=
Disallow /search/
Disallow */feed/
Disallow /?feed=
Disallow /page/
Disallow /*.php$
Disallow /*.php?*
Disallow /lowpr.php*

Other Records

Field Value
sitemap https://edithbeauty.com/sitemap_index.xml

Comments

  • --- Prevent crawling of admin and login pages ---
  • --- Allow AJAX functions to run ---
  • --- Block junk and spammy parameter-based URLs ---
  • --- Block specific spammy parameters ---
  • --- Block spammy extensions ---
  • --- Block .html spam including nested folders ---
  • --- Block unnecessary WordPress directories ---
  • --- Block spammy URL structures ---
  • --- Block search and feeds ---
  • --- Block PHP spam patterns ---
  • --- Sitemap reference ---