yvsite.com
robots.txt

Robots Exclusion Standard data for yvsite.com

Resource Scan

Scan Details

Site Domain yvsite.com
Base Domain yvsite.com
Scan Status Ok
Last Scan2025-09-04T16:20:47+00:00
Next Scan 2025-10-04T16:20:47+00:00

Last Scan

Scanned2025-09-04T16:20:47+00:00
URL https://yvsite.com/robots.txt
Domain IPs 104.21.34.104, 172.67.159.25, 2606:4700:3034::6815:2268, 2606:4700:3034::ac43:9f19
Response IP 104.21.34.104
Found Yes
Hash 9569bbb3d8832c705e085b65013f5a401ebeb489f1c956e238df540b214899b5
SimHash 02605fe2a353

Groups

*

Rule Path
Allow /
Disallow /wp-admin
Disallow /wp-login.php
Allow /wp-admin/admin-ajax.php

semrush-bot

Rule Path
Disallow

semrushbot-ct/0.97

Rule Path
Disallow

semrushbot-ct

Rule Path
Disallow

semrushbot-si

Rule Path
Disallow

bingpreview/1.0b

Rule Path
Disallow /

bingbot/2.0

Rule Path
Disallow /

Comments

  • .__________________________.
  • | .___________________. |==|
  • | | ................. | | |
  • | | ::[ Dear robot ]: | | |
  • | | ::::[ be nice ]:: | | |
  • | | ::::::::::::::::: | | |
  • | | ::::::::::::::::: | | |
  • | | ::::::::::::::::: | | |
  • | | ::::::::::::::::: | | ,|
  • | !___________________! |(c|
  • !_______________________!__!
  • / \
  • / [][][][][][][][][][][][][] \
  • / [][][][][][][][][][][][][][] \
  • ( [][][][][____________][][][][] )
  • \ ------------------------------ /
  • \______________________________/
  • Wordpress Group
  • SEMRush Bot Allowed Group
  • ________
  • __,_, | |
  • [_|_/ | OK |
  • // |________|
  • _// __ /
  • (_|) |@@|
  • \ \__ \--/ __
  • \o__|----| | __
  • \ }{ /\ )_ / _\
  • /\__/\ \__O (__
  • (--/\--) \__/
  • _)( )(_
  • `---''---`