mastertutoriales.com
robots.txt

Robots Exclusion Standard data for mastertutoriales.com

Resource Scan

Scan Details

Site Domain mastertutoriales.com
Base Domain mastertutoriales.com
Scan Status Ok
Last Scan2024-11-10T19:09:16+00:00
Next Scan 2024-11-17T19:09:16+00:00

Last Scan

Scanned2024-11-10T19:09:16+00:00
URL https://mastertutoriales.com/robots.txt
Domain IPs 104.21.12.94, 172.67.131.248, 2606:4700:3032::6815:c5e, 2606:4700:3035::ac43:83f8
Response IP 104.21.12.94
Found Yes
Hash ca51592c6fdc4494e7dfc82f3766b9c5bd62b6e242722b80e105dfbbdc48a61f
SimHash 62201c508b13

Groups

*

Rule Path
Allow /ads.txt
Allow /humans.txt
Allow /.well-known/security.txt
Allow /.well-known/trust.txt
Allow /.well-known/gpc.json
Disallow /cdn-cgi/
Disallow /wp-admin/
Allow /*.js$
Allow /*.css$
Disallow /*.php$
Disallow /*readme.html$
Disallow /*readme.txt$
Disallow /*license.html$
Disallow /*license.txt$

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://mastertutoriales.com/sitemap_index.xml

Comments

  • Cloudflare reference
  • .__________________________.
  • | .___________________. |==|
  • | | ................. | | |
  • | | ::[ Dear robot ]: | | |
  • | | ::::[ be nice ]:: | | |
  • | | ::::::::::::::::: | | |
  • | | ::::::::::::::::: | | |
  • | | ::::::::::::::::: | | |
  • | | ::::::::::::::::: | | ,|
  • | !___________________! |(c|
  • !_______________________!__!
  • / \
  • / [][][][][][][][][][][][][] \
  • / [][][][][][][][][][][][][][] \
  • ( [][][][][____________][][][][] )
  • \ ------------------------------ /
  • \______________________________/
  • _-_
  • /~~ ~~\
  • /~~ ~~\
  • { }
  • \ _- -_ /
  • ~ \\ // ~
  • _- - | | _- _
  • _ - | | -_
  • // \\
  • OUR TREE IS A REDWOOD
  • ________
  • __,_, | |
  • [_|_/ | OK |
  • // |________|
  • _// __ /
  • (_|) |@@|
  • \ \__ \--/ __
  • \o__|----| | __
  • \ }{ /\ )_ / _\
  • /\__/\ \__O (__
  • (--/\--) \__/
  • _)( )(_
  • `---''---`