Log In Sign Up

pirincat.com
robots.txt

Robots Exclusion Standard data for pirincat.com

Resource Scan

Scan Details

Site Domain pirincat.com
Base Domain pirincat.com
Scan Status Ok
Last Scan5/19/2025, 10:41:26 AM
Next Scan 5/26/2025, 10:41:26 AM

Last Scan

Scanned5/19/2025, 10:41:26 AM
URL https://pirincat.com/robots.txt
Domain IPs 104.21.75.151, 172.67.177.230, 2606:4700:3032::6815:4b97, 2606:4700:3035::ac43:b1e6
Response IP 104.21.75.151
Found Yes
Hash c6111c9629c8418ba36ef2489800c0adc24320cfbcf2bbe039411d38f2219222
SimHash c84858c0498e

Groups

*

Rule Path
Allow /wp-content/*.js
Allow /wp-content/*.css
Allow /wp-content/litespeed/js/
Allow /wp-content/litespeed/avatar/
Disallow /wp-content/themes/
Disallow /wp-admin/
Disallow /wp-login.php
Allow /wp-content/uploads/*
Allow /wp-includes/*.js
Allow /wp-includes/*.css
Disallow /cgi-bin
Disallow /wp-includes/
Disallow /*/attachment/
Disallow /tag/*/page/
Disallow /tag/*/feed/
Disallow /page/
Disallow /comments/
Disallow /xmlrpc.php
Disallow /?attachment_id*
Disallow /tag/
Disallow /*?

*

Rule Path
Disallow /?s=
Disallow /search

*

Rule Path
Disallow /trackback
Disallow /*trackback
Disallow /*trackback*
Disallow /*/trackback

*

Rule Path
Allow /feed/$
Disallow /feed/
Disallow /comments/feed/
Disallow /*/feed/$
Disallow /*/feed/rss/$
Disallow /*/trackback/$
Disallow /*/*/feed/$
Disallow /*/*/feed/rss/$
Disallow /*/*/trackback/$
Disallow /*/*/*/feed/$
Disallow /*/*/*/feed/rss/$
Disallow /*/*/*/trackback/$

noxtrumbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

slurp

Rule Path
Allow /feed/$
Disallow /feed/
Disallow /comments/feed/
Disallow /*/feed/$
Disallow /*/feed/rss/$
Disallow /*/trackback/$
Disallow /*/*/feed/$
Disallow /*/*/feed/rss/$
Disallow /*/*/trackback/$
Disallow /*/*/*/feed/$
Disallow /*/*/*/feed/rss/$
Disallow /*/*/*/trackback/$

Other Records

Field Value
crawl-delay 20
Back to top

Comments

  • START YOAST BLOCK
  • ---------------------------
  • Bloqueo de las URL dinamicas
  • Bloqueo de busquedas
  • Bloqueo de trackbacks
  • Bloqueo de feeds para crawlers
  • Ralentizamos algunos bots que se suelen volver locos
  • FEED Y COMENTARIOS
  • ---------------------------
  • END YOAST BLOCK
Back to top

Warnings

  • 1 invalid line.
  • `https` is not a known field.
Back to top