segundoenfoque.com
robots.txt

Robots Exclusion Standard data for segundoenfoque.com

Resource Scan

Scan Details

Site Domain segundoenfoque.com
Base Domain segundoenfoque.com
Scan Status Ok
Last Scan2025-12-23T08:10:21+00:00
Next Scan 2025-12-30T08:10:21+00:00

Last Scan

Scanned2025-12-23T08:10:21+00:00
URL https://segundoenfoque.com/robots.txt
Domain IPs 34.174.78.206
Response IP 34.174.78.206
Found Yes
Hash 44baeaff03cf223b09f63ea2ccd98f08ec0f0799ac8682d76288d35c2230e541
SimHash 6a201f82fdf0

Groups

*

Rule Path Comment
Disallow / -
Disallow /admin -
Disallow /cgi-bin/ -
Disallow /newfanshot -
Disallow /users/*/replies -
Disallow /users/*/comments -
Disallow /search -
Disallow /account -
Disallow /login -
Disallow /chorus_auth -
Disallow /sso -
Disallow /ad -
Disallow /sponsored -
Disallow /wp-admin/ block access to admin section
Disallow /wp-login.php block access to admin section
Disallow /search/ block access to internal search result pages
Disallow *?s=* block access to internal search result pages
Disallow *?p=* block access to pages for which permalinks fails
Disallow *%26p%3D* block access to pages for which permalinks fails
Disallow *%26preview%3D* block access to preview pages
Disallow /tag/ block access to tag pages
Disallow /author/ block access to author pages
Disallow /404-error/ block access to 404 page

googlebot

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

slurp

Rule Path
Allow /

msnbot

Rule Path
Allow /

msnbot-media

Rule Path
Allow /

teoma

Rule Path
Allow /

barkrowler

Rule Path
Disallow /

pinterestbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://segundoenfoque.com/sitemap_index.xml
sitemap https://segundoenfoque.com/post-sitemap.xml
sitemap https://segundoenfoque.com/news-sitemap.xml

Comments

  • Lo hice yo porque el otro día me tiro error que desapareció
  • https://babbar.tech/crawler