Log In Sign Up

nindigible.com
robots.txt

Robots Exclusion Standard data for nindigible.com

Resource Scan

Scan Details

Site Domain nindigible.com
Base Domain nindigible.com
Scan Status Ok
Last Scan2025-09-19T03:33:12+00:00
Next Scan 2025-10-19T03:33:12+00:00

Last Scan

Scanned2025-09-19T03:33:12+00:00
URL https://nindigible.com/robots.txt
Domain IPs 104.21.29.36, 172.67.171.76, 2606:4700:3034::6815:1d24, 2606:4700:3036::ac43:ab4c
Response IP 104.21.29.36
Found Yes
Hash e569e44594c50a4139c9fb4893a46023cb4d4b99f90b071c90cd88753cda4352
SimHash 68d74180c4f5

Groups

*

Rule Path
Disallow /wp-content/plugins/
Disallow /wp-content/themes/
Disallow /wp-includes/
Disallow /wp-admin/
Allow /favicon.png
Allow /ads.txt
Allow /wp-content/uploads/
Allow /wp-admin/admin-ajax.php
Allow /wp-content/*.css
Allow /wp-includes/*.css
Allow /wp-content/themes/*.css
Allow /wp-content/plugins/*.css*
Allow /wp-content/themes/*.css*
Disallow */feed/
Disallow *?feed*
Disallow /feed/$
Disallow /search/*
Disallow /usuarios/*
Disallow /*/embed/
Disallow /*?s=%2F
Disallow /wp-json/*
Disallow /actividad/*
Allow /*.js$
Allow /*.css$

googlebot

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-video

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

adsbot-google-mobile

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

feedfetcher-google

Rule Path
Allow /

googleproducer

Rule Path
Allow /

storebot-google

Rule Path
Allow /

google-inspectiontool

Rule Path
Allow /

googleother

Rule Path
Allow /

googleother-image

Rule Path
Allow /

googleother-video

Rule Path
Allow /

google-safety

Rule Path
Allow /

google-read-aloud

Rule Path
Allow /

google-site-verification

Rule Path
Allow /

twitterbot

Rule Path
Allow /

facebookexternalhit

Rule Path
Allow /

facebookcatalog

Rule Path
Allow /

meta-externalagent

Rule Path
Allow /

meta-externalfetcher

Rule Path
Allow /

bingbot

Rule Path
Allow /

msnbot

Rule Path
Allow /

msnbot-media

Rule Path
Allow /

ai2bot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

amazon-kendra

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

applebot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

awariorssbot

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

brightbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

duckassistbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

friendlycrawler

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

iaskspider/2.0

Rule Path
Disallow /

icc-crawler

Rule Path
Disallow /

img2dataset

Rule Path
Disallow /

kangaroo bot

Rule Path
Disallow /

linerbot

Rule Path
Disallow /

machinelearningforpeacebot

Rule Path
Disallow /

meltwater

Rule Path
Disallow /

nicecrawler

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

pangubot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

perplexity-user

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

piplbot

Rule Path
Disallow /

qualifiedbot

Rule Path
Disallow /

scoop.it

Rule Path
Disallow /

seekr

Rule Path
Disallow /

semrushbot-ocob

Rule Path
Disallow /

sidetrade indexer bot

Rule Path
Disallow /

timpibot

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

webzio-extended

Rule Path
Disallow /

youbot

Rule Path
Disallow /

dalvik

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://nindigible.com/sitemap_index.xml
Back to top

Comments

  • Impedir el acceso a los diversos feed.
  • Evita bloqueos de CSS y JS.
  • Lista de bots de Google.
  • Bots de Redes Sociales.
  • Bots de Microsoft
  • Bloqueo de Bots IA
  • Localizacion del sitemap
Back to top