tematicas.org
robots.txt

Robots Exclusion Standard data for tematicas.org

Resource Scan

Scan Details

Site Domain tematicas.org
Base Domain tematicas.org
Scan Status Ok
Last Scan2026-01-13T22:48:22+00:00
Next Scan 2026-01-20T22:48:22+00:00

Last Scan

Scanned2026-01-13T22:48:22+00:00
URL https://tematicas.org/robots.txt
Domain IPs 51.254.176.235
Response IP 51.254.176.235
Found Yes
Hash 00efd1e5cbbd7baaba9a654f4ba90e2c94a6773a33d8ceb071ea62add110ba6c
SimHash 59150c79aa02

Groups

ahrefsbot
amazonbot
anthropic-ai
baiduspider
barkrowler
blexbot
bytespider
chatgpt-user
claudebot
claude-web
curl
dataforseobot
domaincrawler
domainstatsbot
dotbot
exabot
freshbot
garlikcrawler
gptbot
grouphigh
homeassistant
imagesiftbot
masscan
meta-externalagent
mj12bot
megaindex
openai
oai-searchbot
perplexitybot
petalbot
piplbot
python-requests
qwantify
seekportbot
semrushbot
sentibot
serpstatbot
sitelockspider
spbot
velenpublicwebcrawler
wget
yandexbot
yandeximages
zgrab

Rule Path
Disallow /

*

Rule Path
Disallow /compartir/
Disallow /buscar/
Disallow /comparador-estadisticas/

Other Records

Field Value
sitemap https://tematicas.org/tematicas.xml.gz
sitemap https://tematicas.org/tematicas.bde.xml.gz
sitemap https://tematicas.org/tematicas.ipc.xml.gz