revista-programar.info
robots.txt

Robots Exclusion Standard data for revista-programar.info

Resource Scan

Scan Details

Site Domain revista-programar.info
Base Domain revista-programar.info
Scan Status Ok
Last Scan2025-09-10T01:55:53+00:00
Next Scan 2025-09-24T01:55:53+00:00

Last Scan

Scanned2025-09-10T01:55:53+00:00
URL https://revista-programar.info/robots.txt
Redirect https://www.revista-programar.info/robots.txt
Redirect Domain www.revista-programar.info
Redirect Base revista-programar.info
Domain IPs 104.21.30.233, 172.67.173.249, 2606:4700:3032::6815:1ee9, 2606:4700:3036::ac43:adf9
Redirect IPs 104.21.30.233, 172.67.173.249, 2606:4700:3032::6815:1ee9, 2606:4700:3036::ac43:adf9
Response IP 104.21.30.233
Found Yes
Hash 171d8b108c7d59fb3f0a3cd89281807e5581aa8a22f7ccf7784a67523af93821
SimHash 5404db70ea83

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-login.php
Disallow /participar/guias-internos/
Disallow /privacy/
Disallow /artigos/*/feed/

adsbot-google
amazonbot
anthropic-ai
applebot
awariorssbot
awariosmartbot
bytespider
chatgpt-user
claudebot
claude-web
cohere-ai
dataforseobot
facebookbot
friendlycrawler
google-extended
googleother
gptbot
img2dataset
imagesiftbot
magpie-crawler
meltwater
omgili
omgilibot
peer39_crawler
peer39_crawler/1.0
perplexitybot
piplbot
seekr
timpibot
youbot

Rule Path
Disallow /

ahrefsbot
dotbot
mj12bot
semrushbot

Rule Path
Disallow /

baiduspider
yisouspider
petalbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

sogou inst spider

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.revista-programar.info/sitemap_index.xml

Warnings

  • 1 invalid line.