Log In Sign Up

itools.pe
robots.txt

Robots Exclusion Standard data for itools.pe

Resource Scan

Scan Details

Site Domain itools.pe
Base Domain itools.pe
Scan Status Ok
Last Scan2025-11-29T14:18:48+00:00
Next Scan 2025-12-29T14:18:48+00:00

Last Scan

Scanned2025-11-29T14:18:48+00:00
URL https://itools.pe/robots.txt
Redirect https://www.itools.pe/robots.txt
Redirect Domain www.itools.pe
Redirect Base itools.pe
Domain IPs 3.217.181.114, 44.220.101.65
Redirect IPs 3.217.181.114, 44.220.101.65
Response IP 3.217.181.114
Found Yes
Hash b1db207edf49a311cb8d06b805b7dfd9572db52ed86ee765bd607c5ee12ee1b1
SimHash 41be5840c7f0

Groups

googlebot

Rule Path
Allow /$
Allow /product/*
Allow /collection/*
Allow /brand/*
Allow /sheet/*
Allow /article/*
Allow /blog
Allow /policies/*
Allow /robots.txt
Allow /sitemap.xml
Disallow /

googlebot-image

Rule Path
Allow /$
Allow /product/*
Allow /collection/*
Allow /brand/*
Allow /sheet/*
Allow /article/*
Allow /blog
Allow /policies/*
Allow /robots.txt
Allow /sitemap.xml
Disallow /

googlebot-video

Rule Path
Allow /$
Allow /product/*
Allow /collection/*
Allow /brand/*
Allow /sheet/*
Allow /article/*
Allow /blog
Allow /policies/*
Allow /robots.txt
Allow /sitemap.xml
Disallow /

googlenot-news

Rule Path
Allow /$
Allow /product/*
Allow /collection/*
Allow /brand/*
Allow /sheet/*
Allow /article/*
Allow /blog
Allow /policies/*
Allow /robots.txt
Allow /sitemap.xml
Disallow /

mediapartners-google

Rule Path
Allow /$
Allow /product/*
Allow /collection/*
Allow /brand/*
Allow /sheet/*
Allow /article/*
Allow /blog
Allow /policies/*
Allow /robots.txt
Allow /sitemap.xml
Disallow /

adsbot-google

Rule Path
Allow /$
Allow /product/*
Allow /collection/*
Allow /brand/*
Allow /sheet/*
Allow /article/*
Allow /blog
Allow /policies/*
Allow /robots.txt
Allow /sitemap.xml
Disallow /

adsbot-google-mobile

Rule Path
Allow /$
Allow /product/*
Allow /collection/*
Allow /brand/*
Allow /sheet/*
Allow /article/*
Allow /blog
Allow /policies/*
Allow /robots.txt
Allow /sitemap.xml
Disallow /

adsbot-google-mobile-apps

Rule Path
Allow /$
Allow /product/*
Allow /collection/*
Allow /brand/*
Allow /sheet/*
Allow /article/*
Allow /blog
Allow /policies/*
Allow /robots.txt
Allow /sitemap.xml
Disallow /

storebot-google

Rule Path
Allow /$
Allow /product/*
Allow /collection/*
Allow /brand/*
Allow /sheet/*
Allow /article/*
Allow /blog
Allow /policies/*
Allow /robots.txt
Allow /sitemap.xml
Disallow /

bingbot

Rule Path
Allow /$
Allow /product/*
Allow /collection/*
Allow /brand/*
Allow /sheet/*
Allow /article/*
Allow /blog
Allow /policies/*
Allow /robots.txt
Allow /sitemap.xml
Disallow /

applebot

Rule Path
Allow /$
Allow /product/*
Allow /collection/*
Allow /brand/*
Allow /sheet/*
Allow /article/*
Allow /blog
Allow /policies/*
Allow /robots.txt
Allow /sitemap.xml
Disallow /

facebookexternalhit

Rule Path
Allow /$
Allow /product/*
Allow /collection/*
Allow /brand/*
Allow /sheet/*
Allow /article/*
Allow /blog
Allow /policies/*
Allow /robots.txt
Allow /sitemap.xml
Disallow /

twitterbot

Rule Path
Allow /$
Allow /product/*
Allow /collection/*
Allow /brand/*
Allow /sheet/*
Allow /article/*
Allow /blog
Allow /policies/*
Allow /robots.txt
Allow /sitemap.xml
Disallow /

linkedinbot

Rule Path
Allow /$
Allow /product/*
Allow /collection/*
Allow /brand/*
Allow /sheet/*
Allow /article/*
Allow /blog
Allow /policies/*
Allow /robots.txt
Allow /sitemap.xml
Disallow /

pinterestbot

Rule Path
Allow /$
Allow /product/*
Allow /collection/*
Allow /brand/*
Allow /sheet/*
Allow /article/*
Allow /blog
Allow /policies/*
Allow /robots.txt
Allow /sitemap.xml
Disallow /

ia_archiver

Rule Path
Allow /$
Allow /product/*
Allow /collection/*
Allow /brand/*
Allow /sheet/*
Allow /article/*
Allow /blog
Allow /policies/*
Allow /robots.txt
Allow /sitemap.xml
Disallow /

rogerbot

Rule Path
Allow /$
Allow /product/*
Allow /collection/*
Allow /brand/*
Allow /sheet/*
Allow /article/*
Allow /blog
Allow /policies/*
Allow /robots.txt
Allow /sitemap.xml
Disallow /

dotbot

Rule Path
Allow /$
Allow /product/*
Allow /collection/*
Allow /brand/*
Allow /sheet/*
Allow /article/*
Allow /blog
Allow /policies/*
Allow /robots.txt
Allow /sitemap.xml
Disallow /

gptbot

Rule Path
Allow /$
Allow /product/*
Allow /collection/*
Allow /brand/*
Allow /sheet/*
Allow /article/*
Allow /blog
Allow /policies/*
Allow /robots.txt
Allow /sitemap.xml
Disallow /

chatgpt-user

Rule Path
Allow /$
Allow /product/*
Allow /collection/*
Allow /brand/*
Allow /sheet/*
Allow /article/*
Allow /blog
Allow /policies/*
Allow /robots.txt
Allow /sitemap.xml
Disallow /

ccbot

Rule Path
Allow /$
Allow /product/*
Allow /collection/*
Allow /brand/*
Allow /sheet/*
Allow /article/*
Allow /blog
Allow /policies/*
Allow /robots.txt
Allow /sitemap.xml
Disallow /

claudebot

Rule Path
Allow /$
Allow /product/*
Allow /collection/*
Allow /brand/*
Allow /sheet/*
Allow /article/*
Allow /blog
Allow /policies/*
Allow /robots.txt
Allow /sitemap.xml
Disallow /

google-extended

Rule Path
Allow /$
Allow /product/*
Allow /collection/*
Allow /brand/*
Allow /sheet/*
Allow /article/*
Allow /blog
Allow /policies/*
Allow /robots.txt
Allow /sitemap.xml
Disallow /

perplexitybot

Rule Path
Allow /$
Allow /product/*
Allow /collection/*
Allow /brand/*
Allow /sheet/*
Allow /article/*
Allow /blog
Allow /policies/*
Allow /robots.txt
Allow /sitemap.xml
Disallow /

applebot-extended

Rule Path
Allow /$
Allow /product/*
Allow /collection/*
Allow /brand/*
Allow /sheet/*
Allow /article/*
Allow /blog
Allow /policies/*
Allow /robots.txt
Allow /sitemap.xml
Disallow /

*

Rule Path
Allow /$
Disallow /

Other Records

Field Value
crawl-delay 120
Back to top

Other Records

Field Value
sitemap https://www.itools.pe/sitemap.xml
Back to top

Comments

  • @Bsale 2025
  • Buscadores
  • Redes Sociales
  • Marketing Robots
  • Bots de Inteligencia Artificial
  • Resto de agentes sólo el home
  • Sitemap
Back to top