Log In Sign Up

destacamos.com
robots.txt

Robots Exclusion Standard data for destacamos.com

Resource Scan

Scan Details

Site Domain destacamos.com
Base Domain destacamos.com
Scan Status Ok
Last Scan2024-05-26T22:59:10+00:00
Next Scan 2024-06-25T22:59:10+00:00

Last Scan

Scanned2024-05-26T22:59:10+00:00
URL https://destacamos.com/robots.txt
Redirect https://www.destacamos.com/robots.txt
Redirect Domain www.destacamos.com
Redirect Base destacamos.com
Domain IPs 104.22.34.96, 104.22.35.96, 172.67.26.135, 2606:4700:10::6816:2260, 2606:4700:10::6816:2360, 2606:4700:10::ac43:1a87
Redirect IPs 104.22.34.96, 104.22.35.96, 172.67.26.135, 2606:4700:10::6816:2260, 2606:4700:10::6816:2360, 2606:4700:10::ac43:1a87
Response IP 172.67.26.135
Found Yes
Hash 8be8e59871f9fd7d725e2b8a96149da44e8a0af7397babeb53a8df834407c33f
SimHash 729cdd15e595

Groups

*

Rule Path
Disallow /*/show-list/listings.html
Disallow /*/show-gallery/listings.html
Disallow /admin/
Disallow /temp/
Disallow /db_backup/
Disallow /modules/
Disallow /images/listings/
Disallow /periodic.php
Disallow /content.php?*
Disallow /register.php?*
Disallow /details.php?id=*
Disallow /newad.php?*
Disallow /favorites.php
Disallow /favorites.html
Disallow /ocultar.php
Disallow /ocultar.html
Disallow /pre-register.html
Disallow /login.php
Disallow /logout.php
Disallow /mailto.php
Disallow /reply.php
Disallow /report.php
Disallow /access_restricted.php
Disallow /not_authorized.php
Disallow /offline.php
Disallow /include/add_alert.php
Disallow /premium.php
Disallow /top.php
Disallow /subidas.php
Disallow /renewad.php
Disallow /editad.php
Disallow /edit_photos.php
Disallow /templates/*/stylechanger.php?style=*
Disallow /all/about/
Disallow /pre/
Disallow /p/

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

seznambot
cliqzbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

adsbot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /
Back to top

Comments

  • Disallow: /7-ayuda/content.html
  • Bingbot (http://www.bing.com/bingbot.htm)
  • User-agent: bingbot
  • Crawl-delay: 10
  • SemrushBot (https://es.semrush.com/bot/)
  • dotbot (https://moz.com/researchtools/ose/dotbot)
  • AhrefsBot (https://ahrefs.com/robot)
  • BLEXBot (http://webmeup-crawler.com/)
  • CCBot (http://commoncrawl.org/big-picture/frequently-asked-questions/)
  • MJ12bot (http://mj12bot.com/)
  • Seznambot (https://napoveda.seznam.cz/en/seznamcz-web-search/)
  • Cliqzbot (http://cliqz.com/company/cliqzbot)
  • MauiBot (crawler.feedback+wc@gmail.com)
  • Seekport Bot (https://bot.seekport.com/)
  • DataForSeo (https://dataforseo.com/dataforseo-bot)
  • Adsbot (https://seostar.co/robot/)
  • Trendiction Bot (https://www.trendiction.com/bot)
  • PetalBot (https://aspiegel.com/petalbot)
  • SEOkicks (https://www.seokicks.de/robot.html)
  • GPTBot (https://platform.openai.com/docs/gptbot)
  • ChatGPT-User (https://platform.openai.com/docs/plugins/bot)
  • Barkrowler (https://www.babbar.tech/crawler)
Back to top

Warnings

  • `request-rate` is not a known field.
Back to top