celextel.org
robots.txt

Robots Exclusion Standard data for celextel.org

Resource Scan

Scan Details

Site Domain celextel.org
Base Domain celextel.org
Scan Status Ok
Last Scan2026-02-12T08:04:39+00:00
Next Scan 2026-02-19T08:04:39+00:00

Last Scan

Scanned2026-02-12T08:04:39+00:00
URL https://celextel.org/robots.txt
Redirect https://www.celextel.org/robots.txt
Redirect Domain www.celextel.org
Redirect Base celextel.org
Domain IPs 104.21.63.41, 172.67.143.16, 2606:4700:3034::ac43:8f10, 2606:4700:3037::6815:3f29
Redirect IPs 104.21.63.41, 172.67.143.16, 2606:4700:3034::ac43:8f10, 2606:4700:3037::6815:3f29
Response IP 104.21.63.41
Found Yes
Hash 5af13b0c66f694c6c911896f158a33b57db56d61f7e4730d99519cd42a526647
SimHash 4a0747725682

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 12

*

Rule Path
Disallow /.well-known/
Disallow /backups/
Disallow /blackhole/
Disallow /cgi-bin/
Disallow /data/
Disallow /error_page/
Disallow /includes/
Disallow /plugins/
Disallow /scripts/
Disallow /theme/
Disallow /.htaccess
Disallow /banned.php
Disallow /error_log
Disallow /errorlogs_clean.php
Disallow /filesafe.php
Disallow /gsconfig.php
Disallow /rss.css
Disallow /wp-login.php
Disallow /z_uptime.txt

ahrefsbot

Rule Path
Disallow /

applewebkit

Rule Path
Disallow /

arquivo-web-crawler

Rule Path
Disallow /

backlinkcrawler

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

clarabot

Rule Path
Disallow /

domain re-animator bot

Rule Path
Disallow /

domainstatsbot

Rule Path
Disallow /

downloaderchrome

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

earwigbot

Rule Path
Disallow /

eventgurubot

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow /

googlebot-image/1.0

Rule Path
Disallow /

jersey

Rule Path
Disallow /

lightspeedsystemscrawler

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

mozilla/5.0 (compatible; megaindex.ru/2.0; +http://megaindex.com/crawler)

Rule Path
Disallow /

obot

Rule Path
Disallow /

pagepeeker

Rule Path
Disallow /

proximic

Rule Path
Disallow /

python

Rule Path
Disallow /

python-requests

Rule Path
Disallow /

python-urllib

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

seekport

Rule Path
Disallow /

semanticscholarbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

sougou+web+spider

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yandeximages/3.0

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.celextel.org/sitemap.xml

Comments

  • Hi Robots! Welcome!
  • Hi Humans! This File is not for you!
  • Robots Main Rules
  • Folders and Files Disallow Rules
  • Robots Disallow Rules

Warnings

  • 2 invalid lines.
  • `host` is not a known field.
  • `indexpage` is not a known field.
  • `request-rate` is not a known field.