sqlbi.com
robots.txt

Robots Exclusion Standard data for sqlbi.com

Resource Scan

Scan Details

Site Domain sqlbi.com
Base Domain sqlbi.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-19T04:40:20+00:00
Next Scan 2025-12-18T04:40:20+00:00

Last Successful Scan

Scanned2025-04-29T08:11:58+00:00
URL https://sqlbi.com/robots.txt
Redirect https://www.sqlbi.com/robots.txt
Redirect Domain www.sqlbi.com
Redirect Base sqlbi.com
Domain IPs 20.119.0.24
Redirect IPs 20.119.0.24
Response IP 20.119.0.24
Found Yes
Hash 77ad20dba1bc5a8dea89f978c2f28be67c241da33952a1b5432edd90e67b2d6b
SimHash 105c78d0e801

Groups

gptbot

Rule Path
Disallow /articles/
Disallow /whitepapers/
Disallow /wp-content/

google-extended

Rule Path
Disallow /articles/
Disallow /whitepapers/
Disallow /wp-content/

serpstatbot

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

mtrobot

Rule Path
Disallow /

mauibot (crawler.feedback+wc@gmail.com)

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

app.limber.io

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

awariobot

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

awariorssbot

Rule Path
Disallow /

crawler

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

nutch

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

*

Rule Path
Disallow /wp-admin/
Disallow /u/
Disallow /cert/
Disallow /learn/
Disallow /account/
Disallow /cart/
Disallow /checkout/