biconnector.com
robots.txt

Robots Exclusion Standard data for biconnector.com

Resource Scan

Scan Details

Site Domain biconnector.com
Base Domain biconnector.com
Scan Status Ok
Last Scan2025-10-10T19:48:51+00:00
Next Scan 2025-11-09T19:48:51+00:00

Last Scan

Scanned2025-10-10T19:48:51+00:00
URL https://biconnector.com/robots.txt
Domain IPs 104.21.65.253, 172.67.196.80, 2606:4700:3032::6815:41fd, 2606:4700:3032::ac43:c450
Response IP 172.67.196.80
Found Yes
Hash c5eabb51e8484a926ae9a9b0fe65f3f3482d0590f13efee1668ca33a91467378
SimHash 6c31dd925781

Groups

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

googlebot-mobile

Rule Path
Disallow

msnbot

Rule Path
Disallow

slurp

Rule Path
Disallow

teoma

Rule Path
Disallow

robozilla

Rule Path
Disallow

ia_archiver

Rule Path
Disallow

naverbot

Rule Path
Disallow

yeti

Rule Path
Disallow

yahoo-mmcrawler

Rule Path
Disallow

psbot

Rule Path
Disallow

yahoo-blogs/v3.9

Rule Path
Disallow

*

Rule Path
Disallow /cgi-bin/
Disallow /blog/author/
Disallow /feed/
Disallow /comments/
Disallow /search
Disallow /author/
Disallow /2018/
Disallow /The-Ultimate-Guide-to-Modernize-OBIEE-and-Oracle-Analytics-Cloud-with-Power-BI.pdf

Other Records

Field Value
sitemap https://biconnector.com/sitemap.xml