bioexplorer.net
robots.txt

Robots Exclusion Standard data for bioexplorer.net

Resource Scan

Scan Details

Site Domain bioexplorer.net
Base Domain bioexplorer.net
Scan Status Ok
Last Scan2024-05-26T05:25:36+00:00
Next Scan 2024-06-02T05:25:36+00:00

Last Scan

Scanned2024-05-26T05:25:36+00:00
URL https://bioexplorer.net/robots.txt
Redirect https://www.bioexplorer.net/robots.txt
Redirect Domain www.bioexplorer.net
Redirect Base bioexplorer.net
Domain IPs 104.26.10.198, 104.26.11.198, 172.67.73.27, 2606:4700:20::681a:ac6, 2606:4700:20::681a:bc6, 2606:4700:20::ac43:491b
Redirect IPs 104.26.10.198, 104.26.11.198, 172.67.73.27, 2606:4700:20::681a:ac6, 2606:4700:20::681a:bc6, 2606:4700:20::ac43:491b
Response IP 104.26.11.198
Found Yes
Hash 2425d58c00fb96f233e0f19089f7fe097f0870e2185e83b3e14da244339689cf
SimHash 61205940a1b0

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

pinterest

Rule Path
Disallow

pinterestbot

Rule Path
Disallow

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

piplbot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.bioexplorer.net/sitemap_index.xml

Comments

  • Bio Explorer Robots file