Log In Sign Up

pharmascience.com
robots.txt

Robots Exclusion Standard data for pharmascience.com

Resource Scan

Scan Details

Site Domain pharmascience.com
Base Domain pharmascience.com
Scan Status Ok
Last Scan2024-09-24T07:48:51+00:00
Next Scan 2024-10-24T07:48:51+00:00

Last Scan

Scanned2024-09-24T07:48:51+00:00
URL https://pharmascience.com/robots.txt
Domain IPs 104.21.41.210, 172.67.193.152, 2606:4700:3031::ac43:c198, 2606:4700:3035::6815:29d2
Response IP 104.21.41.210
Found Yes
Hash 2b09412428ccec28ea3f2f7982699882e6ab8e7a864057aa7e966da735aa1d33
SimHash 66359af050f3

Groups

*

Rule Path
Allow /wp-admin/admin-ajax.php
Disallow /wp-admin/
Disallow /wp-includes/

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /wp-content/uploads/

mediapartners-google

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

bingbot

Rule Path
Allow /

msnbot

Rule Path
Allow /

msnbot-media

Rule Path
Allow /wp-content/uploads/

applebot

Rule Path
Allow /

yandexbot

Rule Path
Allow /

yandeximages

Rule Path
Allow /wp-content/uploads/

slurp

Rule Path
Allow /

baiduspider

Rule Path
Allow /

baiduspider-image

Rule Path
Allow /wp-content/uploads/

duckduckbot

Rule Path
Allow /

qwantify

Rule Path
Allow /

dotbot

Rule Path
Disallow /

giftghostbot

Rule Path
Disallow /

seznam

Rule Path
Disallow /

paperlibot

Rule Path
Disallow /

genieo

Rule Path
Disallow /

dataprovider/6.101

Rule Path
Disallow /

dataprovidersiteexplorer

Rule Path
Disallow /

dazoobot/1.0

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

domainstatsbot/1.0

Rule Path
Disallow /

dotbot/1.1

Rule Path
Disallow /

dubaiindex

Rule Path
Disallow /

ecommercebot

Rule Path
Disallow /

expertsearchspider

Rule Path
Disallow /

feedbin

Rule Path
Disallow /

fetch/2.0a

Rule Path
Disallow /

ffbot/1.0

Rule Path
Disallow /

focusbot/1.1

Rule Path
Disallow /

huaweisymantecspider

Rule Path
Disallow /

huaweisymantecspider/1.0

Rule Path
Disallow /

jobdiggerspider

Rule Path
Disallow /

lemurwebcrawler

Rule Path
Disallow /

lipperheylinkexplorer

Rule Path
Disallow /

lssrocketcrawler/1.0

Rule Path
Disallow /

lyt.srv1.5

Rule Path
Disallow /

miadev/0.0.1

Rule Path
Disallow /

najdi.si/3.1

Rule Path
Disallow /

bountiibot

Rule Path
Disallow /

experibot_v1

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 5
Back to top

Other Records

Field Value
sitemap https://www.pharmascience.com/sitemap_index.xml
Back to top

Comments

  • Direct link to Sitemap.xml
  • Allow All Known Bots
  • Disallow Spam Bots
Back to top