genomea.asm.org
robots.txt

Robots Exclusion Standard data for genomea.asm.org

Resource Scan

Scan Details

Site Domain genomea.asm.org
Base Domain asm.org
Scan Status Ok
Last Scan2025-09-01T12:01:33+00:00
Next Scan 2025-10-01T12:01:33+00:00

Last Scan

Scanned2025-09-01T12:01:33+00:00
URL http://genomea.asm.org/robots.txt
Redirect https://journals.asm.org/robots.txt
Redirect Domain journals.asm.org
Redirect Base asm.org
Domain IPs 104.232.27.118
Redirect IPs 104.18.35.251, 172.64.152.5, 2606:4700:4400::6812:23fb, 2606:4700:4400::ac40:9805
Response IP 104.18.35.251
Found Yes
Hash c395a436fc38d1fd0bd3d1f73b049a4116511fe088623e918573a7560fdd23a8
SimHash b825d030cb7c

Groups

*

Rule Path
Disallow /search*
Disallow /topic
Disallow /author/
Disallow /authored-by/*
Disallow /thank-you
Disallow */requestResetPassword
Disallow /action
Disallow */doi/metrics/*
Disallow */doi/citedby/*
Disallow */doi/reader/*
Disallow */doi/ref/*
Disallow */epdf/*
Disallow */cdn-cgi/*
Disallow /servlet/linkout?*
Disallow *?resultClick*
Disallow /botdetectcaptcha?*
Allow */suppl_file/*
Allow */action/showFeed?*
Allow */action/downloadSupplement?*

facebookexternalhit
linkedinbot
twitterbot

Rule Path
Allow /

gptbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://journals.asm.org/sitemap-index-1.xml