journals.asm.org
robots.txt

Robots Exclusion Standard data for journals.asm.org

Resource Scan

Scan Details

Site Domain journals.asm.org
Base Domain asm.org
Scan Status Ok
Last Scan2025-09-09T18:50:32+00:00
Next Scan 2025-10-09T18:50:32+00:00

Last Scan

Scanned2025-09-09T18:50:32+00:00
URL https://journals.asm.org/robots.txt
Domain IPs 104.18.35.251, 172.64.152.5, 2606:4700:4402::6812:23fb, 2606:4700:440a::ac40:9805
Response IP 172.64.152.5
Found Yes
Hash c395a436fc38d1fd0bd3d1f73b049a4116511fe088623e918573a7560fdd23a8
SimHash b825d030cb7c

Groups

*

Rule Path
Disallow /search*
Disallow /topic
Disallow /author/
Disallow /authored-by/*
Disallow /thank-you
Disallow */requestResetPassword
Disallow /action
Disallow */doi/metrics/*
Disallow */doi/citedby/*
Disallow */doi/reader/*
Disallow */doi/ref/*
Disallow */epdf/*
Disallow */cdn-cgi/*
Disallow /servlet/linkout?*
Disallow *?resultClick*
Disallow /botdetectcaptcha?*
Allow */suppl_file/*
Allow */action/showFeed?*
Allow */action/downloadSupplement?*

facebookexternalhit
linkedinbot
twitterbot

Rule Path
Allow /

gptbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://journals.asm.org/sitemap-index-1.xml