Log In Sign Up

www.accessdata.fda.gov
robots.txt

Robots Exclusion Standard data for www.accessdata.fda.gov

Resource Scan

Scan Details

Site Domain www.accessdata.fda.gov
Base Domain fda.gov
Scan Status Ok
Last Scan2025-02-13T21:19:30+00:00
Next Scan 2025-03-15T21:19:30+00:00

Last Scan

Scanned2025-02-13T21:19:30+00:00
URL https://www.accessdata.fda.gov/robots.txt
Domain IPs 23.50.83.222, 2600:1413:3800:182::308a, 2600:1413:3800:188::308a
Response IP 23.50.83.222
Found Yes
Hash 0b48413db0f448b22fabeb04cdb813b46fb6c2a1cfab62f86159cd1a30ca4069
SimHash 5b52da024556

Groups

eventmachine

Rule Path
Disallow /

*

Rule Path
Disallow /scripts/cder/bmis/
Disallow /scripts/cder/BMIS/
Disallow /scripts/cdrh/cfdocs/cfClia/
Disallow /scripts/cdrh/cfdocs/cfclia/
Disallow /scripts/cdrh/cfdocs/cfCLIA/
Disallow /scripts/cdrh/cfdocs/cfrl/rl.cfm
Disallow /SCRIPTs/cdrh/cfdocs/cfrl/rl.cfm
Disallow /SCRIPTs/cdrh/cfdocs/cfRL/rl.cfm
Disallow /scrIpts/cdrh/cfdocs/cfrl/rl.cfm
Disallow /SCRIPTS/cdrh/cfdocs/cfrl/rl.cfm
Disallow /scripts/cdrh/cfdocs/cfRL/rl.cfm
Disallow /scripts/cdrh/cfdocs/cfres/textresults.cfm
Disallow /scripts/cdrh/devicesatfda/
Disallow /scripts/cdrh/cfdocs/cftplc/
Disallow /scripts/cdrh/*excel*.cfm
Disallow /scripts/cdrh/*excel*.CFM
Disallow /scripts/cdrh/*Excel*.cfm
Disallow /scripts/cdrh/*Excel*.CFM
Disallow /SCRIPTs/cdrh/devicesatfda/
Disallow /scripts/email/
Disallow /scripts/enforcement/enforce_rpt-Event-Tabs.cfm
Disallow /scripts/enforcement/enforce_rpt-Event-All-Tabs.cfm
Disallow /scripts/ImportRefusals/ir_index.cfm
Disallow /scripts/warningletters/
Disallow /scripts/search/
Disallow /scripts/enforcement/enforce_rpt-Event-Tabs.cfm
Disallow /scripts/enforcement/enforce_rpt-Event-All-Tabs.cfm
Disallow /drugsatfda_docs/rems/
Disallow /DrugsAtFDA_docs/REMS/
Back to top

Comments

  • robots.txt file for Accessdata
  • For all crawlers
  • added 28 Apr 2016 by CN
Back to top

Warnings

  • `concurrent-hits` is not a known field.
  • `hit-rate` is not a known field.
  • `visiting-hours` is not a known field.
Back to top