TREC-COVID: Rationale and Structure of an Information Retrieval Shared Task for COVID-19.

TREC-COVID: Rationale and Structure of an Information Retrieval Shared Task for COVID-19.

Roberts, Kirk;Alam, Tasmeer;Bedrick, Steven;Demner-Fushman, Dina;Lo, Kyle;Soboroff, Ian;Voorhees, Ellen;Wang, Lucy Lu;Hersh, William R;
Journal of the American Medical Informatics Association : JAMIA 2020
226
roberts2020treccovidjournal

Abstract

TREC-COVID is an information retrieval (IR) shared task initiated to support clinicians and clinical research during the COVID-19 pandemic. IR for pandemics breaks many normal assumptions, which can be seen by examining nine important basic IR research questions related to pandemic situations. TREC-COVID differs from traditional IR shared task evaluations with special considerations for the expected users, IR modality considerations, topic development, participant requirements, assessment process, relevance criteria, evaluation metrics, iteration process, projected timeline, and the implications of data use as a post-task test collection. This article describes how all these were addressed for the particular requirements of developing IR systems under a pandemic situation. Finally, initial participation numbers are also provided, which demonstrate the tremendous interest the IR community has in this effort.

Access

Citation

ID: 106150
Ref Key: roberts2020treccovidjournal
Use this key to autocite in SciMatic or Thesis Manager

References

Blockchain Verification

Account:
NFT Contract Address:
0x95644003c57E6F55A65596E3D9Eac6813e3566dA
Article ID:
106150
Unique Identifier:
ocaa091
Network:
Scimatic Chain (ID: 481)
Loading...
Blockchain Readiness Checklist
Authors
Abstract
Journal Name
Year
Title
5/5
Creates 1,000,000 NFT tokens for this article
Token Features:
  • ERC-1155 Standard NFT
  • 1 Million Supply per Article
  • Transferable via MetaMask
  • Permanent Blockchain Record
Blockchain QR Code
Scan with Saymatik Web3.0 Wallet

Saymatik Web3.0 Wallet