mnaylor/bigbird-base-mimic-mortality

BigBird for Mortality Prediction

Starting with Google's base BigBird model, we fine-tuned on binary mortality prediction in MIMIC admission notes. This model seeks to predict whether a certain patient will expire within a given ICU stay, based on the text available upon admission. Data prepared for this task as described in this project, using the simulated admission notes (taken from discharge summaries). This model will be used in an upcoming submission for IMLH at ICML 2021.

References

• Van Aken, et al., 2021: Clinical Outcome Prediction from Admission Notes using Self-Supervised Knowledge Integration
• Zaheer, et al., 2020: Big Bird: Transformers for Longer Sequences