Lisa Adams

47 posts

Lisa Adams

Lisa Adams

@LCAdamsRad

Radiology MD & Assistant Professor @TU_Muenchen | Former Postdoctoral Fellow @StanfordMedicine | Focused on #Radiology, #AI, #MolecularImaging

Munich เข้าร่วม Nisan 2023
117 กำลังติดตาม169 ผู้ติดตาม
Lisa Adams
Lisa Adams@LCAdamsRad·
You're right that "validation" is traditionally used for the split during training to tune hyperparameters and check for overfitting. It makes sense to continue using "validation" for this purpose (also see CLAIM 2024 item 19). Meanwhile, "test" should refer to evaluating the model's final performance on a separate dataset, whether it's internal or external. This distinction helps maintain clarity: "validation" for tuning during training and "test" for the final evaluation.
English
0
0
1
36
Evan Calabrese, MD PhD
Evan Calabrese, MD PhD@ecalabr·
@LCAdamsRad What should we call the split of data used to gauge model overfitting during training? Traditionally this has been called the validation split. It doesn’t seem accurate to call this internal testing data as it’s common to have a separate internal test split to eval performance.
English
1
0
2
163
Lisa Adams
Lisa Adams@LCAdamsRad·
T3. CLAIM 2024 emphasizes precise terminology: ‘internal/external testing’ preferred over ambiguous ‘validation’. Encourages sharing protocols and data/code. Updates aim to standardize AI reporting, increase transparency, and facilitate comparison between studies. #RadAIchat
English
1
2
5
543
Lisa Adams
Lisa Adams@LCAdamsRad·
T5. Beyond reporting, CLAIM educates on best practices in AI study design and execution. It can inform curriculum development for AI in radiology and promote standardization across the field, improving research quality and clinical translation. #RadAIchat
English
0
4
10
568
Lisa Adams
Lisa Adams@LCAdamsRad·
T5. CLAIM serves as a roadmap for comprehensive AI study reporting in radiology. It guides researchers in study design, helps journals maintain reporting standards, and enables readers to critically assess AI research quality. #RadAIchat
English
0
2
9
583
Lisa Adams
Lisa Adams@LCAdamsRad·
T4. CLAIM 2024 replaces 'ground truth' and 'gold standard' with 'reference standard'. This change acknowledges uncertainty in medical data labeling, aligns with other reporting guidelines like STARD, and avoids implying absolute certainty in benchmarks. #RadAIchat
English
0
2
9
935
Lisa Adams
Lisa Adams@LCAdamsRad·
T4. ‘Ground truth’ implies absolute certainty, while ‘gold standard’ suggests a fixed benchmark. CLAIM 2024 adopts ‘reference standard’ to acknowledge the inherent uncertainty in medical data labeling and align with other reporting guidelines. #RadAIchat
English
0
3
7
995
Lisa Adams
Lisa Adams@LCAdamsRad·
T3. CLAIM 2024 adds ‘not applicable’ option, adopts ‘reference standard’ instead of ‘ground truth’/’gold standard’, includes image acquisition details. Simplifies by removing data element definitions. Not extended to radiomics research, keeping focus on AI in imaging. #RadAIchat
English
0
3
10
496
Lisa Adams
Lisa Adams@LCAdamsRad·
T2. CLAIM serves multiple stakeholders: authors use it for thorough reporting, reviewers for completeness assessment, and readers to evaluate study quality and reproducibility. #RadAIchat
English
0
2
6
387
Lisa Adams
Lisa Adams@LCAdamsRad·
T2. CLAIM guides authors in clear AI research presentation. It covers the entire manuscript structure, ensuring critical details on data, model architecture, training, and evaluation are reported. #RadAIchat
English
0
2
8
433
Lisa Adams
Lisa Adams@LCAdamsRad·
T1. The recently updated CLAIM guideline is a comprehensive guideline for AI in medical imaging. It covers 44 items across all manuscript sections, ensuring thorough reporting of data, methods, and results. #RadAIchat
English
0
1
7
965
Lisa Adams
Lisa Adams@LCAdamsRad·
T1. Key AI reporting guidelines in radiology include CLAIM, STARD-AI, MI-CLAIM, CONSORT-AI, SPIRIT-AI, FUTURE-AI, MINIMAR, and RQS. Each addresses specific aspects of AI research reporting and reproducibility. #RadAIchat
English
0
1
5
855
Lisa Adams
Lisa Adams@LCAdamsRad·
Hi there! I'm Lisa Adams, a physician scientist and radiologist at Technical University Munich. Excited to discuss CLAIM guidelines and their impact on AI reporting in radiology. #RadAIchat
English
0
1
10
1.5K