Flan-PaLM
An instruction-tuned model from Google built on PaLM, exhibiting strong zero-shot and few-shot capabilities across a range of NLP tasks.
Timeline (last 90 days)
Flan-PaLM and Med-PaLM 2 report accuracies of 57.6% and 72.3% on MedMCQA under different protocols, which are inconsistent with the evaluation protocol of this paper's best result of 46.0%, so direct comparison requires caution.
Med-PaLM is a series of language models for the medical domain introduced by Google; its first generation was based on Flan-PaLM with medical instruction tuning, and Med-PaLM 2 further introduced expert feedback and finer alignment strategies.
All Facts (2)
Flan-PaLM and Med-PaLM 2 report accuracies of 57.6% and 72.3% on MedMCQA under different protocols, which are inconsistent with the evaluation protocol of this paper's best result of 46.0%, so direct comparison requires caution.
50%UnverifiedMed-PaLM is a series of language models for the medical domain introduced by Google; its first generation was based on Flan-PaLM with medical instruction tuning, and Med-PaLM 2 further introduced expert feedback and finer alignment strategies.
50%