Scalability of Long-term Cross Adversarial Training in Few-shot Text Classification with Large Language Models

Meta-learning model can quickly adapt to new tasks using few-shot labeled data. However, despite achieving good generalization on few-shot classification tasks, it is still challenging to improve the adversarial robustness of the meta-learning model in few-shot learning. Although adversarial training (AT) methods such as Adversarial Query (AQ) can improve the adversarially robust performance of meta-learning models, AT is still computationally expensive training. On the other hand, meta-learning models trained with AT will drop significant accuracy on the original clean images. This paper prop

Research goal: How scalable is the Long-term Cross Adversarial Training method when applied to larger language models (e.g., Llama-2 70B) in few-shot text classification tasks under adversarial attacks?

Autonomous synthesis report generated by Assignee Research. Tribunal consensus score: 8.7/10.