Lora 中 怎么 实现 矩阵压缩

1. 导入必要的库

import torch
import re
from datasets import Dataset
from transformers import AutoTokenizer, AutoModelForCausalLM, TrainingArguments, Trainer, \get_cosine_schedule_with_warmup, EarlyStoppingCallback
from peft