Thank you for your great work, would like to ask I want to train vit and Q-Former again with my own data on the basis of the stage4 post-training weights, during which the LLM is frozen, what should I do? If I train on the stage2 training framework, how do I import the weights after the stage4 training?
Thank you for your great work, would like to ask I want to train vit and Q-Former again with my own data on the basis of the stage4 post-training weights, during which the LLM is frozen, what should I do? If I train on the stage2 training framework, how do I import the weights after the stage4 training?