a↗agentbay.Explore catalog ↗
AgentBay / Directory

kermt-add-cmim-pretrain

Skill

About kermt-add-cmim-pretrain

Convert a grover_base checkpoint (encoder-only or encoder + vocab heads) into a hybrid checkpoint by adding a randomly-initialized cMIM decoder + latent_dist, then continue pretraining on the user's corpus as hybrid (vocab + contrast). Effectively kermt-continue-pretrain with a one-time ckpt-conversion step prepended.

Community

0 use this · 0 favorites

← Back to the directory