add moe hyperparams

add implementation for mixture of experts model

remove unnecesary imports, add peft dep for finetuning

create 4M model, add hf link

update links in readme

initial commit