handle ZeroDivisionError

fix eval logic

change config

change layer norm order

add save dir

fix bug

fix logging issue

fix bug: DistributedDataParallel' object has no attribute 'clip'

solve out of memory issue

fix ddp issue (all gather back wards returns not enough grad)

fix allgether

fix allgether

fix config and allagther

solve text_token dtype mismatch

solve image loading issue