added zero3 config

bing bert working script

added bert ds pretrain

DS inference examples (#53) (#111)

Z3 arg update (#105)

1-bit LAMB optimizer example scripts (#97)

Add Megatron clarification (#99)

ZeRO-Infinity examples (#98)

1-bit Adam v2 example scripts (#89)

missed PR merge after Init rename (#93)

Megatron + ZeRO-3 (#91)

Megatron 3D parallelism example (#82)

Fix transformer kernel call parameters (#81)

[mpu] typos (#80)

Add deepspeed for the glue finetuning tasks & bert-large scripts (#77)