Add multigpu pt - #288

Draft

gkumbhat wants to merge 10 commits into

caikit:mainfrom

gkumbhat:add_multigpu_pt

Commits on Nov 26, 2023

:construction: Initiate HF Trainer

gkumbhat
and
alex-jw-brooks
committed
f6ae261
:construction: Replace custom training loop with HF Trainer

gkumbhat
and
alex-jw-brooks
committed
da9418d

Commits on Nov 30, 2023

:fire: Remove old training execution functions
gkumbhat
committed
c442b06
:construction: Fix missing imports and arguments

gkumbhat
and
alex-jw-brooks
committed
565cb3c
:bug: Remove explicit conversion of model to dtype

gkumbhat
and
alex-jw-brooks
committed
fc6e689
:art: Fix formatting

gkumbhat
and
alex-jw-brooks
committed
3498d3d
:art: Fix linting
gkumbhat
committed
0fbac9f
:art: Fix formatting
gkumbhat
committed
f051d83
:art: Fix linting

gkumbhat
and
alex-jw-brooks
committed
4561ae1

Commits on Dec 1, 2023

:construction: Add FSDP configuration for executing training across multi-gpu

gkumbhat
and
alex-jw-brooks
committed
b720824