 The LMs were trained on the Summit supercomputer , using 5616 GPUs  and one TPU Pod , using V3-512 cores.
<fluency>  The LMs were trained on the Summit supercomputer , using 5616 GPUs  and one TPU Pod , using V3-512 cores.
 The LMs were trained on the Summit supercomputer , using 5616 GPUs ) and one TPU Pod , using V3-512 cores.