ClusterFusion with Llama-2-7B on H100 GPU: We provide following script to run ClusterFusion. USE_CLUSTER_FUSION=true torchrun --nproc_per_node 1 chat/chat.py \ --ckpt ...
For example, in the image below, creating a linear model in the first case makes far more sense since a clear straight line trend is visible. Also, they help in observing naturally occuring clusters.
Some results have been hidden because they may be inaccessible to you
Show inaccessible results