asteroza + learning + infiniband   2

yahoo/CaffeOnSpark
Yahoo built a frankenstein framework to support frankenstein hadoop clusters, with a custom MPI over RDMA protocol, infiniband interconnects,and Yarn scheduling SPark and other Deep Learning workloads. The smart approach is an integrated single cluster, so deep learning workloads stay in cluster, but can migrate between GPU and CPU stages.
Caffe  Spark  hadoop  deep  learning  cluster  framework  GPU  GPGPU  CPU  yarn  scheduling  MPI  RDMA  infiniband  yahoo  opensource  software  Delicious 
february 2016 by asteroza

Copy this bookmark:



description:


tags: