Making Better Use Of Memory In AI Applications

Steven Woo, Rambus fellow and distinguished inventor, talks about using number formats to extend memory bandwidth, what the impact can be on fractional precision, how modifications of precision can play into that without sacrificing accuracy, and what role stochastic rounding can play.

Rambus,Semiconductor Engineering,IEEE,BFLOAT16,exponent,Microsoft,Xilinx,mantissa,memory,AI,power efficiency,inferencing,co-design,