NVIDIA interview questions

What does it mean for an algorithm to be numerically unstable? What are the trade-offs between using FP32, FP16, and BF16 precision when training large-scale models on NVIDIA GPUs?When dealing with massive datasets, how do you decide between using sparse matrix representations versus dense ones, and how does this affect memory bandwidth?