Add TurboQuant3/4 modes to quantized_scaled_dot_product_attention#3453

dedalien wants to merge 23 commits into

ml-explore:mainml-explore/mlx:mainfrom

dedalien:turboq/integrate-generic-quant-sdpadedalien/mlx:turboq/integrate-generic-quant-sdpaCopy head branch name to clipboard