The bench numbers seem about right for 200GB/s bandwidth. The prefill speeds are really impressive for an SBC though.

It also sets context length to 2k by default iirc, which breaks a lot of tasks, and gives a general bad first impression to users who are likely using local models for the first time.

Could say the same for borh

Non-healing consumables are always either so strong they’re required to finish the game (Terraria) or so weak that they may as well be a placebo (Cyberpunk).