I've been using a do-it-yourself connector [0] (aka Hack Connect) for my own boards - it stays in the board by itself.

Interesting the link you posted - it seems 2x5p 1.27mm version with one pin cut would work as the pogo version of Hack Connect.

[0]: https://arcade.makecode.com/hardware/dbg