For real DIY audio on PC, try the covox. It's a resistor based "dac" for the paralell port that we used to build as kids too before we could afford a proper sound card.
You could also buy a commercial version if you didn't want to solder [1]
I seem to recall that the USB ones don't work for this kind of thing. From my teenage memories, you could bit-twiddle by writing to a memory address. I presume the USB ones use a UART that doesn't allow direct memory access, or precise timing, or something.
The one linked in the parent is a PCI card, so this might not apply.
You could also buy a commercial version if you didn't want to solder [1]
[1] https://en.wikipedia.org/wiki/Covox_Speech_Thing