> The remote features require a version of Vim with GUI features compiled in, but you don't have to run vim in GUI mode to use them.

You do have to have an X server available though; the client/server communication occurs via X.