> Sounds a bit like Baron Münchhausen pulling himself and the horse on which he was sitting out of a mire by his own hair.

It sounds crazy, but you've likely seen what NVidia did with high-resolution synthetic faces using their progressive GANs; I'd totally use them as training examples without any hesitation.