There are examples of other language models that learned to do hard math problems such as symbolic integration which are difficult even for professionals empowered with dedicated (non learning) software.