Why would exports grow? And who would be the buyers?

If the UK does not accept freedom of movement, it won't have access to the single market. Exports of goods are more likely to decline as a result. UK banks would also lose passporting rights, meaning they would have to relocate to keep doing business in the EU.