Just let Heroku know what your public keys are:

heroku keys:add ~/.ssh/id_rsa.pub