When working with private keys that are protected with a passphrase on Ubuntu server you will be prompted you to enter the passphrase on each use. Just like on your desktop environment you can however use an SSH agent in which you load your keys for the duration of your session.
