How do I completely remove an app from Spanbox?

Remove it from its entry in your Spanbox sidebar and its local session is cleared from your machine. Nothing on the actual service is touched, your Gmail, Slack or whatever keeps all its data, you've just freed up an app slot and signed that local session out. Add it back and log in again anytime.