Send users emails surveying their experience. Just feeling like they're being heard is enough to keep some people sticking around. Make sure you act on the most actionable and priority pieces of feedback and respond to your users in order to further the feeling that you're responsive and actively making changes based on valid suggestions. You can do this via email or a product update blog post.