Salam wa alakum bro,
Remember Allah is most gracious most merciful, people like to see Allah as a God of punishment.. He has no gain in punishing anyone other than to enforce justice or to straighten a person out.
In your case Allah most high is delighted you found Islam and guided you regardless of what ever you were doing before.
Allah knows that you and your situations won't change over night but your now your actively conscious about your behaviour.
If you have any control in the situation without too much loss then go for it... Avoid Avoid the Riba.. If you don't have any control and there may involve a lot of loss.. Then I would say be conscious about it and ask Allah to find you a way out.. But don't fall into shaytarns trap of thinking that the sin is so bad Allah won't forgive it..