(I’m maybe a wrong person to answer, since I have very limited Windows experience, but anyway…)
For OSX/Linux there are version managers, that let’s you install and use and easily switch between any Ruby version. RVM is an example of such tool. I would assume that something like this also exists for Windows? Quick googling revealed a tool called pik, but unfortunately according to the README it’s no longer maintained.