You can use the batch file converter to change formats. You can also just drag the files into Reaper and it will sample rate convert on the fly. If you want to make sure you're using the best quality preserving method, then upsample the files in question with the batch file converter to your projects sample rate using the highest quality conversion (offline only) first.