According to #44043 just overwrite the binaries in /usr/lib/monodevelop/AddIns/MonoDevelop.PackageManagement through files from nuget-binary/tree/2.12.

However I also needed to install the 5.0 Extension.