Cleaned up patches, remove the aarch64-fregs one (it was fixed with a musl patch, instead), and moved closer to where upstream is moving regarding musl compat.