That is unrelated to an issue that essentially amounts to adding your friends' phone numbers (phone numbers they already made available to you) to your new address book when you get a new phone.
Not if Google subsequently decide to make your information available more widely than it was originally, it's not -- and I would remind you that several of the Internet giants, including both Google and Facebook, have faced heavy criticism for deliberately doing exactly that in the not-so-distant past.