Best to get good quality inbound links. Cannot answer your question with any authority, but google, despite saying to the contrary, can definitely penalise your site, if a site links to you in a way in which it does not like.
I know that for fact,as this site was not listed in google for over a year because of that, something completely out of my control, anyway they eventually fixed the problem.