I've been using Perian without the preference pane since I wrote this post (actually slightly longer!), and have noticed no problems at all.
The prefpane also runs an update checker, and will let you know if there is an update. Please keep your software up to date.
The preference pane was annoying to me as well so I followed these instructions on my system yesterday. Have you had any negative effects from doing this? Great tip!