Following the Jafari school of thought is accepted even by the Sunni scholars. The Committee for Mutual Understanding of Mazaheb (Schools of Thoughts) in Al-Azhar has made this decision about 50 years ago. Therefore, there is nothing wrong in following the Jafari school of thought. Shia are our Muslim brothers and sisters and most of what people think of them are based on rumors and political manipulation and propaganda.
[NOTE: For various opinions on this topic, search Jafari.]