Abstract: Multiple zeta values (MZVs) in the usual sense are the special values of multiple variable zeta functions at positive integers. Their extensive studies are important in both mathematics and physics with broad connections and applications. In contrast, very little is known about the special values of multiple zeta functions at non-positive integers since the values are usually singular. We define and study multiple zeta functions at any integer values by adapting methods of renormalization from quantum field theory, and following the Hopf algebra approach of Connes and Kreimer. This definition of renormalized MZVs agrees with the convergent MZVs and extends the work of Ihara-Kaneko-Zagier on renormalization of MZVs with positive arguments. We further show that the important quasi-shuffle (stuffle) relation for usual MZVs remains true for the renormalized MZVs.