...only if you don't mind the hammer bouncing off the frets and whacking you in the face...a proper fret hammer absorbs the shock and prevents this!
Oh! And when you get your new fret hammer it is a good thing to sand off any sharp edges! You don't want sharp edges imprinted on your frets.