I wouldn't think twice about it. I've got hand loaded hollow points in my "convenient" pistol. If the BG comes into my house, where does it say what I can or can't shoot him with? To me, this whole argument is ridiculous. If I was sitting on the couch with a .50 BMG, and I shot him with that - it makes me fail because that's a "man-killer" round? pffft - please.
One we are not just talking about shootings that happen in your house. Two besides the who mankiller thing there is the concern with forensic accuracy which is almost impossible with most people and their handloads.