A guilty conscience means at least you’ve got one
The Wallflowers — Here He Comes (Confessions of a Drunken Marionette)