oh great! I was worried that I really was overthinking it...

I guess my viewpoint is that Sam gave in with the condition that Dean kill Lucifer whilst he is in Sam's body. Dean did so but he really regrets it and that's also why he doesn't think of Lucifer when he thinks back to that time because it was Sam who asked him to kill him...