leftovers

there is this saying that if u really love someone, you should let her go..if she comes back to you..then she is yours for real..but doesn't that mean she is actually just someone leftovers? more of a second hand thing or fifth or sixth?