The idea of how the relationship develops is that she goes from his personal plaything/pet to confidant/lover.
Neither of them wanted to get too attached, Lilian only wanted to survive and a place to stay while Hoyt just wanted a plaything.
Time lead to him to feel something more than just carnal convenience her. Lilian's act of seduction eventually become something more genuine and tender...