I usually stick to the same providers when I feel like they are enjoying my company as much as I enjoy theirs (whether or not it's real, is another story).
But overall, it's the connection I feel. If I sense that they aren't that into it, or it comes off transactional, I don't go back