You're not wrong at all, and I do worry too, for sure. But after seeing so many people on this site openly talk and even rate encounters with details about what's going on, and seeing them as members for years and years, I worry less and less.
You also have to weigh your personal risk/reward...