I have a few times and didn’t find it weird because we always start with dinner. This gives us time to warm up to each other.
A few times I’ve had dinner dates and the man wished I could have stayed the night…unfortunately I cannot accommodate last minute overnight requests