That day my boss offered to take me home because it was quite late, I agreed, and the next day all my neighbors were talking about it

I am 35 years old, live alone, work in a good office, my boss is very kind and always helps me on every issue.

I finished work late that day, he offered to drive me home.
He dropped me off in front of my house at 11 p.m., and the next day all the neighbors were already talking about it. I didn’t do anything wrong, but people see things the way they want to see them.