when you hold the door open for someone and they don't say thank you or acknowledge it at all

I watched a man walk through the door I'd held open for a full three seconds before I realized he thought I was just standing there, blocking his path. He sighed. I let it close on myself to apologize.