I miss comments too sometimes and feel awful about it. But as a reader, if a writer doesn't respond to a comment or two, I don't usually notice it.

If I left numerous comments on the same writer's articles and they never responded, that I would notice.