It seems to me that there is no solution: either the hole will be too
small for viewing with the naked eye (i.e. without film & long
exposure) or the hole will be too large for a reasonably sharp image.

Cameras obscuras used for painting perspective in the past made use of
lenses, so the aperture becomes bigger in order for the image to
become visible and you can focus on your subject as well. Clever!