You might not worry about an easy branch or leaf, but such things can turn into a hazard individuals swimming within your pool.
Have a phone installed near your pool which won't have to leave children even for only a short while to answer calls.