You can rest assured that not much of a single bit of dirt will reach the water.
Given that they are one gigantic sheet, they take time and effort to absorb. Keeping your pool covered if not in use will prevent accidental submersion which usually happens in children and house pets.