Folders are what you see, and Albums are what the public sees.
When you change a folder to public, that folder is displayed as an album on your public page and is then available for anyone to see.
By default all your photos are private.
Tip: You can resize the width of the folder and file pane by hovering over the dividing line and dragging with the grippers.