In the Folder & Album Structure window located in the left hand side:
1) Click on the folder to add the new album to.
2) Click the Album icon in the lowest left corner. It will display "Add an album" when hovered over.
3) Give the album a name and a description. Click Create to build the new album.