Right-clicking the icons also works, at least on the Mac. That is my own preferred method as it is quicker than a long press and provides a bigger target than the tiny arrows in the corners.