You can add floors by selecting the building and then increasing the floor number using the Floors field.
Notice in the previous screenshot there are two floors (AirDefense 1 and AirDefense 2) under the area (The Falls 1125). Floor numbers are displayed inside the Floor icon.
You can delete a floor by decreasing the floor number. The last floor is always deleted first.