Five thousand bottles went into the Bottle Castle (also known as the Glass Castle) which was a small five-room house completed in 1963. By the time he was finished, Plumb was famous. He entertained visitors from around the world and made appearances on TV shows including The Tonight Show where he played harmonica for Johnny Carson.

Over the years, he used 200,000 bottles. Plumb collected bottles from local industries and others were donated by neighbors and visitors. The structures around the main building included a Leaning Tower of Pisa, a well and a giant Coke bottle – all made with bottles and cement. Around the buildings were animals sculptures, some made from concrete and others carved in stone. In the gardens, there were paths between low walls that led past flower beds to a small waterfall, water lily and fish ponds, a totem pole and a small studio.

After his death in 1976, the complex was maintained by family members until the 1990s. It was then sold to a couple who operated it as a tourist attraction for a few years until it fell into disrepair. Despite some interest in preserving the site, the building and sculptures were bulldozed for highway expansion.