Yes, that's right! Not only is bamboo sufficiently stiff, it also is quite light, making it a great material for the construction of bike frames. The stalks grow in a nice "tube" shape ...
With a few picture frames, some bamboo skewers, craft sticks ... depending on how you'd like to style your decorative shelf and since they typically only carry water-based paints.