Even Brown Dwarfs May Grow Rocky Planets