Peugeot started as a manufacturing business as early as the 1700's, making items such as coffee, pepper and salt grinders before moving on bicycles and later cars.  Their bicycle manufacturing was kicked off around 1882 with the introduction of the "Brand Bi", a penny-farthing bicycle.  Peugeot's company website has a good write up of their bicycle history on their website.