I wouldn't wish to be prescriptive and say that there are certain fragrances that one must experience in order to understand perfumery, so all I can really do is tell you what has been instrumental in developing my own knowledge and appreciation.
Firstly, the exercise can be approached in various ways: knowledge of notes and accords; knowledge of styles; knowledge of historical importance and influence; knowledge of various houses and perfumers. I do not suggest that any one of these approaches is necessarily the correct one, as I favour a broad experience of all these ways of gaining knowledge.
Starting with the very basics, I try to experience as many natural scents as I can ... plants, flowers, foods, beverages, inorganic substances, animalic scents, and so on. I also like to experience a range of essential oils. Doing this helps me zero in on exactly what I experience in perfumery, and I take the opportunity as often as I can. Take patchouli, for example, which in essential oil form often smells quite different from the way it is experienced in perfumes. Having this knowledge of a broad range of notes is an important first step towards gaining a good understanding of perfumery as a whole, I think. Individual notes are the building blocks for understanding fragrance accords and styles.
Next, I try to experience a wide range of houses and perfumers. Here, I think that broad experience is more useful than focusing on individual houses, although, if pushed on the subject, I'd list many that have already been mentioned and some others, such as Acqua di Parma, Aramis, Chanel, Dior, Geo. F. Trumper, Guerlain, Hermès, Marc-Antoine Barrois, Penhaligon's, Serge Lutens and YSL. Also, in agreement with Valhelsingv, I'd add Comme des Garçons as a house that creates more unusual scents. Along different lines, but still unusual, you may want to look at Demeter and CB I Hate Perfume.
If I had to pick a few fragrances from these houses, they would mostly be ones that have already been mentioned, with a few additions ...
Colonia Eau de Cologne – Dating from 1916, the classic of Italian perfumery, in my opinion. Much favoured by Hollywood stars in the 1950s, I believe.
Aramis Eau de Toilette – A classic men's fragrance of the 1960s.
N°5 Eau de Toilette – Like it or not, Chanel N°5 (EdT and EdP) remains one of the most iconic fragrances ever.
Antaeus Eau de Toilette – A classic masculine-leaning fragrance of the 1980s. One of the defining expressions of the decade's bold, animalic masculinity.
Kouros Eau de Toilette – Another 1980s animalic powerhouse.
Eau Sauvage Eau de Toilette – Like Aramis, a 1960s icon. Its use of hedione makes it a standout for me.
Jicky Eau de Parfum – For reasons I'll discuss later.
Eau de Cologne Impériale – For reasons I'll discuss later.
Terre d'Hermès Eau de Toilette – A fairly modern fragrance that I feel set a new direction with its flinty, mineral accord.
Ganymede Eau de Parfum – Another modern fragrance that I think represents a departure from the usual.
When it comes to historical importance and influence, all of the above are contenders, in my opinion. Jicky, from 1889, is particularly interesting because it is frequently described as the oldest continuously produced modern perfume in the world. However, there are fragrances that predate it and are still being produced today. Guerlain's own ...
Eau de Cologne Impériale – Dating from 1853, predating Jicky by 36 years. It is in production now, although whether it has remained in continuous production throughout that time is another question. Likewise for ...
Acqua della Regina – Said to date from 1533.
"Farina Eau de Cologne" – Dating from 1709.
"4711 Original Eau de Cologne" – Dating from 1792.
Hammam Bouquet Eau de Toilette – Dating from 1872.
And then there are several offerings from Geo. F. Trumper that predate Jicky and are still in production.
Of course, the distinction between these older fragrances and Jicky is an important one. From what I've read, Jicky's historical significance lies not simply in its use of synthetic materials, which were already beginning to appear in perfumery, but in the innovative way Aimé Guerlain combined them with natural ingredients. In that respect, Jicky is widely regarded as a landmark in the development of modern perfumery.
All these older fragrances are interesting, and I'd like to try them, but the difficulty I have is knowing just how close they are to the original formulations. I suspect most, perhaps even all of them, are somewhat different from what they were over a hundred or more years ago. This raises an interesting question: when we experience a fragrance that was created 150 years ago, are we actually experiencing that historical creation, or merely a modern interpretation of it?