Well, you happen to be a member of a fairly small minority who feel the way you do. There's nothing wrong with that!
As you say, people who take your approach can not achieve the level of performance that the top international competitors do. That's just the way things are.
As for the ethics of supplementation, at what point does it become wrong? Is it wrong to boil tea leaves just to extract the caffeine, catechins, and other chemicals we want out of them and make tea? That could be considered a supplement. Is it wrong to eat extra fruit after a work out? That might be a supplement. Is it wrong to drink lots of milk after a work out? If it's not, then there's nothing wrong with whey or casein protein supplements, since they are expensively dried milk. Is there something wrong with eating oranges because they have lots of Vitamin c? If you noticed that you performed better when you ate an orange a day, even though you didn't need it and oranges didn't grow in your area, are you doing something wrong?
In the end, most of the supplements that elite athletes use are just natural products; either proteins, carbohydrates, vitamins, or minerals. If there's nothing wrong with eating a whole food that contains them then there should be nothing wrong with consuming a dried and concentrated version. How do you feel about these issues?