The bacteria called Propionibacter is responsible for the holes but since you can buy swiss without the wholes and that taste just as good, I don't believe they are a factor in the taste.
Abusive comment hidden.
(Show it anyway.)