I understand the meaning of the idiom, but I reject the implications in this case.
It is our tastes that age, and the fault is in them. If a game is well received at release, then poorly after time, it "aged poorly," the implication is we had poor taste then and good taste now. Similarly, when a game is poorly received at release but well received now, it is a "hidden gem," implying we had poor taste then, and good taste now. The fallacy is that "now," whatever time that is, we have good taste... simply because it is the taste we have "now." This is nothing more than chronological snobbery, the belief that what appeals to contemporary taste is good and the blindness that the contemporary taste is just one "fashion" among many that will itself fade away.
I prefer to deal with more concrete standards of criticism. Therefore, "aged poorly" as a category of criticism has no weight in itself, and I reject it wholly as a standard and even as a useful idiom.