What to do with Advantage items after maxing stat?

Oh, you will want to keep them. As others have already mentioned, there are going to be some tough late-game rolls.