They are actually not stored permanently. The last 50 lines of private chat are held in memory, but they aren’t disk backed or anything. So presently this isn’t possible.
That isn’t to say that we shouldn’t revisit and rethink that at some point, but that’d be a decision to be made when the private chat functionality is revamped.