They were all stamp collectors, and feature among Robert Irwin’s oddball fraternity caught up in a collecting mania spanning centuries