Could you point out for me where Sam talks about diversity of perspectives? All I see him talking about is what the OP mentions - gonads and skin color.
Gonads and skin color are correlated with a diversity of perspectives. All you have to do is look at the perspectives r/TwoX versus r/all, for instance, or Twitter vs. HN.
For instance, just see the period panties thread. Men don't have the perspective necessary to even comprehend the idea of period panties, let alone build one.
Not everything in tech is that obvious, of course. But it's worth thinking about non-obvious ways in which it might.