The dimensionality is a challenge here - these are 2D islands in a, what, 2000D space? Imagine a cross section of a cylinder, that would look like an island if it went through the cylinder, but not along it.
I wonder what it would look like if the cross-section plane was aligned with a line between two recognisable points.
When discussing “n parameters,” such as 6B parameters or in the case of GPT4 around 1.7T is the rumored parameters size, each parameter is a dimension. So, yeah, that’s a lot more than 2d or even 2000d. More like 1,700,000,000,000D.
I wonder what it would look like if the cross-section plane was aligned with a line between two recognisable points.