In general, I like the idea of further distributing things out. But, there is a couple aspects you might not have considered.
Some of us, due to particulars of where they work, will find it significantly easier to contribute to a common cncf managed repository rather then hosting something of their own.
The second, being part of the cncf, certain resources can be brought to bare for things like testing. It won't be so easy for some self hosted repositories.
Due to this, I would ask that in addition to the split, that the charts repo be kept. Most of the charts can be split out to their own repositories. The remainder can be kept for those that need to contribute as before.