I wouldn't say optimal survival necessarily...
You can survive very well without them though. Remember, all of the animal organ meats and fats are going to be the ones that contain all of the vitamins and minerals that we need. Problem is... no one eats those... and then they eat processed foods and no fruits and veggies which is why everyone is so vitamin/minderal deficient nowadays.
In general though I wouldn't go to either extreme unless you want to see how your body reacts. Just eat everything of non-processed food in moderation. Fish, meat, fowl, etc. + fruits, veggies, nuts, etc