I think what the plants on my list have in common, is zero drought tolerance. I much prefer plants that can endure a brief drying out period (though, I do enjoy aquatics). Here is my short list.
GARDENIAS (too temperamental)
Tree ferns (I could populate a forest with all the ones I killed)
Arabian sambac jasmine, very, very prone to mealy bugs.
Creeping fig (they always die on me)
Coffee USED to be on my list but, I have been doing better with it in bigger pots, higher moisture for longer periods. They can also be prone to mealy bugs over winter but I have been lucky with my current one.