I'm like that too, but the 3DS is just so awfully outdated I can't stand it. The screen resolution is so awful, you can barely make out anyone's face in XY/ORAS. Everything's just so pixelated and jagged on the system. I'm not looking for anything insane visually, I just want to actually see what the models are supposed to look like when the resolution isn't turning them into a jumbled mess (if you see the games on an emulator, everything looks so nice and smooth, you can actually see details you can't on the 3DS since modelling work is always done on a computer at a higher resolution) and I want better framerate for battles.
Also, the more processing power they have, the more they can do with the models and game world. Wouldn't you like to have Pokemon follow you around, and even have actual idle battle and move impact animations like in the gamecube and Stadium games? The more powerful the system is, the more Game Freak can give us in the games. You're also looking at the possibility of very large regions, and even travelling betwen two or more separate regions. The Switch would be the best thing to happen to the franchise.