Not quite that simple. You have to reset wifi on the drone every time, put the controller in pairing mode, press the button combination (which sometimes takes two or three tries), etc.
Again - not a huge problem if i did it once every few weeks, but i switch between phone and controller...