Google Keyboard quick shortcuts to other languages

So on KitKat Nexus 4, I used the Google Keyboard and installed the Google PinYin input.

Whenever the keyboard popped up, there was a tab for Chinese Input and a tab for QWERTY Input. I could click on a tab and switch languages easily.

I upgraded to Lollipop and the PinYin keyboard seems to be installed by default. The tabs don't show up anymore. Instead, I can press the little "Globe" key on the keyboard to swap languages or long press the space bar.

How do I change it back to the tab view?

It should look like this