When in the Lobby for local Multiplayer, possibly with Remote Play Together, only one controller can join the game by pressing X.
Input from the other controllers is ignored.

You see a Popup in the bottom left. But you can't close it.

Go back to the main menu. Then close the Popup by clicking the X in the corner.

Try again, everything should work now.