I have v4.22.2.540 (2.5.8). "Settings > Main > Automatically Sign In" is not being remembered as checked. If I exit, then return to Plex, it asks for my pin, and the setting is unchecked.
Actually, it looks like none of the "Main" settings are being remembered.