I would suggest you log in as the main administrator and change the email address of the main administrator. Then change the password of the main administrator.
This way the previous admin will not be able to log in because he does not have the new password.