Masexual or Mansexual refers to the exclusive attraction to men. This definitely in includes binary men, but it can also include masculine aligned non-binary people depending on the person. The term was made with non-binary people in mind, so they don't have to use terms like "gay" or "straight" but binary people can use it.
Similar terms include androphilic, mascic, viramoric, uranic, and minsexual.