No, sexual attraction is not just a feeling in the mind, psyche or figurative heart.
Sexual attraction is psychological and emotional, and thus it's a feeling in that sense. But sexual attraction is also very much a physical response which leads to distinct bodily sensations.
When people who are undergoing or have completed puberty of adolescence experience sexual attraction, we typically evince telltale physical signs and sensations that can be objectively observed and measured. These include quickening of the pulse, dilation of the pupils, fluttering of the heart, increased salivation, sweaty palms, shortness of breath, hardening and elongation of the penis (erections), swelling of the testicles or labia, vaginal secretions (getting wet), vaginal lengthening, clitoral engorgement and enlargement, increased blood flow to and higher temperature in various body parts.
Some people swoon, faint, and get clumsy and tongue tied when in the throes of sexual attraction. Some people piss their pants, vomit, sneeze, get coughing fits, experience involuntary toe and finger curling. Some people when sexually attracted find their vision becomes blurry or becomes extra clear and focused.
Lots of people when sexually attracted have funny feelings in their stomachs and groins such as "butterflies" and flip-flopping that are probably measurable.
Many people have observable signs of physical sexual attraction to people they don't like and even find contemptible. I personally have felt very strong physical attraction to quite a few fellas I've seen in media and met in RL that I wouldn't want to touch with a barge pole.
IMHO, those who claim that sexual attraction is just a feeling in the mind/psyche are approaching human sexuality from a place of inexperience and ignorance. Makes me wonder how much face to face, in the flesh RL sexual interactions LRC user Geore has had.