They both are different. An elegant stuff might not be correct and the correct stuff might not be elegant. But it’s always better to have both.
An idea might be elegant but incorrect. An idea might seem ethical and correct but not elegant.
“Elegant” is in the eye of beholder. “Correct” is decided by the ultimate judge of science, history nature or the result from experiments.