Addressing the name Thursday, Cowell says it is "rubbish" and will be changing the group's name before next week's round of performances.
"If you watched the show tonight we have asked you to come up with a new name for 1432 (which is rubbish) #rename1432." Cowell said via Twitter.
As seen on the show, 1432 narrowly escaped elimination. They were saved after a performance of Demi Lovato's single "Skyscraper."
Claiming she hadn't believed them before, Britney Spears said "You guys definitely made me a believer tonight."
It is unclear what the group's new name will be, but Cowell is taking any suggestions you might have.
Due to legal reasons the girls could no longer be called Lylas.
"X Factor" returns with a new round of performances and eliminations next Wednesday at 8 p.m. on FOX.