After a bit more of poking around I managed to do it. One of the options I read about here was deleting the album name, but it wasn't letting me completely delete it. What I did was just abbreviate it.
For example, in my case the album's name that was split into three was "Ella and Louis". I named two of them just "Ella", went to list mode searched for the album there, highlighted all of them and changed to Ella and Louis. And sure enough that put them all in the same album.
Thanks for your help anyways. Hope this helps if it ever happens to you again. Seems a bit easier, albeit still tedious, than having to go chasing them into the recycle bin.