2 Monitors, 2 separate sets of speakers

[NickTheWelder]

OK so this might be a crazy idea, and it might also be totally impossible. Furthermore, it might be completely pointless, but I have a crazy idea and I want to know if you guys think it's possible. What I'm trying to do is have all the audio that would come from anything displayed on my TV (HDMI out on my GeForce card) run through one set of speakers. The speakers in question is a tower speaker running through the audio out on the back of my computer. But I would also like any audio that would come from anything displayed on my monitor (DVI out on the GeForce) run through a different set of speakers. Those speakers would be the ones that are mounted in my monitor, and run through the headphone out port on my computer. The windows audio thing recognizes the headphone port and the audio out on the back as two totally separate ports, and I can run them both at the same time, or one at a time, depending on what I set as default audio out. Do you guys think this is possible? Any constructive input would be appreciated, no rush as, like I said, this might be completely pointless, it's just a crazy idea I had that I thought might be cool. In the end, I want to be able to drag, for example, a youtube video that is playing from my TV to the monitor and have the audio follow it.