Unassigning Plot view in a cue

Assigning lights to a plot is pretty straight forward and then obviously recording that to a cue is easy as well. What I can't seem to figure out, and I'm almost embarrassed to admit is, I can't figure out how to unassign it in a later cue in the same List so they can reference a color palette again. My work around has been to assign those lights in a separate list, raise the priority and then toggle it in the main CueList using the Macro line. If there isn't a way, I'll just stay the course but I'd love to have a way to unassign it.
Any insight out there?