I guess I would have to use a marker, but I can't figure it out.
The table column column shows one way to do this with a regular JTable. I would guess it works for JXTable as well.