Add USES=xorg and USES=gl to ports in categories starting with 'j' While here, try to sprinkle other USES (mostly gnome and sdl) as needed.
