Actually, you might be in luck! If you want to style a tab according to the domain, the TAB element has an attribute called IMAGE which is the URL for the Favicon it displays. If the website has a favicon then you can do this:

@namespace url(http://www.mozilla.org/keymaster/gatekeeper/there.is.only.xul);
tab[image*="example.com"] {background:red !important;}