Depends on when I'll be wearing it, I've got a few pairs of trackies and t-shirts that are comfy to wear around the house but I'd not be seen dead wearing out in public.
In general though, a combination of the both is key, I won't wear something uncomfortable because it's branded, but I won't wear some amazing comfy item of clothing (like a onesie) if it looks silly.