Bilirubin is, indeed, the result of hemoglobin breakdown at the liver. The gall bladder is not involved at all (bile is green). When liver function is impaired (for example, if you have hepatitis), you become jaundiced (yellow) because you are unable to get rid of bilirubin the usual way.