Phillips was the first president of the Massachusetts General Hospital Corporation, from 1814 to 1826. He was an early donor to the efforts to build the hospital as well as the first person to include MGH in his will. He was a founder and trustee of Phillips Academy and president of the Bank of Massachusetts, and he served three terms as Lieutenant Governor of Massachusetts. The Phillips House at MGH is named in his honor.