Appeals ouster, Thomas D. Spencer says he was fired for criticisms