Pressure to do so increased after a serious complaint against the Eastern Cape judge president came to light