LOS ANGELES (CNN) -

Dr. Conrad Murray, who was Michael Jackson's personal physician, is refusing to testify in the wrongful death lawsuit that the singer's mother filed against concert promoter AEG Live.

If called, he will plead the fifth so as not to incriminate himself, the doctor said in a statement sent to the Jackson family.

Murray has never been questioned under oath about Jackson's death which occurred on his watch.

He did not testify at his trial, where he was found guilty of causing Jackson's death on June 25, 2009, by administering a deadly overdose of sedatives and the surgical anesthetic propofol in what he told police was an attempt to cure the singer's insomnia.

He is serving a four-year sentence but could be out in two.

On Monday, he was supposed to be deposed in the wrongful death suit.

But lawyers for Jackson's mother, Katherine, and her three children called off their jailhouse visit because Murray swore "he would not answer any questions at the deposition or the trial," Jackson lawyer Kevin Boyle told CNN.

He said the Jackson case would not suffer without his testimony.

AEG's lawyer suggests the Jacksons canceled Murray's deposition because his testimony would "destroy" their case.

"They are not interested in the truth," said the lawyer, Marvin Putnam.

Asserting his 'Fifth Amendment privilege'

The cancellation came after Murray's attorney Valerie Wass sent the Jacksons a sworn statement signed by Murray making it clear he would not answer any questions while his involuntary manslaughter conviction in Michael Jackson's death is being appealed.

"Accordingly, if I am called or ordered to testify at deposition or trial in the Katherine Jackson vs AEG wrongful death case, I will be asserting my Fifth Amendment privilege against self-incrimination and refuse to answer any questions," Murray's declaration said.

Jury selection in the civil trial is set to begin April 2 in a Los Angeles County court.

Prince Jackson, the pop star's oldest son, is expected to testify about his father's last days.

Jacksons: Focus back on AEG

The Jackson lawsuit contends that AEG Live is responsible for Jackson's death because it hired and supervised Dr. Murray, who was administering the surgical anesthetic propofol to Jackson each night for a month to induce sleep as he prepared for a series of concerts organized by AEG Live.

A jury found Dr. Murray guilty of involuntary manslaughter after hearing testimony that he violated medical standards in his treatment of Jackson.

"Dr. Murray's choice to keep quiet puts the focus back on the company -- AEG -- that hired Dr. Murray and agreed to pay him over $1.5 million a year, and provide Murray with a large house and drivers and other perks, to make sure that the company's biggest asset, Michael Jackson, made it to the shows on time, no matter what," Boyle, the Jacksons' lawyer said.

The judge ruled last month that Jackson lawyers could question Murray at the Los Angeles County jail, where he is serving his prison sentence.