Two bombs were discovered Tuesday inside the bunker where an FBI team rescued a 5-year-old boy from his kidnapper, the agency said.

The FBI said they "disrupted" the two explosive devices. One was in the bunker and another was in the PVC pipe that hostage taker Jimmy Lee Dykes sometimes used to communicate with the authorities, Special Agent in Charge Steve Richardson said in a written statement.

The agency sent in a hostage rescue team after negotiations broke down with Dykes, who apparently had bombs in the bunker and shot at agents when they stormed the bunker.

The search for other bombs will continue Wednesday, Richardson said.

Dykes had held a 5-year-old named Ethan since abducting him from his school bus.

Ethan's mother said she awoke Tuesday to what she will forever remember as "the most beautiful sight ... my sweet boy."

For almost a week, Ethan, had been held by Dykes until an FBI team rescued him Monday afternoon.

Mother and child were reunited at a hospital.

"I can't describe how incredible it is to hold him again," the mother, who has not been publicly named, said in a written statement. "Ethan is safe and back in my arms, and I owe it all to some of the most compassionate people on Earth."

Ethan was released from the hospital Tuesday afternoon, Alabama state trooper Kevin Cook said.

Dozens of people attended a prayer vigil for Ethan on Tuesday night and signed a huge birthday card for the boy, who turns 6 on Wednesday.

Tough negotiations

A law enforcement source told CNN that Dykes was contentious with authorities from the beginning of the nearly weeklong standoff, but the conversations deteriorated rapidly toward the end.

The source said investigators talked with Dykes on the phone, exploring several strategies to resolve the situation, without success.

"The team kept going back to the same place -- that they had to go in and get Ethan," the source said.

They knew the rescue might be difficult.

"Dykes built this bunker specifically for law enforcement not to get in and him to not get out," the source said.

Dykes had reinforced the bunker to prevent others from getting in, Richardson said.

Law enforcement officers were able to see what was going on inside the underground bunker where the child was held hostage with a camera they slipped into the hideout, a law enforcement official said.

FBI sources said surveillance drones constantly monitored the situation.