Defense Minister Elias Murr has pledged to change the makeup of the security apparatus in Lebanon, a day after twin bus bombings left three people killed.

"I assure the Lebanese that we will be changing the structure of the security apparatus in the country … as the current security status of the country can't go on like this," Murr told reporters after a late night meeting on Wednesday with U.S. Ambassador Jeffrey Feltman.

"Innocent people are now paying the price," Murr said. "I will personally oversee and look after the restructuring of the security apparatus … and how it should be employed to serve the citizen," Murr added.

He said that he will be working in his capacity as deputy prime minister and not as defense minister.

"When I was interior minister we had 3,000 policemen and citizens would safely return home," Murr said.

"Now we have 60,000 (Lebanese) army soldiers and a 20,000-strong security force, and people cannot travel or ride vans," Murr said in reference to the twin bombings that targeted two commuting minibuses in the town of Ain Alaq northeast of Beirut on Tuesday, killing three people and wounding 23 others.

He said the blasts were a "message to every Lebanese who wants a free, sovereign country."