Hailemariam has faced nationwide protests following his government's harsh crackdown on dissent and opposition. The academic-turned-politician has led Ethiopia since 2012 following the death of former strongman Meles Zenawi.
"Unrest and a political crisis have led to the loss of lives and displacement of many," Hailemariam said in a televised address to the nation.
"I see my resignation as vital in the bid to carry out reforms that would lead to sustainable peace and democracy."
Read more: Ethiopia: Crisis in the land of economic miracle
Violent protestsHundreds of people have died in violence sparked initially by an urban development plan for the capital, Addis Ababa, in 2015. The unrest spread the following year with protests against political restrictions.
The government responded by declaring a state of emergency, granting itself special powers, including the right to deploy the army.
Though the worst of the violence was quelled, periodic demonstrations continued.
In a bid to ease tensions, the government beganreleasing political prisoners last month after Hailemariam said charges against them would be dropped to "create a national consensus and widen the democratic space for all."
The 53-year-old prime minister will continue in his role until the "power transition is completed," the state-affiliated Fana Broadcasting Corporate reported.
The ruling coalition has accepted Hailemariam's resignation, Reuters news agency reported, citing state-affiliated outlets.
ap/kms (Reuters, AP)
Each evening at 1830 UTC, DW's editors send out a selection of the day's hard news and quality feature journalism. You can sign up to receive it directly here.