A wood retaining wall can be very cost effective.

Wood comes in a wide range of styles and they are cheap and easy to install.