You might not care for the look of concrete blocks for your retaining wall. But you can use another material that's durable and more visually appealing.
If your retaining wall exceeds a certain height limit, you'll likely need to secure a permit before you start building.