Hi, yes - it's possible. But you have to use custom class name for menu item and inside Custom CSS define that class name by adding a image etc.

This method works for all templates also for Protostar etc.

Tip! The content property may be very useful in your case.

.icon-here::before {
  content: url(menu-icon.png);
}

whole rest is on your hands, I hope.