Seriously? So this could be what I am looking for indeed!
You can find pet companions lurking near towns and stables, they are usually named,pressing "E" will make them follow you. You can give them different commands and take them on your adventures. By default i think they are set to non-essential so you might want to make them essential.