Well, I did as much as you (all side quests apart from fishing), and I beat the game in a little less than 50 hours. So I guess you can definitely blame the learning curve
(and I must be used to the genre, although the game in itself is pretty easy to go through)