When Japanese people invite others to their homes, many of them offer their guests hospitality of a level which may even be considered extravagant. It is advised that you bring a small gift to show your gratitude. Preferably something from your home country. If it is not possible, something like cake or drinks are fine. This is a kind of Japanese custom.
When you give the present. If you say old day humble expression, “Tsumaranai mono desu ga..(This is something not valuable.. but please),” the host will smile and be impressed by your wisdom.
Nowadays, the custom has been westernized, people would say, “This is very good, I’m sure you love it.”