Okay. This may sound like a simple question, but hear me out.
Are you sure you are going to the right hut?
I just finished the Do-Daga quest, so I went back into the game now to try to access Do-Daga's hut again. And it worked okay.
If you activated the teleport stones in the middle of Hametsu Village, you can use the Green Teleport Stone to get to Do-Daga's hut.
BUT... his hut is NOT the one right next to the green teleport stone.
Do-Daga's hut is in the middle of that same road, and it has the four sigils in front of it.
If you look at your map for Hametsu Village, you can see the picture of a large funny-looking green tree in the bottom left corner of the map. Do-Daga's hut is the one near the head of that tree.