Noah was in his own tent.

There was no reason for Canaan to be there.

Only Noah and Canaan know what really happened.

The Curse was prophetic since the Canaanites did not come under the Israelites for another 5 or 600 years or more after that incident. The Israelites were slaves in Egypt for a long time before they went into the promised land where the Canaanites were living