I recall him explaining that some events are meant to happen, fixed events that cannot change, and everything else is in a flux. I can't remember the exact episode. So I suppose changing that man's childhood isn't very wrong, in the grand scheme of it all. He does seem to respect the time lines, so I suppose Janeway is still going to make Braxton more angry