Reminds me of an early application of AI where scientists were training an AI to tell the difference between a wolf and a dog. It got really good at it in the training data, but it wasn’t working correctly in actual application. So they got the AI to give them a heatmap of which pixels it was using more than any other to determine if a canine is a dog or a wolf and they discovered that the AI wasn’t even looking at the animal, it was looking at the surrounding environment. If there was snow on the ground, it said “wolf”, otherwise it said “dog”.
East is sunrise. West is sunset. The sun will also always be slightly south and even more so in the winter (unless you’re in the southern hemisphere then it’s slightly north).
If your local area has some kind of landmark like a big tower, or a big lake, learn where that is relative to you and use it as a reference point. For me, I live near a big lake and it’s always south of me. It might be easier for you to ask yourself “which way is the lake?” instead of “which way is south?” or whatever your landmark and direction happen to be.