I would like to know the latin translation of the latin proverb "let
us go, where fate directs us"

How about "imus ad fatum" which would be "we go to [our divine]
destiny." I use fatum because of the divine aspect rather than
fortuna, which includes aspects of luck, or fatalis, which tends to
mean a bad ending. Either of these words could be substituted, I
suppose.

Imus is pronounced "EE-muss" to rhyme with tea puss. Fatum has the a
sound that father has (if memory serves).

Quo fata ferunt, meaning "where the fates bear us," is the national
motto of Bermuda.

The latin you are thinking of is a quotation from Vergil's Aeneid,
Book 5.709: I add the following line as well. The context is as
follows: Aeneas and his Trojans have landed in Sicily after lots of
wanderings. The wives of the Trojans have just burnt the Trojan ships
(they are fed up with all the travelling they have been doing), and
Aeneas is feeling dejected. His wondering whether to stay in Sicily,
forgetgul of his fate (which is to bring the Trojans to Italy), or
push on with his mission. He receives some advice from a seer named
Nautes, who says:

nate dea, quo fata trahunt retrahuntque sequamur
quidquid erit, superanda omnis fortuna ferendo est.

"son of a goddess (Aeneas' mother was Venus), let us follow where the
fates take us or take us back: whatever will be, every (mis-)fortune
can be overcome through endurance"