Can "je viens de" also mean I have just, if the phrase is followed by an infintive of a verb

Yes, such as "je viens de commencer à apprendre le français". Léon

Bonjour Ayush ! Yes indeed, just like Leon demonstrated :) Here is a link to our related lesson: https://french.kwiziq.com/revision/grammar/conjugate-in-le-passe-proche-by-using-venir-de-infinite À bientôt !