You’re referring to Direct Traffic. Google uses over 200 signals to determine search ranking. Traffic or visits is not a primary factor, though it’s probably somewhere on the list.
The most important ranking factors are **relevance** (how relevant the content on your website is to what the person searched for), **authority** (how reliable and credible you are as a resource, generally determined by the number of sites link to your site or page), **engagement** (how long people stay on your site or engage with the content once they get to your page), and **overall** **experience** (load speed, page design, site UX).
Traffic numbers are too easy to “game”, so Google probably doesn’t use that as a key factor.