They calculate your ad quality every time their is an impression. I think what they’re trying to communicate is that you can’t just game the system by getting a high quality score and then somehow trick google into displaying shitty ads. Every time there is a potential impression google calculates your ad rank based on those criteria (click through rate, relevance, landing page experience). And for the first times your ad runs, Google is using the decades of search data that they have available.