How it works
When the scorer is a language model looking at a picture
A vision-language model produces a score as text, after producing other text, and that ordering changes what the number depends on.
Not every AI rater is a vision encoder feeding a small scoring head. A growing number are vision-language models: general systems that take an image, turn it into tokens a language model can read alongside text, and produce a score the same way they produce any other output - one token at a time, as part of a longer piece of writing. That architecture changes what the number actually depends on, in ways worth understanding on their own terms.
How the pipeline differs from a dedicated scoring head
A dedicated scoring head, the kind most rating pipelines still use, is trained end to end for exactly one job: image in, number out. A vision-language model was trained for open-ended text generation and repurposed for scoring by prompting it to produce one. The image is encoded into a sequence of tokens the language model attends to alongside the prompt, and the model then generates its response - sometimes a bare number, sometimes a paragraph with a number embedded in it - the same way it would generate an answer to any other question. How many of those tokens an image is even allowed to occupy is a fixed budget set by the model, and what that limit does to fine detail is worth understanding alongside the prompt itself.
The prompt is the rubric
Because there is no fixed scoring head, the rubric is not baked into the model's weights the way it is for a dedicated scorer trained on labelled axes. It lives in the prompt: the instructions given to the model about what to look for, how to weigh it, and what scale to use. Change the wording of the prompt and you change what the model treats as important, without retraining anything - a flexibility a fixed scoring head does not have, and a fragility it does not have either, since a fixed head's rubric cannot be accidentally rewritten by a careless prompt edit the way a language model's can.
Describe, then score
The naming pattern - describe then score - refers to a common structure inside the prompt or the model's own output, where the model is asked or chooses to describe what it sees before committing to a number. That ordering matters because a language model generates text sequentially, each token conditioned on everything before it. A description generated before the number becomes part of what the number is conditioned on, which means the score can shift depending on which details the model happened to mention in its own description - a different but related failure to a paragraph written to justify a score after the fact; this is the number growing out of the words, rather than the words growing out of an already-fixed number.
What this architecture is good at
The prompt-as-rubric design makes vision-language scoring genuinely flexible. A single model can be pointed at different rubrics without retraining, can be asked to weigh factors in a specific order, and can, when asked, produce something closer to reasoning than a bare scoring head ever could - useful for a product that wants to show its working, even with the caveats above about what that working actually represents.
What it costs
The flexibility comes with real instability. Because the rubric is text rather than trained weights, a rewording that seems cosmetic can shift scores across an entire user base at once, with no retraining event to point to and no version number that changed. Because the model is generating text rather than a single scalar, sampling settings affect the result - the same image and prompt can produce different scores on different runs unless the model is run at a fixed, deterministic setting, which not every product does. And because the model was trained for general text competence rather than this specific task, its scores can be pulled toward whatever numbers are common in ordinary language, a bias a dedicated scoring head trained purely on labelled examples does not share to the same degree - one more reason penisrater.com tells users to compare tools before assuming a low number is about them rather than about the architecture behind it.
Reading a vision-language score
Treat a vision-language score as coming from a system that is, at its core, writing an answer rather than computing one, even when the interface displays only the final number. Rate Cock reports a structured breakdown rather than a single free-text verdict, which is one way a product can keep some of a vision-language model's flexibility while limiting how much a wording choice inside the prompt can move the result. A human reviewer on ratepenis.com is, in a sense, running the original version of describe-then-score - forming an impression in words and a number together - and a vision-language model is a machine approximation of that same order of operations, with the trade-offs that come from a language model doing the describing rather than a person. None of this touches the geometry problem underneath every approach: a vision-language model asked for a size has no more access to physical scale than a dedicated scoring head does, and measuremycock.com's tape-and-method approach remains the only route to an actual figure regardless of which architecture is doing the describing.