Model sensitivity: GPT-5.6 → GPT-6

On 15 October we moved our ChatGPT measurement from GPT-5.6 Luna to GPT-6 Luna, the model free ChatGPT users have had since 8 October. The answers changed a lot: half as long, 40% fewer businesses named, more searching. The visibility score barely moved.

By Gullik Vetvik Killie,

The answers changed

Measured

We compared the six nights before the switch (8 to 13 October) with the first three after (15 to 17 October): around 5,800 ChatGPT answers, about 4,000 before and 1,800 after.

ChatGPT answers on GPT-5.6 Luna and GPT-6 Luna
Per ChatGPT answerGPT-5.6 LunaGPT-6 Luna
Answer length (characters)2,7041,397
Businesses named per answer6.23.7
Answers that searched the web87%94%
Search queries per answer3.33.7

GPT-6 Luna gives shorter answers that name fewer businesses, so each answer has fewer slots, and it searches more to decide who fills them.

Visibility stayed quite stable

Measured

Fewer slots could have pushed many businesses out of the answers. On average they did not. Share of answers that name the business we track for each site:

Share of answers naming the tracked business per engine, before and after
EngineModel6 nights before3 nights after
ChatGPTGPT-5.6 Luna → GPT-6 Luna32.3%31.9%
Geminiunchanged39.4%43.5%
Copilotunchanged37.0%38.7%

Gemini and Copilot kept their models and drifted up a little over the same nights, so ChatGPT trails them slightly. Per site, the average move on ChatGPT was 4 points, about what Gemini and Copilot move with no change at all. Only one site moved 10 points or more. A hint to watch: four of the five sites ChatGPT named most often lost 5 to 7 points, which fits fewer slots per answer, but three nights is too early to call it. The flip side: a business that is still named now shares the answer with about three others instead of five, so each mention is worth more.

So a model change shows up as a step in the trend, not a verdict on your work. We mark it on the timeline, and we read our own changes against an engine whose model stayed the same.

Three nights so far, measured through OpenAI's API rather than the ChatGPT app. Claude changed model the same day, so it is left out here.

The Sensitivity series asks how much the measuring setup moves an AI visibility number: the model, the surface and the prompts. More experiments on our own site are under How we work with our AI visibility.