Read signals over time · 12 min read · Updated 24 Sep 2026

Use These Prompts to Analyse Competitor Changelogs

A changelog is a publication decision before it is an engineering record. Somebody chose which work got an entry and how it was described. These prompts read a period of releases for where the effort went, and hold the model to what the entries say rather than to the plan they imply.

A competitor's changelog looks like a timeline and is not one

A changelog is the friendliest competitor source there is. Everything is already in order, everything has a date, and nothing has to be interpreted. That is exactly what makes it easy to over-read.

Start with the dates, because they are doing more than one job. On the developer changelog we used for the run below, most entries are stamped with the day the change was announced. A few are stamped with the day it went live. Both sit in the same column, in the same format. An entry announced in August and one that shipped in August are a month or more apart in reality.

The second thing to hold on to is who wrote the entry. Somebody decided this piece of work was worth telling customers about, and wrote it in words chosen for customers. Plenty of engineering never gets an entry at all. A changelog is a record of what was published, and that is a narrower thing than a record of what was built.

What the date beside a changelog entry can mean, and what each kind supports
The dateWhat it marksWhat you can say with it
AnnouncedThe day the change was made public. The work may already be done, or may be months off.When they told people. Useful for cadence of communication, not of shipping.
LiveThe day the change took effect for customers.When it actually landed. The only date that supports a claim about a release period.
Effective fromA future date attached to a withdrawal or a breaking change.A scheduled moment when a known set of their customers has to do something.
NoneA marketing page organised by campaign or season rather than by time.Nothing about a period. The entries are real; the timeline is not there to read.

The check that takes ten seconds and saves the analysis

Before you paste anything, look at two entries and ask whether their dates mean the same thing. If one says announced and the other says live, you are holding two measures. Say so in the brief, or every date range in the output is the sum of two different clocks.

Prompts to read a competitor's release period

Three passes. The first reads the period, the second splits a stream that is carrying two opposite things, and the third only works once you have a second capture to compare against.

The first pass over a period, once every entry has a date on it.

Here are the changelog entries for [COMPETITOR] between [START] and [END]: [PASTE]. Group them into themes and, for each theme, give the number of entries, the date range, and whether the entries are launches, improvements or maintenance. Then answer: where is their engineering effort concentrated, and what did they NOT ship in this period that the themes would predict? Two rules. Judge investment by the substance of entries, not by their count, since a vendor can post ten small fixes and one platform change in the same week. And do not infer a roadmap: say what the period shows, and say plainly where the pattern is too short to read.

Straight after the first pass, because one stream is carrying two opposite events.

Here are [COMPETITOR]'s changelog entries for [START] to [END]: [PASTE]. Sort every entry into exactly one of: added (something that did not exist before), changed (something that worked differently afterwards), or withdrawn (something taken away, deprecated, sunset or made unsupported). Report the withdrawn list on its own, with the date of the entry and any date it says the change takes effect. Quote the entry title for each. Then say what share of the period's entries are withdrawals, and name any product area where withdrawals outnumber additions. Where an entry does both, put it in withdrawn and say what it added.

Once you have a second capture far enough back that a change in rhythm would show.

Here are two sets of changelog entries for [COMPETITOR]. Set A covers [PERIOD A] and set B covers [PERIOD B]: [PASTE]. Do not summarise either set. Compare them, and answer only these: - which themes appear in both, and did the share of entries rise or fall - which themes appear in B and not in A - which themes appear in A and not in B, which is the half people forget to ask for - did the number of entries per month change, and by how much Give the counts you used for every claim. Where a theme name would have to be stretched to cover entries in both sets, keep them apart and say so.

Notice what the first one forbids. It may not infer a roadmap, and it has to say where the period is too short to read. Both rules are there because the opposite is the default behaviour, and the section below shows what that looks like.

What a changelog analysis needs besides the entries

Three inputs, and the third is the one nobody has. A period only means something against another period, and a model has no memory of what the same changelog looked like in spring.

The entries for a stated period, each carrying its own date

Where it comes from
The dated record rather than the announcement. Where a vendor keeps a changelog, and what each surface is worth, is covered under tracking a competitor roadmap.
What good looks like
Every entry as published, in its own words, with the date beside it, copied from a surface that dates things.
Without it
The period gets set by the sentence you typed above the paste. Themes then span whatever the entries happen to cover, and nothing in the output says so.

The name of the surface each batch of entries came from

Where it comes from
One line you write. Most vendors publish three or four changelogs: a developer log, a release-notes blog, a customer what's-new page, and an app store version history.
What good looks like
One named surface per batch, so a claim about a period is a claim about a record somebody can open and count.
Without it
A marketing round-up and a release log get counted as one list, and only one of the two dates its entries.

An earlier period of the same record

Where it comes from
Your own previous capture, or an archived copy of the same changelog page.
What good looks like
The same surface, a period of the same length, far enough back that a change in cadence would be visible rather than noise.
Without it
Concentration has nothing to be concentrated against, so any theme appearing twice reads as a focus.
Then run it
Dates first. Paste the entries with their dates attached, then name the surface they came from, then ask the question.
Before the output leaves the building
Open the changelog beside the output and check that every theme names entries you can point at, and that no claim reaches past the oldest date in your paste.

Copy the entries rather than summarising them. A one-line summary of a release note has already thrown away the vocabulary, and the vocabulary is where a theme is visible. Two entries that both say “agent” are a pattern. The same two, summarised as “automation improvements”, are not.

The sentence where a competitor's changelog becomes a roadmap

We pasted the ten entries showing on a real developer changelog, with their dates, and asked two questions about them. Both answers are good. One sentence in each is not supported by anything on the page.

Ten entries from HubSpot's public developer changelog, read on 24 September 2026 and checked against the page they came from.

Claude Opus 5given the ten entries showing on the competitor's developer changelog, with their dates and status labels, and asked for themes with a count and a date range

2026-09-24

Platform deprecations and sunsets (4 entries, 12 Aug - 15 Sep 2026), maintenance: legacy APIs going unsupported, legacy private app creation disabled, the Pipelines API V1 sunset, and Node 18.x and 20.x runtimes deprecated. API validation enforcement (2 entries, 11 Aug - 8 Sep 2026), maintenance: CRM API write validation and pipeline delete endpoint reference checks, both arriving with the 2026-09 API version. Periodic rollups (3 entries, 29 Jun - 31 Jul 2026), improvements: the June developer updates and the July and August rollups. Seasonal release (1 entry, 15 Sep 2026), launch: the Fall 2026 Spotlight developer and builder updates.

Checked against HubSpot's developer changelog

Every entry is real and every grouping is one a person would defend. The date ranges are not defensible. Seven of the ten dates mark the day something was announced and three mark the day it went live, and the output adds them together. The entry titled "August 2026 Rollup" carries 31 July, so it lands in a range that ends a month before the work it describes.

Conflation

Claude Opus 5given the same ten entries and asked where engineering effort is concentrated, and what the themes would predict they did not ship

2026-09-24

Effort in this period sits on the developer platform rather than on features: retiring legacy surfaces, enforcing stricter API validation, and moving custom code onto supported runtimes. The pattern reads as a deliberate narrowing of the supported surface area ahead of the Fall 2026 Spotlight, which is the only entry here announcing new capability. Given that direction, what is absent is migration tooling. A vendor retiring four surfaces in five weeks would usually ship something to carry customers across, and no entry in this period does.

Checked against HubSpot's developer changelog

The first sentence is supported by the entries. The second is not. Nothing on the page connects the deprecations to the Spotlight release, and the entries were published weeks apart. The absence claim is the weakest of the three. Those ten entries are page one of a paginated log. What is missing from a sample is not missing from the record.

Over-inference

A date range built from two kinds of date

The themes in the first answer are fair. Every entry is real and every grouping is one a person would defend. The date ranges beside them are not fair, and they are the part that would travel into a report.

Seven of those ten dates mark an announcement. Three mark the day something went live. Adding them produces a range that describes neither. The entry titled August 2026 Rollup sits under 31 July, so a range ending in July contains a month of work that had not happened yet.

Concentration needs something to compare against

The second answer says effort is concentrated on the platform. Concentrated compared with what? There is no earlier period in the context window, so the claim is really a description of the only period the model can see. A vendor who always spends six entries in ten on platform work looks identical to one who has just started.

The closing line is the one to watch. A period with no migration tooling in it is an observation about ten entries on page one of a paginated log. Absence from a sample is not absence from the record, and the answer does not distinguish the two. That is why the prompt asks for the counts behind every claim: a claim with a denominator attached can be argued with.

One changelog stream carries two opposite events

Six of the ten entries take something away. They retire an API, disable a way of building apps, drop support for two runtimes, or tighten a rule so that code which used to work stops working. The other four add or describe something new.

Both kinds sit in one list, in one typeface, with nothing separating them. A theme count run over the whole stream mixes them, and the mixture is what produces a sentence like “heavy investment in the platform”. Retiring things and building things are both platform work. They are not the same signal.

The withdrawals are worth pulling out for a reason that has nothing to do with tidiness. A withdrawal names a date on which a known set of their customers has to do unplanned work. Very little else in a competitor’s public record comes with a scheduled moment attached, and a scheduled moment is something a sales team can plan around. A weekly competitor digest that carries one line about a sunset date three months out is more useful than the same digest listing five new features.

The same split is worth keeping when the output lands somewhere permanent. A competitor tracking sheet with one column for what was added and another for what was withdrawn answers a question a single feed of entries cannot: whether their product is getting broader or narrower.

How to monitor a competitor changelog automatically

The reading you have just done covers whatever was on the page the day you copied it. Changelogs are paginated and older entries drop off the first screen. A quarter from now, the period you analysed will be two clicks deep and the entries around it will have changed.

That matters more here than for most sources, because the value of a changelog is almost entirely in the comparison. One period tells you what a team was working on. Two periods tell you whether that changed, which is the only version of the question anybody acts on. Keeping the first capture is what makes the second one worth running.

There is also a gap no reading closes. A changelog says what shipped. It does not say what it cost them, whether customers adopted it, or what was cancelled before it got an entry. Those are the questions a release log is structurally unable to answer, and no prompt recovers them.

Flares watches competitor changelogs and release notes as they publish, and keeps each entry with the date it appeared. The period you sit down to analyse is then already assembled, including the entries that have since scrolled off the first page.

Every competitor release, dated as it ships

Flares records what each competitor ships and when, so a release period is already assembled when you sit down.

Discover Flares

14-day free trial · 30-second setup

Reading a competitor's changelog FAQ

Can ChatGPT analyse a competitor's changelog?

Reading and grouping a set of entries is work a model does well, and it is faster than any person at it. What it cannot do is fetch the entries or know what was published after its training data ends. Paste the period yourself, dates attached, and the job becomes the one a model is actually good at.

What does a competitor's changelog actually tell you?

Which parts of the product got attention in a period, in the words of the people who shipped it. A changelog is evidence of work completed and published. That is a narrower claim than it looks. Entries get written by somebody deciding what is worth telling customers about, and plenty of engineering never reaches one.

How far back should a changelog analysis go?

Far enough that the period is long enough to have a shape, and short enough that the product has not been reorganised inside it. A quarter works for most software. Whatever you pick, use the same length next time, because a three-month period and a six-month period produce theme counts nobody can compare.

Does the number of changelog entries show how fast a competitor ships?

Entry count measures how often somebody writes an entry. A team that posts every bug fix and a team that posts one note per release can do identical work and produce a tenfold difference in the count. Judge by what the entries describe, and treat the count as a fact about their publishing habit.

Can you predict a competitor's roadmap from their changelog?

Nothing in a changelog is forward-looking except the dates it gives for changes already decided. A release period tells you what has shipped, which is a record of the past. Some vendors do publish intent, on a public roadmap or in a filing. Read those as their own document. Do not infer them from release notes.

Why do some vendors' product update pages have no dates?

Marketing pages are organised by campaign rather than by time, so entries sit under a season or a launch name instead of a date. A page like that cannot support any claim about a period, however complete it looks. The dated record is usually a developer changelog or a release-notes blog, and those are the ones to paste.

What should you do with a competitor's deprecation notice?

Read it as the one entry with a customer on the other side of it. A withdrawal forces somebody to do work they did not plan. The date it takes effect is a day when a known set of their customers is annoyed and paying attention. Almost nothing else in a competitor's public record comes with a scheduled moment like that.

How often should a competitive team read a competitor's changelog?

Monthly is enough for the reading, because the analysis needs a period to be about. Watching is a different job and should be continuous, since a single entry occasionally matters the day it appears. Doing the reading quarterly and the watching never is the combination that produces surprises.

How do you compare two competitors' changelogs fairly?

Only within the same product area, and never by count. Two vendors with different publishing habits produce different numbers for the same amount of work. The comparable unit is what got attention, not how many lines were written about it. Where the question is really about a specific gap, a feature comparison built from documentation answers it better than two release logs will.

Read a release period you did not assemble

Flares watches competitor changelogs continuously, so your period is complete rather than whatever got saved.

Discover Flares

14-day free trial · 30-second setup