We gave one meeting to four AI note-takers. Two knew who had to do what
A three-minute meeting with seven tasks, a changed launch date, a misleading joke and a few lines in Ukrainian. Every tool caught the decisions. Fireflies left four tasks without an owner. MeetGeek gave five tasks to someone who wasn't in the meeting.

In short
- We wrote a meeting with a known answer: 3 decisions, 7 tasks, 9 facts and a few traps. Two synthetic voices read it, and four tools wrote the minutes. Tested on 17 November 2026.
- Everyone found the decisions and the moved launch date. None turned the coffee-machine joke into a task.
- The real difference was who does what. Notuly and Gemini gave all 7 tasks to the right person with the right date. Fireflies left 4 tasks unassigned. MeetGeek gave 5 to the name on our account, someone who wasn't in the meeting.
- Only Notuly understood the Ukrainian lines. Fireflies and MeetGeek turned them into nonsense in Latin letters; the task survived only because it was repeated in English.
- Notuly records only, it can't take a file. Gemini takes a file, but can't record. Fireflies hid its free plan behind a card-required trial screen.
An AI note-taker has one job: after the call, tell you what was decided and who promised what by when. A summary that sounds right but puts the wrong name on a task is worse than no summary. Someone will trust it.
So we wrote a meeting where we knew every right answer, and gave it to four tools.
How we tested
The meeting. Anna, a project lead, and Mark, from marketing, run a three-minute weekly check-in about a product launch. We wrote the script and planted everything a note-taker should catch, and a few things it should not:
- 3 decisions. The launch moves from Tuesday 24 to Thursday 26 November, 10:00 Vienna time. The price is €19 a month and €190 a year. The extra ad budget is not decided: they will decide on 1 December.
- 7 tasks, each with an owner and a date. Mark tells the agency, updates the website by Friday, sends the contract tomorrow, drafts the launch email by Monday, and calls a new client on Wednesday. Anna reviews the email and checks the payment page.
- 9 facts: prices, subscriber numbers, an open rate, a budget, and a Polish surname, Kowalczyk.
- Traps. A joke about a coffee machine (“somebody should write a song about it”), a podcast idea for “maybe next year”, and a short exchange in Ukrainian, repeated in English afterwards.
The voices. Two synthetic voices read the script, with faint room noise added. That is the easy case: perfect diction, nobody talking over anybody. A real meeting is harder, so treat these results as the best a tool can do.
The tools.
- Notuly, a Dutch note-taker, recorded the meeting from the computer’s sound. Its app can’t take a file.
- Fireflies and MeetGeek got the audio file as an upload, on free plans.
- Gemini got the same file in the ordinary Gemini app, with one prompt: “Write meeting minutes: decisions, action items with owner and due date, open questions.” It ran on the app’s default model, 4 Hydrogen.
We scored every result against our answer key.
The results
| Notuly | Gemini | Fireflies | MeetGeek | |
|---|---|---|---|---|
| Decisions (of 3) | 3 | 3, plus the podcast as a fourth | 3 | 3 |
| Tasks found (of 7) | 7 | 7 | 7 | 7 |
| Right owner and date (of 7) | 7 | 7 | 3 (4 unassigned) | 2 (5 to the wrong person) |
| Facts (of 9) | 9 | 7 | 8 | 8 |
| Launch date correction | ✓ | ✓ | ✓ | ✓ |
| Coffee machine as a task | no | no | no | no |
| Ukrainian lines | ✓ transcribed | can’t tell | ✗ nonsense | ✗ nonsense |
| Speakers in the transcript | Anna, Mark | no transcript | Speaker 1, Speaker 2 | no labels |
| Time to the summary | about 1 minute | under 1 minute | about 1 minute | about 3 minutes |
Everyone got the easy part
All four found both real decisions and the moved launch date. None reported the old Tuesday as the launch. All four kept the ad budget open, with the 1 December date. Nobody turned the coffee machine into a task.
That alone is progress. A year ago, “maybe one day” regularly became an action item.
The hard part: who does what
This is where the tools split.
Notuly got every task right: owner, date, and the note that Anna wants a copy of the contract email. Its transcript named both speakers from the conversation, and it was the only tool that understood the Ukrainian lines. It left one thing undone: “tomorrow” stayed “tomorrow”, not 18 November.
Gemini matched it on tasks and did the dates better. It turned “tomorrow” into Wednesday 18 November and gave 1 December its weekday. But it listed the podcast idea under “Decisions made”. Nobody decided anything about a podcast. It also left out two facts, the €24 price that tested worse and the 38% open rate.
Fireflies found every task, but four of Mark’s five went into an “Unassigned” list. Nothing went to a wrong person, so this is the safer kind of mistake: you can see what’s missing. Its transcript was clean and had timestamps, but called the speakers Speaker 1 and Speaker 2.
MeetGeek made the mistake we’d least want to see in a real office. Anna’s name doesn’t appear in its report at all. Her tasks, and three of Mark’s, went to the name on the MeetGeek account we uploaded from: a person who wasn’t in the meeting. One line reads that this person “will send the contract tomorrow and be copied”. MeetGeek also spelled the client “Kolachuk”, and its transcript opens with lines nobody said, including “Hi, I’m MeetGeeks AI product specialist.” Its useful idea: every point links to the exact sentence and second in the recording, so you can check it.
The Ukrainian test
Many European meetings switch language for a minute. Ours did, for three lines in Ukrainian: Anna asks if Mark speaks Ukrainian, Mark says he can call the new client from Kyiv on Wednesday.
Notuly wrote the lines in Ukrainian, with two small slips, and turned them into an English task. Fireflies squeezed all three lines into one line of nonsense in Latin letters and lost Mark’s reply. MeetGeek produced something that looks like Croatian. Both still got the task, only because Anna repeated it in English. In a real meeting, nobody repeats it.
Getting in
Notuly runs as a desktop or phone app that records the meeting itself. There is no file upload, so you can’t send it an old recording. The report arrives by email, in English or Dutch, with the transcript attached. The app keeps no history.
Gemini is the opposite: it takes a file, but it doesn’t sit in your meeting. You need the recording first.
Fireflies sent us straight from sign-up to a “7 days free trial” of its Business plan, card required, $29 a month afterwards. Neither screen had a skip button. Typing the app’s address by hand got us to the free plan, with a counter showing 3 free meetings.
MeetGeek let us upload on the free plan without any detour.
What it costs
| Free | Cheapest paid | Data | |
|---|---|---|---|
| Notuly | 3 meetings a month, up to 60 minutes each | Pro €9.99 a month billed yearly, €13.49 monthly, VAT included | processed in Amsterdam; audio deleted after processing; data processing agreement from the Team plan (€10.99 per user, two or more) |
| Fireflies | transcription, limited summaries, 400 minutes of storage | Pro $10 a month billed yearly, $18 monthly | no training on your meetings; EU storage not offered on the pricing page |
| MeetGeek | 3 hours a month, uploads allowed | Pro $9.99 a month billed yearly, $15.99 monthly | choose EU or US storage |
| Gemini | the Gemini app; limits depend on your Google plan | Google AI plans | under your Google account’s settings |
If you use Gemini on a personal account for work meetings, check your Gemini activity settings first. A work recording is other people’s data.
What this means for you
- Check the names on every task. It was the most common mistake in our test, even on perfect audio.
- “Unassigned” is better than wrong. Fireflies showed what it didn’t know. MeetGeek guessed, and guessed someone who wasn’t there.
- If your meetings mix languages, test that first. Only one tool of four understood our Ukrainian.
- Already have a recording? Gemini does a good job with a clear prompt. It won’t record for you, and it may promote an idea into a decision.
- Tell people you are recording. Our guide to AI note-takers covers the rules.
How we’re paid: Notuly gave us a free Pro account until 30 November. We used it for this test; the free plan would have covered it. We have no affiliate deal with Notuly, Fireflies, MeetGeek or Google.
Tested on 17 November 2026, with one scripted three-minute meeting and two synthetic voices. Real meetings, with people talking over each other, are harder; results may differ. Seen something different? Tell us in the comments.
Sources
More guides
- AI presentation tools compared: Gamma, Beautiful.ai, Copilot, Gemini and Canva
- AI meeting note-takers compared: Otter, Fireflies, Fathom, Granola, MeetGeek, Notuly and the built-ins
- We gave four AI slide makers the same document. Two of them made up the numbers
- AI audio tools compared: voice, clean-up, editing and music
- We cleaned one noisy 35-minute recording with Diffio and Adobe. Background voices decided it
- AI video tools compared: generators, presenters and editors
- AI data analysis tools compared: from spreadsheets to big data
- AI image tools compared: ChatGPT, Gemini, Midjourney, Firefly, Ideogram, Canva and more
Comments
What do you think? No account needed. Please be kind; comments that attack people are removed.
No comments yet. Be the first.