AI Beat

GuideAI toolsTech

We gave one meeting to four AI note-takers. Two knew who had to do what

A three-minute meeting with seven tasks, a changed launch date, a misleading joke and a few lines in Ukrainian. Every tool caught the decisions. Fireflies left four tasks without an owner. MeetGeek gave five tasks to someone who wasn't in the meeting.

Scorecard: Notuly and Gemini gave all seven tasks to the right person with the right date, Fireflies three, MeetGeek two
Image: AI Beat test, our own scorecard

In short

  • We wrote a meeting with a known answer: 3 decisions, 7 tasks, 9 facts and a few traps. Two synthetic voices read it, and four tools wrote the minutes. Tested on 17 November 2026.
  • Everyone found the decisions and the moved launch date. None turned the coffee-machine joke into a task.
  • The real difference was who does what. Notuly and Gemini gave all 7 tasks to the right person with the right date. Fireflies left 4 tasks unassigned. MeetGeek gave 5 to the name on our account, someone who wasn't in the meeting.
  • Only Notuly understood the Ukrainian lines. Fireflies and MeetGeek turned them into nonsense in Latin letters; the task survived only because it was repeated in English.
  • Notuly records only, it can't take a file. Gemini takes a file, but can't record. Fireflies hid its free plan behind a card-required trial screen.

An AI note-taker has one job: after the call, tell you what was decided and who promised what by when. A summary that sounds right but puts the wrong name on a task is worse than no summary. Someone will trust it.

So we wrote a meeting where we knew every right answer, and gave it to four tools.

How we tested

The meeting. Anna, a project lead, and Mark, from marketing, run a three-minute weekly check-in about a product launch. We wrote the script and planted everything a note-taker should catch, and a few things it should not:

  • 3 decisions. The launch moves from Tuesday 24 to Thursday 26 November, 10:00 Vienna time. The price is €19 a month and €190 a year. The extra ad budget is not decided: they will decide on 1 December.
  • 7 tasks, each with an owner and a date. Mark tells the agency, updates the website by Friday, sends the contract tomorrow, drafts the launch email by Monday, and calls a new client on Wednesday. Anna reviews the email and checks the payment page.
  • 9 facts: prices, subscriber numbers, an open rate, a budget, and a Polish surname, Kowalczyk.
  • Traps. A joke about a coffee machine (“somebody should write a song about it”), a podcast idea for “maybe next year”, and a short exchange in Ukrainian, repeated in English afterwards.

The voices. Two synthetic voices read the script, with faint room noise added. That is the easy case: perfect diction, nobody talking over anybody. A real meeting is harder, so treat these results as the best a tool can do.

The tools.

  • Notuly, a Dutch note-taker, recorded the meeting from the computer’s sound. Its app can’t take a file.
  • Fireflies and MeetGeek got the audio file as an upload, on free plans.
  • Gemini got the same file in the ordinary Gemini app, with one prompt: “Write meeting minutes: decisions, action items with owner and due date, open questions.” It ran on the app’s default model, 4 Hydrogen.

We scored every result against our answer key.

The results

Scorecard: Notuly and Gemini gave all seven tasks to the right person with the right date, Fireflies three, MeetGeek two. Facts: 9, 7, 8 and 8 of 9
Notuly Gemini Fireflies MeetGeek
Decisions (of 3) 3 3, plus the podcast as a fourth 3 3
Tasks found (of 7) 7 7 7 7
Right owner and date (of 7) 7 7 3 (4 unassigned) 2 (5 to the wrong person)
Facts (of 9) 9 7 8 8
Launch date correction ✓ ✓ ✓ ✓
Coffee machine as a task no no no no
Ukrainian lines ✓ transcribed can’t tell ✗ nonsense ✗ nonsense
Speakers in the transcript Anna, Mark no transcript Speaker 1, Speaker 2 no labels
Time to the summary about 1 minute under 1 minute about 1 minute about 3 minutes

Everyone got the easy part

All four found both real decisions and the moved launch date. None reported the old Tuesday as the launch. All four kept the ad budget open, with the 1 December date. Nobody turned the coffee machine into a task.

That alone is progress. A year ago, “maybe one day” regularly became an action item.

The hard part: who does what

This is where the tools split.

Notuly got every task right: owner, date, and the note that Anna wants a copy of the contract email. Its transcript named both speakers from the conversation, and it was the only tool that understood the Ukrainian lines. It left one thing undone: “tomorrow” stayed “tomorrow”, not 18 November.

Gemini matched it on tasks and did the dates better. It turned “tomorrow” into Wednesday 18 November and gave 1 December its weekday. But it listed the podcast idea under “Decisions made”. Nobody decided anything about a podcast. It also left out two facts, the €24 price that tested worse and the 38% open rate.

Fireflies found every task, but four of Mark’s five went into an “Unassigned” list. Nothing went to a wrong person, so this is the safer kind of mistake: you can see what’s missing. Its transcript was clean and had timestamps, but called the speakers Speaker 1 and Speaker 2.

MeetGeek made the mistake we’d least want to see in a real office. Anna’s name doesn’t appear in its report at all. Her tasks, and three of Mark’s, went to the name on the MeetGeek account we uploaded from: a person who wasn’t in the meeting. One line reads that this person “will send the contract tomorrow and be copied”. MeetGeek also spelled the client “Kolachuk”, and its transcript opens with lines nobody said, including “Hi, I’m MeetGeeks AI product specialist.” Its useful idea: every point links to the exact sentence and second in the recording, so you can check it.

The Ukrainian test

Many European meetings switch language for a minute. Ours did, for three lines in Ukrainian: Anna asks if Mark speaks Ukrainian, Mark says he can call the new client from Kyiv on Wednesday.

Notuly wrote the lines in Ukrainian, with two small slips, and turned them into an English task. Fireflies squeezed all three lines into one line of nonsense in Latin letters and lost Mark’s reply. MeetGeek produced something that looks like Croatian. Both still got the task, only because Anna repeated it in English. In a real meeting, nobody repeats it.

Getting in

Notuly runs as a desktop or phone app that records the meeting itself. There is no file upload, so you can’t send it an old recording. The report arrives by email, in English or Dutch, with the transcript attached. The app keeps no history.

Gemini is the opposite: it takes a file, but it doesn’t sit in your meeting. You need the recording first.

Fireflies sent us straight from sign-up to a “7 days free trial” of its Business plan, card required, $29 a month afterwards. Neither screen had a skip button. Typing the app’s address by hand got us to the free plan, with a counter showing 3 free meetings.

MeetGeek let us upload on the free plan without any detour.

What it costs

Free Cheapest paid Data
Notuly 3 meetings a month, up to 60 minutes each Pro €9.99 a month billed yearly, €13.49 monthly, VAT included processed in Amsterdam; audio deleted after processing; data processing agreement from the Team plan (€10.99 per user, two or more)
Fireflies transcription, limited summaries, 400 minutes of storage Pro $10 a month billed yearly, $18 monthly no training on your meetings; EU storage not offered on the pricing page
MeetGeek 3 hours a month, uploads allowed Pro $9.99 a month billed yearly, $15.99 monthly choose EU or US storage
Gemini the Gemini app; limits depend on your Google plan Google AI plans under your Google account’s settings

If you use Gemini on a personal account for work meetings, check your Gemini activity settings first. A work recording is other people’s data.

What this means for you

  1. Check the names on every task. It was the most common mistake in our test, even on perfect audio.
  2. “Unassigned” is better than wrong. Fireflies showed what it didn’t know. MeetGeek guessed, and guessed someone who wasn’t there.
  3. If your meetings mix languages, test that first. Only one tool of four understood our Ukrainian.
  4. Already have a recording? Gemini does a good job with a clear prompt. It won’t record for you, and it may promote an idea into a decision.
  5. Tell people you are recording. Our guide to AI note-takers covers the rules.

How we’re paid: Notuly gave us a free Pro account until 30 November. We used it for this test; the free plan would have covered it. We have no affiliate deal with Notuly, Fireflies, MeetGeek or Google.

Tested on 17 November 2026, with one scripted three-minute meeting and two synthetic voices. Real meetings, with people talking over each other, are harder; results may differ. Seen something different? Tell us in the comments.

Comments

What do you think? No account needed. Please be kind; comments that attack people are removed.

We store only your name and comment. See our privacy policy.

    Sources

    1. AI Beat: AI meeting note-takers compared
    2. Notuly: Plans and privacy (checked 17 November 2026)
    3. Fireflies.ai: Pricing (checked 17 November 2026)
    4. MeetGeek: Pricing (checked 17 November 2026)
    5. Google: Gemini app

    More guides