Observability and Evals @Mastra

London
Joined July 2015
Alex Booker retweeted
Builds are back up. Our recommendation now: revoke and rotate keys for any env variables stored on Mastra platform. To reiterate: we have no evidence of impact.
Mastra's platform is hosted on Railway and thus Mastra platform users are affected by the ongoing Railway security incident. Comms here as things evolve.
2
3
18
1,636
Alex Booker retweeted
Mastra's platform is hosted on Railway and thus Mastra platform users are affected by the ongoing Railway security incident. Comms here as things evolve.
Today, we were alerted of malicious activity that compromised Railway's servers We are sharing this with you broadly and swiftly. We recommend folks rotate their keys out of an abundance of caution.
4
6
1
92
13,081
You can now reorder columns in the Traces view Small quality of life improvement
6
421
We redesigned the Mastra trace viewer so you can follow an agent run as a conversation instead of digging through a tree of spans Quick demo with real runs from our docs agent
Incredibly stoked to launch Thread View for traces in the Mastra studio. Zoom in to see a single chat turn and its associated span. Zoom out to see the whole conversation and underlying trace:
1
14
779
My ambition is for everyone building with Mastra to use Mastra Observability for their traces This week we shipped - Thread View - Metrics API - Trace imports - And now trace queries
Today we're incredibly excited to launch trace queries! The point of collecting observability data is to analyze it and improve your agent. So now you (or your coding agent) can query by fields like time, primitive name, agent/workflow ID, status, score, and feedback:
2
24
1,200
Join Charlie and I tomorrow for a workshop on how to build a company brain with Mastra Connect! You'll learn to: - Connect an agent to your knowledge bases - Give it tools to look things up and take action - Put it in your team's Slack 🚀 luma.com/mastra-304z
2
5
382
Stitching together traces turn by turn and reading span trees is not it 😮‍💨 Thread View shows you the conversation the way your user experienced it. Add feedback, or dig into the trace behind any turn
Incredibly stoked to launch Thread View for traces in the Mastra studio. Zoom in to see a single chat turn and its associated span. Zoom out to see the whole conversation and underlying trace:
1
7
575
Before Mastra Connect, giving an agent access to company tools like Notion, Linear, or Slack meant handling OAuth and writing tools yourself, or using a third-party platform. Now you can connect those accounts with 𝚖𝚊𝚜𝚝𝚛𝚊 𝚌𝚘𝚗𝚗𝚎𝚌𝚝 𝚊𝚍𝚍 and give your agents hundreds of ready-made tools, all within Mastra!
Agents need to get knowledge and take actions. So today we're launching Mastra Connect! Run 𝚖𝚊𝚜𝚝𝚛𝚊 𝚌𝚘𝚗𝚗𝚎𝚌𝚝 𝚊𝚍𝚍 from the CLI to give your agent Slack, Linear, Notion and 20 other services with 900+ tools:
1
6
664
Alex Booker retweeted
We shipped a new template for monitoring competitor pages. A page edit doesn't always mean an important update. Use Jev to evaluate each change, and decide if it matters to you. mastra.ai/templates/competit…
3
2
15
1,413
Fair play to the presenter for keeping their cool Half of being a good presenter or emcee is knowing how to handle things when they inevitably go wrong
HOLY SHIT OpenAI's live demo for "Dots" completely FLOPPED💀 and then they CUT THE AUDIO on the official stream to hide it I caught the original:
4
22
3,526
Authentication tells you who's signed in. It doesn't tell you whether they're allowed to read a thread, run an agent, or call a tool. Tomorrow I'm building that layer live with Mastra's fine-grained authorization. Come join me! luma.com/mastra-xy3o
2
1
7
538
Do not miss!
Jev was announced last week. This week, to help devs dive in, @mastra shipped: workflows classifier, tool approval classifier checks, classifier as judge scorers, classifier as a processor. @abhiaiyer and I are diving into it all tomorrow. Come thru! luma.com/mastra-dwi3
1
1
7
981