
vp solutions @Statsig + @Amplitude_HQ || GTM technical geek || music enthusiast + producer w/ https://xitter.cf/t.co/EidiaFrT2D @bitwig || views my own
New York City
Joined December 2010
- Tweets1.1K
- Following291
- Followers209
- Likes2.6K
how to meditate. on the ice.
Devin Cooley shares some great life advice on how he blocks out distractions and enters a flow state during games:
“I could go on forever about this. There's a recipe for flow, there's certain ways. But honestly, the easiest way, the simplest way that I can describe it is that anytime you think about yourself, you just, ‘I don't care. I literally don't care. Like, quiet.’
I say ‘shhh’ like all the time during the game, or, like, ‘I literally don't care.’ Thoughts are gonna pop in your head all the time. You can't control that. So instead of trying to control it, just let them come. And if they want to stick around, they can stick around. It's not gonna bother me, or if they want to leave right away, they can leave. It's not a problem.
And then that frees all your energy to focus on what's happening in front of you. So what are their next options gonna be? What are their threats? You can just really focus all your brainpower into what's happening. You can react a lot quicker. The time moves a lot quicker. You just get lost, and it's a really great feeling.” #Flames
gold. pure gold.
Good life lesson from Pat Murphy about how worrying is a "waste of time."
@FoulTerritoryTV | #WorldSeries
Brian Ivanovick retweeted
Wow. I woke up to an impressive number of upset people who apparently don’t understand how LLMs work and can’t cope well with me pointing it out.
An LLM is a statistical next-token prediction model. That’s how it works. It’s an extraordinarily sophisticated calculator performing math you could theoretically do by hand (if you were sufficiently masochistic).
Math doesn’t know what it’s calculating. Pi doesn’t spend its evenings contemplating the nature of circles, and c doesn’t ponder the relationship between matter and energy.
That doesn’t make the results any less accurate, impressive, or useful.
Between inference requests, an LLM isn’t sitting around thinking. It isn’t reconsidering its answers, wondering whether it made a mistake, contemplating its existence, or questioning whether it’s conscious. Its weights remain fixed (it doesn’t learn), and computation resumes when it receives input.
We know this because we designed these systems. The architectures, mathematics, implementations, and research are extensively documented. You can study them yourself.
Of course, some people immediately lean into comparisons of biological intelligence or philosophical debates over consciousness because that is what they know.
But biological intelligence and artificial neural networks are fundamentally different systems. Similar outputs don’t establish equivalent internal experiences.
I experience consciousness directly. I infer that other humans do too because we share biological structures and processes. We don’t have equivalent evidence for an LLM, and nothing about its known operation gives evidence of conscious experience.
Which brings me back to my original point.
To me, understanding is conscious comprehension. It means being aware of information, recognizing its meaning, and experiencing that comprehension. If I wasn’t conscious I could not understand.
We can perform actions unconsciously. We can produce correct results without knowing why they’re correct. But I distinguish those capabilities from consciously understanding what we’re doing.
An LLM can solve complex problems, explain difficult concepts, and produce remarkably accurate information. I give it full credit for those capabilities.
But producing an answer that we rationalize as understanding isn’t the same as experiencing understanding.
You don’t have to agree with my definitions. We can debate functional understanding versus conscious comprehension all day, but that won’t establish whether an LLM actually experiences anything.
The right debate is this…
Could machines exhibit something different from human consciousness, something measurable, meaningful, and worth studying?
I think so, absolutely!
I’m entirely open to discussing “machine consciousness” in terms of observable, testable computational properties. We built these systems, we can instrument them, examine their internal mechanisms, and investigate what they’re capable of.
That seems far more productive than endlessly arguing over whether a machine experiences life the way humans do.
So here’s my question:
How would you define machine consciousness, and more importantly, how would you measure it?
this post is not about flying cars.
roughly 75% of your features have a negative or neutral impact on your key metrics.
now, more than ever, every company needs to measure the incremental impact of every feature. promote the winners. kill the losers.
the best way to do that is through robust feature gates and experiments.
Welcome @vijayeraji to Amplitude's board of directors.
Vijaye founded and led Statsig through its acquisition to OpenAI.
@statsig and @Amplitude_HQ's history are deeply intertwined.
Amplitude was initially inspired by Meta's growth team and their finding that 7 friends in 10 days was the best predictor of long term engagement for a new user. We were convinced everyone would need the same type of insights and started Amplitude in 2012.
Vijaye was working at Meta on Deltoid, their internal experimentation platform, among many other things. They effectively invented the modern data science and experimentation stack which is now standard practice across the industry. Fast forward to 2021, Vijaye left Meta to take Deltoid and other internal tools at Meta to the rest of the world as Statsig.
For a number of years we were competitors. We both had an engineering led approach where we'd build for each customer in a hands on way. Amplitude focused on its core of analytics and Statsig focused on experimentation. We both were making sophisticated measurement tools accessible. We'd copy each other's functionality, pricing, marketing, sales and support motions, and a lot else. Statig was a fearsome competitor with their advanced statistical engine, warehouse native capabilities, and engineering centric product.
Fast forward to earlier this year, Vijaye was looking for the right home for Statsig's product, brand, and customers, and we agreed that combining with Amplitude was the best way to continue the mission.
I'm excited to get the opportunity to work with someone who has thought deeply about the same mission. It's an honor to be able to continue the work together with Vijaye joining our board of directors. I'm looking forward to having his perspective as we build what's next. Welcome, Vijaye!
"Great execution is hard and rare, which makes it a source of competitive advantage. The world has plenty of ideas. We lack people who turn those ideas into reality. Great execution can make an average strategy go a long way, but poor execution will make the best strategy fail. Execution is king." - @frank_slootman in Amp It Up
Brian Ivanovick retweeted
Replying to @orangebook
"Even though you try very hard, the progress you make is always little by little. It is not like going out in a shower in which you know when you get wet. In a fog, you do not know you are getting wet, but as you keep walking you get wet little by little."
(Zen Mind, Beginner's Mind, "Nothing Special")
One of our lead AI PMs dropping enthusiastic f-bombs on X. You know we're on to something!
reminder: a human didn’t trigger this investigation or point the agent at a known issue
this was an agent first understanding how users engage with the product, then figuring out what drives retention, then designing and shipping an elegant solution that improved the user experience and makes them come back
like holy fuck we’re really doing it folks
I know he's not technically a founder, but I really want to hear @frank_slootman on @davidsenra 's podcast.
“Reason is a tiny sliver of how decisions get made” - @RickRubin
Alexandr Wang 说了一句让技术流创始人集体沉默的话。
“做技术的人习惯了数据说话,觉得东西更好、数字更漂亮,客户总会识货”
他直接点破:大公司不是这么运转的,政府更不是。
在那些客户眼里,感知比现实更真实。
真实的业务现状太难看了,没几个人愿意直面。
大家要的不是真相,是一套能让自己在系统里安全生存的叙事。
所以更好的产品照样被踢出局。
买方根本没在评测产品,谁掌控了感知,单子给谁。
他甚至点名 Palantir:表面是软件公司,底色是个剧团。新员工入职,真的会发一本戏剧表演书,发了整整好多年。
做企业级市场,改写现实只是一半的工作;
塑造一套客户愿意相信的说法,是另一半。
技术人最容易栽在这道坎上:
你的东西确实碾压竞品,但坐在对面签字盖章的人,自始至终连看都没看屏幕一眼。
One of the finest pieces of ambient music ever produced. Stills stirs the emotions...
Brian Ivanovick retweeted
Pure gold.
My fav — People become what the room expects of them. If the room lets a standard slide, it slides.
If the room corrects the small thing every single day, people stop believing small things are small.
My goal is to build an environment where success is inevitable.
If you had a great Q3, congratulations!
Q4, for many of us, starts today.
youtube.com/watch?v=vEZDdVMo…
Brian Ivanovick retweeted
We've been testing Jev in our own AI analytics benchmarks for when a chart is presenting an anomaly and needs a deeper dive.
It's significantly faster and cheaper but it's overly sensitive eg low precision, escalating much more often than the best general purpose models.
Analytics datasets are significantly more complex to navigate smaller decision models have difficulty capturing that complexity.
Jev caught every meaningful chart in our benchmark. $0.06 per 1,000. 0.14 seconds. Last on precision.
Fast and cheap enough for every branch point. The accuracy still has to be watched.
With @ramsoma: amplitude.com/blog/jev-analy…
Best synopsis of the present moment I’ve seen. Immediately sharing this with family and friends.
The @BostonCollege Investment Committee (an LP and my beloved alma mater) asked for a few thoughts on what's happening in AI. I recorded a test run yesterday morning and then shared it with my partners, who encouraged me to share it more broadly... so here you go!
This is not a sales pitch, it's just a reflection on what we're seeing. And it wasn't intended to be shared, so please pardon the rough edges.
loom.com/share/c016702964a04…
Brian Ivanovick retweeted
Nobody wants your slop.
There is one issue with this mindset (and I agree with the mindset!) I can’t get over: and it’s that people need to interact with the thing you do for you to learn from it, and therefore, if it is bad you are providing them a bad experience and they will bail.
Yes you can “just build it and try it” but if “IT” feels bad to use, you are burning your actual users!! This is where the realities of the new world and mindset of the old world diverge.
Tolerance for crappy experience will go WAY down, quickly, as the expectation of software performance rises, quickly… what happens when consumer expectation increases exponentially?
You can try more things, but they have to be f*cking good
Brian Ivanovick retweeted
We put GPT-6 Sol, GPT-6 Luna, and Claude Opus 5.5 through our Amplitude Global Chat eval and mapped the outcomes on our quality/cost frontier.
Our eval is 185 analytics tasks from simple to complex: building a chart, editing one, choosing the right event in a taxonomy, getting the correct date range, finding the property that most explains the variance in a chart. These evals are all based on real customer queries. We grade answers on correctness only. We measure cost and latency separately.
Here’s where each new model landed (one run each so±2%):
-Claude Opus 5.5: 83% correct at $0.70 per question. That's about 2 points behind our top score (GPT-6 Astra) at roughly a sixth of the cost.
-GPT-6 Sol: 81% at $0.58. It scored a little lower than GPT-5.6 Sol, but was considerably cheaper (less than half the price). This is the cheapest model we've tested that clears 80%.
-GPT-6 Luna: 76% at under $0.04, making it the cheapest model on the frontier. It's about 3x cheaper than GPT-5.6 Luna and achieves about the same score. The tradeoff is speed: its p95 latency was ~400 seconds, about 3x slower than Opus 5.5.
Even with the inclusion of these new releases, GPT-6 Astra still gets the top score (84%) on our eval. The tradeoff is it costs $4 per question and was one of the slowest models we tested (900 seconds at p95).
“In the beginner’s mind there are many possibilities, but in the expert’s there are few.” - Shunryu Suzuki, Zen Mind, Beginner's Mind





















