Luv Kothari retweeted
Enterprise AI agents need context—not scraping scripts.
Cortex Knowledge Extensions are now GA, bringing verified, licensed content from @AP, @WashingtonPost, @StackOverflow, and more into your Snowflake-powered AI. 📚🧠
Use Snowflake Intelligence—now in Public Preview—to connect this content to agents or prompt it directly through Cortex AI APIs using your LLM of choice.
No hacks. No headaches. Just answers you can trust: bit.ly/46OQ8Ck
Luv Kothari retweeted
Congratulations to @Cisco for launching AI Defense today! We worked with Cisco to build the guardrail models that power this end-to-end solution to safeguard enterprise AI transformation.
blogs.cisco.com/news/you-can…
Luv Kothari retweeted
As we launch into 2025, our Public Sector team reflects on our work over the past year. We focused on strengthening national security by equipping U.S. agencies with the best-in-class commercial AI technologies.
Highlights include:
✅Deepening ties to Missouri’s geospatial and defense tech industry
✅Work with the U.S. government to develop and deploy new AI capabilities, including a T&E framework for @DeptofDefense and novel perimeter security technology with @DIU_x and @usairforce
✅Collaborations with @anduriltech, @CISAgov, & Holos
✅Product launches like Defense Llama and major upgrades to Scale Donovan
Read more 👉 scl.ai/public-sector-2025
Luv Kothari retweeted
Want to design better AI agents? Take notes from code writing systems.
Techniques include
— Multi-agent
— Tool choice
— Underlying model
— Diff format
— Innovative Signals
— Code retrieval + knowledge graphs
— LSP
— Fault localization
Let's dive deeper with real examples:
1/10
Luv Kothari retweeted
📣 Introducing Llama 3.2: Lightweight models for edge devices, vision models and more!
What’s new?
• Llama 3.2 1B & 3B models deliver state-of-the-art capabilities for their class for several on-device use cases — with support for @Arm, @MediaTek & @Qualcomm on day one.
• Llama 3.2 11B & 90B vision models deliver performance competitive with leading closed models — and can be used as drop-in replacements for Llama 3.1 8B & 70B.
• New Llama Guard models to support multimodal use cases and edge deployments.
• The first official distro of Llama Stack simplifies and supercharges the way developers & enterprises can build around Llama to support agentic applications and more.
Details in the full announcement ➡️ go.fb.me/229ug4
Download Llama 3.2 models ➡️ go.fb.me/w63yfd
These models are available to download now directly from Meta and @HuggingFace — and will be available across offerings from 25+ partners that are rolling out starting today, including @accenture, @awscloud, @AMD, @azure, @Databricks, @Dell, @Deloitte, @FireworksAI_HQ, @GoogleCloud, @GroqInc, @IBMwatsonx, @Infosys, @Intel, @kaggle, @NVIDIA, @OracleCloud, @PwC, @scale_AI, @snowflakeDB, @togethercompute and more.
With Llama 3.2 we’re making it possible to run Llama in even more places, with even more flexible capabilities. We’ve said it before and we’ll say it again: open source AI is how we ensure that these innovations reflect the global community they’re built for and benefit everyone. We’re continuing our drive to make open source the standard with Llama 3.2.
Luv Kothari retweeted
Let's say you’re a pre-revenue tech startup with a shiny new product that’s almost ready for primetime. You’ve landed a couple of hot leads that could make or break your credibility—and get investors pumped for your next round.
Here’s where I’d focus my energy right now:
1. Value Prop Check
Nail down your sales pitch, but be ready to adapt as real-world feedback rolls in and shows you where your message hits—or misses. You won't get it right the first time, so plan to iterate.
2. Scrappy Sales Team
Assemble a small, agile team that includes you (the CEO or Founder) and one or two sharp folks from engineering with a decent customer UI. At this stage, it's as much about being good learners than about being good closers.
3. Test and Tweak Sales Process
Start with a basic sales playbook, but treat it like a lab experiment—track everything, learn fast, and adjust on the fly. *Always* ask tons of questions first before you pitch your product.
4. Find Your First Believers
Go after the early adopters who feel the pain your product solves, and dig deep into their world to refine your ideal customer profile.
5. Pilot with Partners
Lock in some pilot deals for low initial dollars that let you test your product in the wild—think of it as R&D with potential revenue. Always charge something to test willingness to pay.
6. Fast Feedback Loops
Set up quick and dirty feedback loops between your customers and the product team—iterate like your runway depends on it. Learn and adapt.
7. Insights Over Instincts
Make every customer interaction a chance to gather intel—use it to tweak your product and pitch until you’ve got a winner.
Focus on these 7 key areas, execute relentlessly, and stay adaptable. Nail this phase and you'll transform from pre-revenue to market-ready before you know it.
Luv Kothari retweeted
Google DeepMind have produced a program that in a certain sense has achieved a silver-medal peformance at this year's International Mathematical Olympiad. 🧵
deepmind.google/discover/blo…
Luv Kothari retweeted
Unlock the secrets to mastering generative AI with our AI Readiness Report. Based on a survey of over 1,800 experts, discover how leading organizations are fine-tuning models, tackling data challenges, and implementing robust evaluation frameworks to drive AI success.
Luv Kothari retweeted
We’re excited to see @cohere launching Command-R today!
Enterprises can test and evaluate Cohere’s models on Scale GenAI Platform, incorporate these models into their RAG pipelines, and use these models to build custom GenAI apps built on their own data 💪
Luv Kothari retweeted
Scale GenAI Platform is now available on the @Azure Marketplace!
Azure customers can purchase Scale GP through the Azure Marketplace, leveraging their existing @Microsoft Azure Consumption Commitment (MACC).
👉 scl.ai/sgp-on-azure
👉 scale.com/genai-platform
Luv Kothari retweeted
We are excited that @scale_AI has now added Cohere’s Command model and Rerank technology to their GenAI platform to customize business applications with fine-tuning and use RAG for accurate responses. This move will help unlock the powerful potential of AI for enterprise customers.
📣Today, we're launching a major update to the Scale GenAI Platform, the full-stack platform to transform your data into customized enterprise-ready Generative AI applications. Any use case, any model, anywhere 🧵
scale.com/blog/genai-platfor…
Luv Kothari retweeted
📣Today, we're launching a major update to the Scale GenAI Platform, the full-stack platform to transform your data into customized enterprise-ready Generative AI applications. Any use case, any model, anywhere 🧵
scale.com/blog/genai-platfor…
Luv Kothari retweeted
Being at the 95th percentile in fitness ≈ being 30 years younger. (Image via @andrewchen.)
Luv Kothari retweeted
Here's a list of my favorite LLM papers I read this month:
1/ Zephyr LLM - a 7B parameter model with competitive performance to ChatGPT on AlpacaEval; applies distilled supervised fine-tuning to improve task accuracy and distilled direct performance optimization on AI feedback data to better align the model; shows performance comparable to 70B-parameter chat models aligned with human feedback.
arxiv.org/abs/2310.16944
2/ LLMs Meet New Knowledge - presents a benchmark to assess LLMs' abilities in knowledge understanding, differentiation, and association; benchmark results show
arxiv.org/abs/2310.14820
3/ Llemma - an LLM for mathematics which is based on continued pretraining from Code Llama on the Proof-Pile-2 dataset; the dataset involves scientific paper, web data containing mathematics, and mathematical code; Llemma outperforms open base models and the unreleased Minerva on the MATH benchmark; the model is released, including dataset and code to replicate experiments.
arxiv.org/abs/2310.10631
4/ LLMs for Software Engineering - a comprehensive survey of LLMs for software engineering, including open research and technical challenges.
arxiv.org/abs/2310.03533
5/ Self-RAG - presents a new retrieval-augmented framework that enhances an LM’s quality and factuality through retrieval and self-reflection; trains an LM that adaptively retrieves passages on demand, and generates and reflects on the passages and its own generations using special reflection tokens; it significantly outperforms SoTA LLMs.
arxiv.org/abs/2310.11511
6/ Instruct-Retro - introduces Retro 48B, the largest LLM pretrained with retrieval; continues pretraining a 43B parameter GPT model on an additional 100B tokens by retrieving from 1.2T tokens.
arxiv.org/abs/2310.07713
7/ Overview of Factuality in LLMs - a survey of factuality in LLMs providing insights into how to evaluate factuality in LLMs and how to enhance it.
arxiv.org/abs/2310.07521
8/ LLMs Represent Space and Time - discovers that LLMs learn linear representations of space and time across multiple scales; the representations are robust to prompt variations and unified across different entity types; demonstrate that LLMs acquire fundamental structured knowledge such as space and time, claiming that language models learn beyond superficial statistics, but literal world models.
arxiv.org/abs/2310.02207
9/ StreamingLLM - a framework that enables efficient streaming LLMs with attention sinks, a phenomenon where the KV states of initial tokens will largely recover the performance of window attention; the emergence of the attention sink is due to strong attention scores towards the initial tokens; this approach enables LLMs trained with finite length attention windows to generalize to infinite sequence length without any additional fine-tuning.
arxiv.org/abs/2309.17453
10/ Retrieval meets Long Context LLMs - compares retrieval augmentation and long-context windows for downstream tasks to investigate if the methods can be combined to get the best of both worlds; an LLM with a 4K context window using simple RAG can achieve comparable performance to a fine-tuned LLM with 16K context; retrieval can significantly improve the performance of LLMs regardless of their extended context window sizes; a retrieval-augmented LLaMA2-70B with a 32K context window outperforms GPT-3.5-turbo-16k on seven long context tasks including question answering and query-based summarization.
arxiv.org/abs/2310.03025
You can find more interesting papers for this and past months here: github.com/dair-ai/ML-Papers…
Luv Kothari retweeted
Good intro/overview to LLM retrieval (RAG) from @c_viernickel and Bryan Zhu on Scale's blog — it's not RAG vs. fine-tuning, it's tuning for RAG; for interesting tasks you want both:
🤔 What do you do when you want your LLM to “apply” its knowledge to new information? You can’t just retrain the model every time with new data before calling it.
Enter Retrieval Augmented Generation or as the cool kids call it, RAG. 😎
Unlike fine-tuning, which updates the model's behavior by changing the weights of a pre-trained model, RAG injects additional context to the model at the time it is called.
👉 Learn more about how RAG works and why it matters in the latest blog from Scale: scl.ai/rag-blog
Luv Kothari retweeted
As Arabs, our message to the world cannot be restricted to eliciting global sympathy for the children of Gaza. We cannot depict ourselves as helpless children, behind whom we hide our failure to control our Hamas thugs who massacred 1300 non-combatant Israelis. This is a moral failure that the world sees but that we try to hide behind the “rights of the Palestinian people,” rights that none of us are willing to articulate. Free Palestine can mean anything, from an Arab Palestinian state living in peace next to Jewish Israel to an Arab Palestinian state instead of Jewish Israel.
For Arab Israeli peace to happen, and since Palestinians are either children, or Hamas thugs, or useless corrupt Mahmud Silicon-Face Abbas, non-Palestinian Arabs should step up to save the Palestinians from themselves and save the region ongoing sorrow. We, Arabs, have to show the world that we are at peace with the idea of a Jewish state, that we are willing to concede what we believe – rightly or wrongly -- is ours (1948 territory), that we genuinely want bygones to be bygones, without secretly holding grudges and passing them to our children. We must seek a better future for ourselves and our kids, as well as for Israelis and their kids.
The Palestine disaster (nakba) is not a disaster of land loss or military defeat. It is a disaster of absence of leadership that can articulate the Arab alternative to war and death. We ask the world to stop the Israeli war on Hamas, but what do we offer as an alternative to stopping the war? Just let those Hamas thugs who massacred 1300 Israelis get away with their crime (because there is a history of dispute)? Ask Israel to go back to October 6? Knowing that Hamas can break out of the Gaza fence and repeat its massacre any minute? Hamas must go. We Arabs must help get rid of it, and most importantly, we must show that we have a plan for the day after Hamas.
Let’s learn from the mistake of Iraq and Arab Spring countries, that once what we have is gone, what comes next looks worse. Let’s preempt the worse by offering the better.
As long as we, the Arabs, do not have answers to all these questions, the world will manage things without us. It does not matter if all of us, 1.3 billion Muslims, think that Israel is at fault. What matters is global perception, which clearly thinks that Islamist terrorism is the problem, not Israelis dancing at a music festival. And we, the Arabs, are not even talking to the world. We are talking to each other, patting ourselves on the back for being utopian and principled on Palestine, while we are in fact idiotically out of touch with reality. We insist on our backward message, then act surprised why many of our states are failing and why we are migrating in droves.
Please stop treating Palestine like religion, like we have to stick to our principles to win credit in the afterlife and to garner social acceptance among each other (Arabs and/or Muslims). Please think of Palestine like a problem that requires troubleshooting, compromise, pragmatism, and most importantly, looking toward the future, not the past.
Great analysis!
People ask me all the time if I am "pro-Israel" because I am a Jew who has lived in Israel, and my answer is that being "pro-Israel" or being "pro-Palestine" or being a "Zionist" does not properly capture the nuance of thought most people do or should have about this issue. It certainly doesn't capture mine.
I have a lot to say. I’ve spent the last 72 hours writing, texting, and talking to Israelis, Jews, Muslims, and Palestinians. Much of my reaction is going to piss off people on "both sides," but I am exhausted and hurting and I do not think there is any way to discuss this situation without being radically honest about my views. So I'm going to try to say what I believe to be true the best I can.
Let me start with this: It could have been me.
That's a hard thought to shake when watching the videos out of Israel — the concert goers fleeing across an empty expanse, the hostages being paraded through the streets, the people shot in the head at bus stops or in their cars. I went to those parties in the desert, I rubbed shoulders with Israelis and Arabs and Jews and Muslims, I could have easily accepted an invitation to some concert near Sderot and gone without a care, only to be indiscriminately slaughtered. Or, perhaps worse, taken hostage and tortured.
I don’t believe Hamas is killing Israelis to liberate themselves, nor do I believe they are doing it to make peace. They're doing this because they represent the devil on the shoulder of every oppressed Palestinian who has lost someone in this conflict. They're doing it because they want vengeance. They are evening the score, and acting on the worst of our human impulses, to respond to blood with blood — an inclination that is easy to give in to after what their people have endured. It should not be hard to understand their logic — it is only hard to accept that humans are capable of being driven to this. Not defending Hamas is a very low bar to clear. Please clear it.
It’s not possible to recap the entire 5,000 year history of people fighting over this strip of land in one newsletter. There are plenty of easily accessible places you can learn about it if you want to (and, by the way, many of you should — far too many people speak on this issue with an obscene amount of ignorance, loads of arrogance, and a narrow historical lens focused on the last few decades). But I'll briefly highlight a few things that are important to me.
In my opinion, the Jewish people have a legitimate historical claim to the land of Israel. Jews had already been expelled and returned and expelled again a half dozen times before the rise of the Muslim and Arab rule of the Ottoman Empire. Of course it’s messy because we Jews and Arabs and Muslims are all cousins and descendents of the same Canaanites. But Arabs won the land centuries ago the same way Israel and Jews won it in the 20th century: Through conflict and war. The British defeated the Ottoman Empire and then came the Balfour Declaration, which amounted to the British granting the area to the Jewish people, a promise they’d later try to renege on — all before the wars that have defined the region since 1948.
That historical moment in the late 1940s was unique. After World War II, with many Arab and Muslim states already in existence, and after six million Jews were slaughtered, the global community felt it was important to grant the Jewish people a homeland. In a more logical or just world that homeland would have been in Europe as a kind of reparation for what the Nazis and others before them had done to the Jews, or perhaps in the Americas — like Alaska — or somewhere else. But the Jews wanted Israel, the British had taken to the Zionist movement, the British had conquered the Ottoman Empire which handed them control of the land, and America and Europe didn’t want the Jews. As a result, we got Israel.
The Arab states had already rejected a partitioned Israel repeatedly before World War II and rejected it again after the Holocaust and the end of the war. They did not want to give up even a little bit of their land to a bunch of Jewish interlopers who were granted it all of a sudden by British interlopers who had arrived a hundred years prior. Who could blame them? It had been centuries since Jews lived there in large numbers, and now they wanted to return in waves as secularized Europeans. Many of us would probably react the same way. So, just as humans have done forever, they fought. The many existing Arab states turned against the burgeoning new Jewish state. One side won and one side lost. This is the brutal and broken and violent world we live in, but it is what created the global world order we have now.
Are Israelis and British people "colonizers" because of this 20th century history? Sure. But that view flattens thousands of years of history and conflict, and the context of World War I and World War II. I don’t view Israelis and Brits as colonizers any more than the Assyrians or the Babylonians or the Romans or the Mongols or the Egyptians or the Ottomans who all battled over the same strip of land from as early as 800 years before Jesus’s time until now. The Jews who founded Israel just happened to have won the last big battle for it.
You can’t speak about this issue in a vacuum. You can't pretend that it wasn't just 60 years ago when Israel was surrounded on all sides by Arab states who wanted to wipe them off the face of the planet. Despite the balance of power shifting this century, that threat is still a reality. And you can't talk about that without remembering the only reason the Jews were in Israel in the first place was that they'd spent the previous centuries fleeing a bunch of Europeans who also wanted to wipe them off the face of the planet. And then Hitler showed up.
American partisans have a narrow view of this history, and an Americentric lens that is infuriating to witness. As Lee Fang perfectly put it, "Hamas would absolutely execute the ACAB lefties cheering on horrific violence against Israelis if they lived in Gaza & U.S. right-wingers blindly cheering on Israeli subjugation of Palestinians would rebel twice as violently if Americans were subjected to similar occupation."
And yet, many Americans only view modern Israel as the "powerful" one in this dynamic. Which is true — they obviously are. It isn't a fair fight and it hasn't been for decades because Israel's government is rich and resourceful, has the backing of the United States and most of Europe, and has an incredibly powerful military. At the same time, Israeli leadership has made technological and military advancements that have further tipped those scales — all while the Israeli government has helped create a resource-thin open air prison of two million Arabs in Gaza.
Conversely, Palestinians are devoid of any real unified leadership, and the Arab world is now divided on the issue of Palestine. Israel is unwilling to give the people in Gaza and the West Bank more than an inch of freedom to live. These are largely the refugees and descendents of the refugees of the 1948 and 1967 wars that Israel won. And you can't keep two million people in the condition that those in the Gaza strip live in and not expect events like this.
I'm sorry to say that while the blood on the ground is fresh. The Israelis who were killed in this attack largely have nothing to do with those conditions other than being born at a time when Israel and Jews have the upper hand in this conflict. Some of the victims weren’t even Israeli — they were just tourists. This is why we describe them as “innocent” and why Hamas has only reaffirmed that they are a brutal terror organization with this attack — an organization that I hope is quickly toppled, for the sake of both the Palestinian people and the Israelis. But as someone with a deep love for Israel, with friends in danger and people I know still missing, it breaks my heart to say it but I'm saying it again because it remains perhaps the most salient point of context in a tangled mess full of centuries of context:
You cannot keep two million people living in the conditions people in Gaza are living in and expect peace.
You can't. And you shouldn’t. Their environment is antithetical to the human condition. Violent rebellion is guaranteed. Guaranteed. As sure as the sun rising.
And the cycle of violence seems locked in to self-perpetuate, because both sides see a score to settle:
1) Israel has already responded with a vengeance, and they will continue to. Their desire for violence is not unlike Hamas’s — it’s just as much about blood for blood as any legitimate security measure. Israel will “have every right to respond with force." Toppling Hamas — a group, by the way, Israel erred in supporting — will now be the objective, and civilian death will be seen as necessary collateral damage. But Israel will also do a bunch of things they don't have a right to. They will flatten apartment buildings and kill civilians and children and many in the global community will probably cheer them on while they do it. They have already stopped the flow of water, electricity, and food to two million people, and killed dozens of civilians in their retaliatory bombings. We should never accept this, never lose sight that this horror is being inflicted on human beings. As the group B’Tselem said, “There is no justification for such crimes, whether they are committed as part of a struggle for freedom from oppression or cited as part of a war against terror.” I mourn for the innocents of Palestine just as I do for the innocents in Israel. As of late, many, many more have died on their side than Israel's. And many more Palestinians are likely to die in this spate of violence, too.
Unfortunately, most people in the West only pay attention to this story when Hamas or a Palestinian in Gaza or the West Bank commits an act of violence. Palestinian citizens die regularly at the hands of the Israeli military and their plight goes largely unnoticed until they respond with violence of their own. Israel had already killed an estimated 250 Palestinians, including 47 children, this year alone. And that is just in the West Bank.
2) Every single time Israel kills someone in the name of self-defense they create a handful of new radicalized extremists who will feel justified in wanting to take an Israeli life in retribution sometime in the future. Half of Gaza’s two million people are under the age of 19 — they know little besides Hamas rule (since 2006), Israeli occupation, blockades, and rockets falling from the sky. The suffering of these innocent children born into this reality is incomprehensible to me. They will suffer more now because of Hamas’s actions and Israel’s response, all through no fault of their own.
There is no way out of this pattern until one side exercises restraint or leaders on both sides find a new solution. Israelis will tell you that if Palestinians put their guns down then the war would end, but if Israel put their guns down they'd be wiped off the planet. I don't have a crystal ball and can’t tell you what is true. But what I am certain of is that every time Israel kills more innocents they engender more rage and hatred and recruit more Palestinians and Arabs to the cause against them. There is no disputing this.
So, why did this happen now?
I'm not sure how to answer that question except to say it was bound to happen eventually. It was a massive policy and intelligence failure and Netanyahu should pay the price politically — he is a failed leader. Iran probably helped organize the attack and the money freed up by the Biden administration's prisoner swap probably didn't help the situation, either. Israel's increasingly extremist government and settlers provoking Palestinians certainly didn't help. Nor has going to the Al-Aqsa mosque and desecrating it. Nor do blockades and bombings and indiscriminate subjugation of a whole people. Nor does refusing to talk to non-terrorist leaders in Palestine. Nor does illegally continuing to expand and steal what is left of Palestinian land, as many Jews and Israelis have been doing in the 21st century despite cries from the global community to stop. A violent response was predictable — in fact, plenty of people did predict it.
Israel is forever stuffing these people into tinier and tinier boxes with fewer and fewer resources. But if you want to blame Israeli leaders for continuing to expand and settle land that does not belong to them (as I do), then you should also spare some blame for Palestinian leaders for repeatedly not accepting a partitioned Israel during the 20th century that could have led to peace (as I do).
Please also remember this: Hamas is still an extremist group. The Palestinian people do not have a government or leaders who legitimately represent their interests, and it sure as hell isn't Hamas. Will some Palestinians cheer and clap at the dead, or spit on them as they are paraded through Gaza? Yes they will. And they have. Many will also mourn because they loathe Hamas and know this will only make things worse. This is no different than how some Americans cheer at the dead in every single war we've ever fought. It's no different than the Israelis who set up lawn chairs to watch their government bomb Palestine and cheer them on, too. This doesn't mean Palestinians or Israelis or Americans are evil — it means some of them are giving in to their violent impulses, and their zealous feelings of righteous vengeance.
Solutions, you ask? I can’t say I have any. If you came here for that, I’m sorry. The two-state solution looks dead to me. A three-state solution makes some sense but feels out of the view of all the people who matter and could make it happen. I wish a one-state solution felt realistic — a world of Israelis and Arabs and Muslims and Jews living side by side with equal rights, fully integrated and defused of their hate, is a version of Israel that I would adore. But it seems less and less realistic with every new act of violence.
Am I pro-Israel or pro-Palestine? I have no idea.
I'm pro-not-killing-civilians.
I'm pro-not-trapping-millions-of-people-in-open-air-prisons.
I'm pro-not-shooting-grandmas-in-the-back-of-the-head.
I'm pro-not-flattening-apartment-complexes.
I'm pro-not-raping-women-and-taking-hostages.
I'm pro-not-unjustly-imprisoning-people-without-due-process.
I'm pro-freedom and pro-peace and pro- all the things we never see in this conflict anymore.
Whatever this is, I want none of it.
Luv Kothari retweeted
People ask me all the time if I am "pro-Israel" because I am a Jew who has lived in Israel, and my answer is that being "pro-Israel" or being "pro-Palestine" or being a "Zionist" does not properly capture the nuance of thought most people do or should have about this issue. It certainly doesn't capture mine.
I have a lot to say. I’ve spent the last 72 hours writing, texting, and talking to Israelis, Jews, Muslims, and Palestinians. Much of my reaction is going to piss off people on "both sides," but I am exhausted and hurting and I do not think there is any way to discuss this situation without being radically honest about my views. So I'm going to try to say what I believe to be true the best I can.
Let me start with this: It could have been me.
That's a hard thought to shake when watching the videos out of Israel — the concert goers fleeing across an empty expanse, the hostages being paraded through the streets, the people shot in the head at bus stops or in their cars. I went to those parties in the desert, I rubbed shoulders with Israelis and Arabs and Jews and Muslims, I could have easily accepted an invitation to some concert near Sderot and gone without a care, only to be indiscriminately slaughtered. Or, perhaps worse, taken hostage and tortured.
I don’t believe Hamas is killing Israelis to liberate themselves, nor do I believe they are doing it to make peace. They're doing this because they represent the devil on the shoulder of every oppressed Palestinian who has lost someone in this conflict. They're doing it because they want vengeance. They are evening the score, and acting on the worst of our human impulses, to respond to blood with blood — an inclination that is easy to give in to after what their people have endured. It should not be hard to understand their logic — it is only hard to accept that humans are capable of being driven to this. Not defending Hamas is a very low bar to clear. Please clear it.
It’s not possible to recap the entire 5,000 year history of people fighting over this strip of land in one newsletter. There are plenty of easily accessible places you can learn about it if you want to (and, by the way, many of you should — far too many people speak on this issue with an obscene amount of ignorance, loads of arrogance, and a narrow historical lens focused on the last few decades). But I'll briefly highlight a few things that are important to me.
In my opinion, the Jewish people have a legitimate historical claim to the land of Israel. Jews had already been expelled and returned and expelled again a half dozen times before the rise of the Muslim and Arab rule of the Ottoman Empire. Of course it’s messy because we Jews and Arabs and Muslims are all cousins and descendents of the same Canaanites. But Arabs won the land centuries ago the same way Israel and Jews won it in the 20th century: Through conflict and war. The British defeated the Ottoman Empire and then came the Balfour Declaration, which amounted to the British granting the area to the Jewish people, a promise they’d later try to renege on — all before the wars that have defined the region since 1948.
That historical moment in the late 1940s was unique. After World War II, with many Arab and Muslim states already in existence, and after six million Jews were slaughtered, the global community felt it was important to grant the Jewish people a homeland. In a more logical or just world that homeland would have been in Europe as a kind of reparation for what the Nazis and others before them had done to the Jews, or perhaps in the Americas — like Alaska — or somewhere else. But the Jews wanted Israel, the British had taken to the Zionist movement, the British had conquered the Ottoman Empire which handed them control of the land, and America and Europe didn’t want the Jews. As a result, we got Israel.
The Arab states had already rejected a partitioned Israel repeatedly before World War II and rejected it again after the Holocaust and the end of the war. They did not want to give up even a little bit of their land to a bunch of Jewish interlopers who were granted it all of a sudden by British interlopers who had arrived a hundred years prior. Who could blame them? It had been centuries since Jews lived there in large numbers, and now they wanted to return in waves as secularized Europeans. Many of us would probably react the same way. So, just as humans have done forever, they fought. The many existing Arab states turned against the burgeoning new Jewish state. One side won and one side lost. This is the brutal and broken and violent world we live in, but it is what created the global world order we have now.
Are Israelis and British people "colonizers" because of this 20th century history? Sure. But that view flattens thousands of years of history and conflict, and the context of World War I and World War II. I don’t view Israelis and Brits as colonizers any more than the Assyrians or the Babylonians or the Romans or the Mongols or the Egyptians or the Ottomans who all battled over the same strip of land from as early as 800 years before Jesus’s time until now. The Jews who founded Israel just happened to have won the last big battle for it.
You can’t speak about this issue in a vacuum. You can't pretend that it wasn't just 60 years ago when Israel was surrounded on all sides by Arab states who wanted to wipe them off the face of the planet. Despite the balance of power shifting this century, that threat is still a reality. And you can't talk about that without remembering the only reason the Jews were in Israel in the first place was that they'd spent the previous centuries fleeing a bunch of Europeans who also wanted to wipe them off the face of the planet. And then Hitler showed up.
American partisans have a narrow view of this history, and an Americentric lens that is infuriating to witness. As Lee Fang perfectly put it, "Hamas would absolutely execute the ACAB lefties cheering on horrific violence against Israelis if they lived in Gaza & U.S. right-wingers blindly cheering on Israeli subjugation of Palestinians would rebel twice as violently if Americans were subjected to similar occupation."
And yet, many Americans only view modern Israel as the "powerful" one in this dynamic. Which is true — they obviously are. It isn't a fair fight and it hasn't been for decades because Israel's government is rich and resourceful, has the backing of the United States and most of Europe, and has an incredibly powerful military. At the same time, Israeli leadership has made technological and military advancements that have further tipped those scales — all while the Israeli government has helped create a resource-thin open air prison of two million Arabs in Gaza.
Conversely, Palestinians are devoid of any real unified leadership, and the Arab world is now divided on the issue of Palestine. Israel is unwilling to give the people in Gaza and the West Bank more than an inch of freedom to live. These are largely the refugees and descendents of the refugees of the 1948 and 1967 wars that Israel won. And you can't keep two million people in the condition that those in the Gaza strip live in and not expect events like this.
I'm sorry to say that while the blood on the ground is fresh. The Israelis who were killed in this attack largely have nothing to do with those conditions other than being born at a time when Israel and Jews have the upper hand in this conflict. Some of the victims weren’t even Israeli — they were just tourists. This is why we describe them as “innocent” and why Hamas has only reaffirmed that they are a brutal terror organization with this attack — an organization that I hope is quickly toppled, for the sake of both the Palestinian people and the Israelis. But as someone with a deep love for Israel, with friends in danger and people I know still missing, it breaks my heart to say it but I'm saying it again because it remains perhaps the most salient point of context in a tangled mess full of centuries of context:
You cannot keep two million people living in the conditions people in Gaza are living in and expect peace.
You can't. And you shouldn’t. Their environment is antithetical to the human condition. Violent rebellion is guaranteed. Guaranteed. As sure as the sun rising.
And the cycle of violence seems locked in to self-perpetuate, because both sides see a score to settle:
1) Israel has already responded with a vengeance, and they will continue to. Their desire for violence is not unlike Hamas’s — it’s just as much about blood for blood as any legitimate security measure. Israel will “have every right to respond with force." Toppling Hamas — a group, by the way, Israel erred in supporting — will now be the objective, and civilian death will be seen as necessary collateral damage. But Israel will also do a bunch of things they don't have a right to. They will flatten apartment buildings and kill civilians and children and many in the global community will probably cheer them on while they do it. They have already stopped the flow of water, electricity, and food to two million people, and killed dozens of civilians in their retaliatory bombings. We should never accept this, never lose sight that this horror is being inflicted on human beings. As the group B’Tselem said, “There is no justification for such crimes, whether they are committed as part of a struggle for freedom from oppression or cited as part of a war against terror.” I mourn for the innocents of Palestine just as I do for the innocents in Israel. As of late, many, many more have died on their side than Israel's. And many more Palestinians are likely to die in this spate of violence, too.
Unfortunately, most people in the West only pay attention to this story when Hamas or a Palestinian in Gaza or the West Bank commits an act of violence. Palestinian citizens die regularly at the hands of the Israeli military and their plight goes largely unnoticed until they respond with violence of their own. Israel had already killed an estimated 250 Palestinians, including 47 children, this year alone. And that is just in the West Bank.
2) Every single time Israel kills someone in the name of self-defense they create a handful of new radicalized extremists who will feel justified in wanting to take an Israeli life in retribution sometime in the future. Half of Gaza’s two million people are under the age of 19 — they know little besides Hamas rule (since 2006), Israeli occupation, blockades, and rockets falling from the sky. The suffering of these innocent children born into this reality is incomprehensible to me. They will suffer more now because of Hamas’s actions and Israel’s response, all through no fault of their own.
There is no way out of this pattern until one side exercises restraint or leaders on both sides find a new solution. Israelis will tell you that if Palestinians put their guns down then the war would end, but if Israel put their guns down they'd be wiped off the planet. I don't have a crystal ball and can’t tell you what is true. But what I am certain of is that every time Israel kills more innocents they engender more rage and hatred and recruit more Palestinians and Arabs to the cause against them. There is no disputing this.
So, why did this happen now?
I'm not sure how to answer that question except to say it was bound to happen eventually. It was a massive policy and intelligence failure and Netanyahu should pay the price politically — he is a failed leader. Iran probably helped organize the attack and the money freed up by the Biden administration's prisoner swap probably didn't help the situation, either. Israel's increasingly extremist government and settlers provoking Palestinians certainly didn't help. Nor has going to the Al-Aqsa mosque and desecrating it. Nor do blockades and bombings and indiscriminate subjugation of a whole people. Nor does refusing to talk to non-terrorist leaders in Palestine. Nor does illegally continuing to expand and steal what is left of Palestinian land, as many Jews and Israelis have been doing in the 21st century despite cries from the global community to stop. A violent response was predictable — in fact, plenty of people did predict it.
Israel is forever stuffing these people into tinier and tinier boxes with fewer and fewer resources. But if you want to blame Israeli leaders for continuing to expand and settle land that does not belong to them (as I do), then you should also spare some blame for Palestinian leaders for repeatedly not accepting a partitioned Israel during the 20th century that could have led to peace (as I do).
Please also remember this: Hamas is still an extremist group. The Palestinian people do not have a government or leaders who legitimately represent their interests, and it sure as hell isn't Hamas. Will some Palestinians cheer and clap at the dead, or spit on them as they are paraded through Gaza? Yes they will. And they have. Many will also mourn because they loathe Hamas and know this will only make things worse. This is no different than how some Americans cheer at the dead in every single war we've ever fought. It's no different than the Israelis who set up lawn chairs to watch their government bomb Palestine and cheer them on, too. This doesn't mean Palestinians or Israelis or Americans are evil — it means some of them are giving in to their violent impulses, and their zealous feelings of righteous vengeance.
Solutions, you ask? I can’t say I have any. If you came here for that, I’m sorry. The two-state solution looks dead to me. A three-state solution makes some sense but feels out of the view of all the people who matter and could make it happen. I wish a one-state solution felt realistic — a world of Israelis and Arabs and Muslims and Jews living side by side with equal rights, fully integrated and defused of their hate, is a version of Israel that I would adore. But it seems less and less realistic with every new act of violence.
Am I pro-Israel or pro-Palestine? I have no idea.
I'm pro-not-killing-civilians.
I'm pro-not-trapping-millions-of-people-in-open-air-prisons.
I'm pro-not-shooting-grandmas-in-the-back-of-the-head.
I'm pro-not-flattening-apartment-complexes.
I'm pro-not-raping-women-and-taking-hostages.
I'm pro-not-unjustly-imprisoning-people-without-due-process.
I'm pro-freedom and pro-peace and pro- all the things we never see in this conflict anymore.
Whatever this is, I want none of it.
Luv Kothari retweeted
With many 🧩 dropping recently, a more complete picture is emerging of LLMs not as a chatbot, but the kernel process of a new Operating System. E.g. today it orchestrates:
- Input & Output across modalities (text, audio, vision)
- Code interpreter, ability to write & run programs
- Browser / internet access
- Embeddings database for files and internal memory storage & retrieval
A lot of computing concepts carry over. Currently we have single-threaded execution running at ~10Hz (tok/s) and enjoy looking at the assembly-level execution traces stream by. Concepts from computer security carry over, with attacks, defenses and emerging vulnerabilities.
I also like the nearest neighbor analogy of "Operating System" because the industry is starting to shape up similar:
Windows, OS X, and Linux <-> GPT, PaLM, Claude, and Llama/Mistral(?:)).
An OS comes with default apps but has an app store.
Most apps can be adapted to multiple platforms.
TLDR looking at LLMs as chatbots is the same as looking at early computers as calculators. We're seeing an emergence of a whole new computing paradigm, and it is very early.























