Founder & Co-CEO @ZylonPrivateGPT. Private AI for the Enterprise. Creator of Private GPT, 54K+ Github stars: https://xitter.cf/t.co/tHrUZNFvGW
Madrid, Spain
Joined April 2009
- Tweets965
- Following548
- Followers2.1K
- Likes1K
Pinned Tweet
Privacy is a top concern when discussing ChatGPT-like tools with professionals. With this working proof of concept, I show how open-source models and tools like @langchain enable a 100% local execution, ensuring your data never leaves your environment. github.com/imartinez/private…
Iván Martínez retweeted
Big day for Ollama! When we started, open models and the open source AI ecosystem were in their early days with few believers.
Our belief in open source has never wavered.
With today's fundraising announcement and our 9M+ active builders, we’re ready to scale open models into AI that you can own.
All aboard open models!
🧵
ALT Ollama is here to accelerate open models!
Learn how to run PrivateGPT local AI inside Microsoft Word, PowerPoint, and Excel 😎
Convenient, useful, and private. Honestly, I love it.
In case you didn't have a small side project for the weekend, now you have one 😆.
Happy to support you in our Discord channel
Local, natural-language database querying is one of the features I enjoy most in the new PrivateGPT 1.0.
It comes ready-to-use (via API & UI), with support for MSSQL, Postgres, DB2, and MySQL.
Give it a try this weekend!
docs.privategpt.dev/tools/da…
Iván Martínez retweeted
PrivateGPT is back!
In 2023, it became the first offline RAG implementation and a breakout open source project.
Then we went quiet in 2024.
Today, PrivateGPT 1.0 is here: a full application API layer for local AI.
github.com/zylon-ai/private-…
Iván Martínez retweeted
🚀 MAJOR NEWS: Strategic partnership with @TelefonicaTech to revolutionize enterprise AI!
When one of Europe's largest tech giants validates your approach, you know the market is shifting toward private AI workspaces where data sovereignty is ensured 🔐
telefonicatech.com/en/news/w…
Iván Martínez retweeted
🫵 Join us for our next event on #PrivateAI hosted by
@GoogleStartups Madrid on June 9th at 17:00 for great talks and even greater food and drinks networking afterwards 🍻
Register now! lu.ma/7sym9e4r
Understanding MCP architectures helps teams make smarter AI integration decisions. The key factor is where the LLM processes data. This diagram different setups - no "wrong" choice if you're informed about the tradeoffs.
More details:
zylon.ai/blog/mcp-architectu…
Iván Martínez retweeted
Episode 1 of our "Zylon Success Stories" series with @UCBerkeley's @GoldmanSchool who built ChatGSPP using our open-source PrivateGPT tech - a fully private #AI chatbot running on-prem that helps students & faculty access information in a quick & easy way youtu.be/2X3TvcVWAnA
🤯 What our team at @ZylonPrivateGPT just built has shattered every boundary of on-prem enterprise AI.
Agentic workflows, real-time collaboration, editable canvas, inline AI support, multi-modality...
... 100% on YOUR servers.
No more "quality or privacy" dichotomy. 💪
Iván Martínez retweeted
💪 Yesterday: "I need to do this."
🦾 Today: "I need to ask AI to do this."
🧠 Tomorrow: "I need to explain the problem to AI so it can solve it."
🤖 Near future: "I need to update AI on our company vision so it can identify and solve our next critical problems."
🗒️👇
Iván Martínez retweeted
With us your company data NEVER leaves your servers, no matter what LLM we use.
Our on-prem AI runs ENTIRELY local in YOUR infrastructure with zero outbound connections.
It's not marketing—it's architecture.
True data sovereignty means complete control.
zylon.ai/blog/why-aren-t-we-…
Iván Martínez retweeted
Announcing @MistralAI Small 3.1: multimodal, multilingual, Apache 2.0, the best model in its weight class.
💻 Lightweight: Runs on a single RTX 4090 or a Mac with 32GB RAM, perfect for on-device applications.
🗣️ Fast-Response Conversations: Ideal for virtual assistants and other applications where quick, accurate responses are essential.
⚡ Low-Latency Function Calling: Capable of rapid function execution within automated or agentic workflows.
🔍 Specialized Fine-Tuning: Customizable for specific domains.
🧠 Advanced Reasoning Foundation: Inspires community innovation, with models like DeepHermes 24B by Nous Research built on Mistral Small 3. We're releasing base and instruct checkpoints for Mistral Small 3.1 to support further downstream customization of the model.
Iván Martínez retweeted
Announcing the latest DeepHermes Preview models, DeepHermes 24B and 3B!
huggingface.co/collections/N…
These new models are Hybrid Reasoners - meaning you can toggle ON and OFF the long chain of thought reasoning whenever you want a short, intuitive answer, or a long, well reasoned higher accuracy answer, now available on our API and to download on HuggingFace.
Iván Martínez retweeted
🔍 Knowing beats guessing every time.
We've made significant strides with Opik by @Cometml. Our latest iteration brought a 52% improvement in context recall and enhanced measurement capabilities. Iterating, measuring, and optimizing—this is how we drive excellence to #PrivateAI
Iván Martínez retweeted
Just launched: RFPs automation with Zylon's Bulk Q&A Agent Flow! 🚀
Our new private AI feature extracts questions from RFPs, searches your knowledge base, and generates accurate responses with sources—all in minutes.
See how engineering firms are saving 1000+ hours annually:
Iván Martínez retweeted
Today, we release QwQ-32B, our new reasoning model with only 32 billion parameters that rivals cutting-edge reasoning model, e.g., DeepSeek-R1.
Blog: qwenlm.github.io/blog/qwq-32…
HF: huggingface.co/Qwen/QwQ-32B
ModelScope: modelscope.cn/models/Qwen/Qw…
Demo: huggingface.co/spaces/Qwen/Q…
Qwen Chat: chat.qwen.ai
This time, we investigate recipes for scaling RL and have achieved some impressive results based on our Qwen2.5-32B. We find that RL training con continuously improve the performance especially in math and coding, and we observe that the continous scaling of RL can help a medium-size model achieve competitieve performance against gigantic MoE model. Feel free to chat with our new models and provide us feedback!
Iván Martínez retweeted
8.5% of AI prompts contain sensitive data. Yet, 64% of employees use Cloud AI tools like ChatGPT without safeguards.
CISOs, ignoring this = risk ⚠️
Stop compromising your most valuable assets by using Cloud-based AI providers.
#PrivateAI is the solution to secure your data 🔐
