
AI Solutions Architect at @nvidia. Working on LLMs, accelerators and AI. Before @graphcoreai, @amazon, PhD @imperialcollege. All views are my own. He/him.
London
Joined November 2011
- Tweets885
- Following1.2K
- Followers812
- Likes1.9K
Pinned Tweet
Time for a new challenge: I've joined @nvidia as Solutions Architect for Conversational AI 🗣️🤖🧠!
I look forward to helping the AI community to use NVIDIA's GPUs for language applications. I'll be based in London, do reach out if you come over!
2
24
1,224
We are live discussing with the @bielikllm team about their Bielik models and how they compressed their Bielik 11B to 7B. Join us to ask life about pruning, distillation, post-training alignment, etc
teapaw.org/i/broadcasts/1pKkOOaXw…
54
Sergio Perez retweeted
🟢 ¡APÚNTATE AL GTC 2025!
El próximo 17-21 MARZO volverá el gran evento de NVIDIA. Un montón de ponencia de IA, robótica y mucho más!
Y como cada año, quien se registre conmigo podrá conseguir un gran premio!
Todos los detalles en este hilo 👇🧵
It's really inspiring to be working with @igeniusai. I look forward to all the training and inference that will come out of their new Colosseum supercomputer with Grace Blackwell Superchips! Great news for Italy and Europe. – at Reading, England
Unveiling Colosseum, one of the world’s largest #NVIDIADGX AI supercomputers, built in collaboration with @NVIDIA, and powered by NVIDIA Grace Blackwell Superchips, for the training and deployment of advanced models in highly regulated industries. Read more in the press release: igenius.ai/press-releases/ai…
1
5
301
Are you interested in AI Inference and want to dive deeper? Dima Mironov and I have created a practical course about "Sizing LLM Inference Systems".
Check it out and let us know what you think: learn.nvidia.com/courses/cou…
1
1
162
The motivation is to help AI engineers to estimate the number of GPUs needed to run an AI model under certain requests/second or latency requirements.
The course is highly practical, with several notebooks using python, bash and deployment of @nvidia Inference Microservices.
1
89
Join us at the AI Engineer meetup in London on the 17th October!
I'll be presenting about AI inference and how companies leverage cloud AI services or do-it-yourself strategies. As a bridge between both, I'll talk about @nvidia NIMs and its benefits.
lu.ma/scxafc58
AI Engineer London meetup is back again on October 17th. Big thanks to NVIDIA and again Cloudflare for supporting us.
Apply for a spot here: lu.ma/scxafc58
3
384
Even after 4 years working in the semiconductor industry, I've learned a lot from reading this Economist's overview.
The end of Moore's law, Dennard's scaling, new ideas to reach a trillion transistors, specialized chips for AI... This overview is superb.
AI has returned chipmaking to the heart of computer technology. But it is time for some new ideas.
Read our latest Technology Quarterly to learn how advances in chipmaking, both incremental and radical, can keep the exponential engine humming econ.st/4gIs1Ib 👇
Join us on the 3rd of October at the JADE day in University of Oxford! I'll give a keynote about GPUs for scientific computing and AI.
📢Keynote Speaker for JADE Day 2024: Sergio Perez, NVIDIA
Sergio will give a talk on how NVIDIA enables scientific breakthroughs covering #GenAI, #GPUs, software libraries #NVIDIA has developed for scientific researchers & more
🔗cvent.me/oLgDW8
4
280
Sergio Perez retweeted
Introducing ChatQA 2, a Llama3-based model with a 128K context window, designed to close the gap between open LLMs and leading proprietary models like GPT-4-Turbo in both long-context and RAG capabilities.
The long-context capability of LLMs is sometimes viewed as a rival to RAG, but from a pragmatic perspective, they complement each other. RAG efficiently retrieves relevant contexts for query-based tasks from millions or billions of tokens, a feat long-context LLMs cannot achieve. Meanwhile, long-context LLMs excel at summarizing entire documents, where RAG may fall short. Thus, A state-of-the-art LLM should excel in both capabilities.
Highlights:
- The Llama3-ChatQA-2-70B model achieves accuracy comparable to GPT-4-Turbo-2024-0409 on real-world long-context tasks, and surpasses it on the ChatRAG benchmark.
- We find the long-context retriever can alleviate the top-k context fragmentation issue in RAG, further improving RAG-based results for long-context understanding tasks.
- We provide extensive comparisons between RAG and long-context solutions using state-of-the-art long-context LLMs.
Further Information:
- Paper: arxiv.org/abs/2407.14482
- Model weights & training blend: To be released soon!
Eager to try Llama 3.1 405B? Start calling it now with our inference endpoints: build.nvidia.com/explore/dis…
With @NVIDIA AI Foundry, you can customise Llama 3.1 with your data: blogs.nvidia.com/blog/ai-fou…
1
126
Hi, any recommendations about VSCode extensions for OpenAI-compatible LLMs? I've been trying llm-vscode from @huggingface but I get errors github.com/huggingface/llm-v…
102
"Graphcore today announced that the company has been acquired by SoftBank Group Corp"
Best wishes for my former colleagues in this new era for @graphcoreai
Exciting news: Graphcore joins @SoftBank_Group to build next generation of AI compute. graphcore.ai/posts/graphcore…
Are you in the Benelux area this week? 🇧🇪🇳🇱🇱🇺
Join us in Brussels at the @RedHat Tech Day to discuss about AI inference with NIMs and how to deploy them for production!
events.redhat.com/profile/fo…
145
It is still not late to virtually register for GTC! Jensen's keynote is on Monday 18th at 8pm in London or 9pm in Madrid. Register for free to watch it while having dinner in Europe:
nvidia.com/gtc/?ncid=GTC-NV2…
I've heard it is full of AI announcements, don't miss it 😉
1
181
Sergio Perez retweeted
🟢 ¡VUELVE EL NVIDIA GTC 2024! 🟢
Y un año más podrás ganar una GPU RTX4090 registrándote gratis al evento!
Si quieres asistir a uno de los mayores eventos de computación, IA, gráficos en tiempo real, y mucho más...
lee el siguiente hilo que te cuento. 👀🧵👇
📢Check out this great position at my team at NVIDIA 📢
We are hiring a solutions architect specialised in LLMs and artificial intelligence. It is a remote position in EMEA.
Let me know if you would like to discuss about it 🙂
nvidia.wd5.myworkdayjobs.com…
201
I've worked with Alex and he's an amazing ML engineer, really strong both in AI and software engineering.
If you're looking into hiring ML engineers, he'd be an excellent candidate! 💪
I am looking / on the market for a new ML Engineer / Researcher remote (EU times) role! 👨🔬
You can find my resume here 👉 afmck.in/cv.pdf
If I fit the bill for a role you have open, or someone you know has, please reach out!
Would appreciate sharing and RTs 🙏
3
848
Sergio Perez retweeted
today I learned that there’s a literal GPU church with 4k H100s in Barcelona
h/t @tugot17
Readers added context they thought people might want to know
The picture is of MareNostrum 4, a supercomputer installed in 2017 and has Nvidia Volta & AMD Radeon Instinct MI50 GPUs, not H100 GPUs:
bsc.es/marenostrum/ma…
The MareNostrum 5 does use a total of 4480 Nvidia Hopper/H100 GPUs (1120 nodes with 4 gpus each), but the datacenter is not in a chapel:
bsc.es/marenostrum/ma…
hpcwire.com/2023/05/23/mar…























