ElectropixTV retweeted
Essentially unlimited tokens? 🤯
Scaling Transformer to 1M tokens and beyond with RMT
Recurrent Memory Transformer retains information across up to 2 million tokens.
During inference, the model effectively utilized memory for up to 4,096 segments with a total length of 2,048,000 tokens—significantly exceeding the largest input size reported for transformer models (64K tokens for CoLT5 (Ainslie et al., 2023), and 32K tokens for GPT-4 (OpenAI, 2023)). This augmentation maintains the base model’s memory size at 3.6 GB in our experiments
abs: arxiv.org/abs/2304.11062
github: github.com/booydar/t5-experi…
ElectropixTV retweeted
Pen and Paper Exercises in Machine Learning
A handy collection of pen-and-paper exercises in machine learning. Covers foundational topics related to machine learning such as linear algebra, optimization, graphical models and etc...
This is a relevant resource for anyone who wants to brush up on ML foundational theories.
Get a free copy here: arxiv.org/abs/2206.13446
ElectropixTV retweeted
We’ve expanded our index to include tweets, YouTube, countless pdfs, and much more – allowing you to search more of the web in expressive and unusual ways
Here’s search over twitter (2/7)
ElectropixTV retweeted
Introducing Stable Diffusion XL beta!
Our latest image generation model, now available through our API, excels at photorealism & adds many cool features like enhanced face generation, minimal prompts & legible text.
Try out #SDXL in @DreamStudioAI now:
beta.dreamstudio.ai/
ElectropixTV retweeted
An AI-generated image wins the Sony World Photography Awards.
"Boris Eldagsen himself has come out and stated after the winning result was announced that this isn’t a photograph at all. It’s an image generated by inputs he provided to the Open AI photo tools".
Info+links 🧵👇
Readers added context they thought people might want to know
The image in the post did initially win the "Creative" category of the Open Competition of the Sony World Photography Awards. The image has since been scrubbed from the award's official website. The citation below describes the circumstances-
petapixel.com/2023/04/14/art…
ElectropixTV retweeted
One of my favorite moments from @ilyasut's interview by @dwarkesh_sp, exploring the role of AGI in human society 🎙️🌐
Who says tech talks can't be entertaining? Just sprinkle in some VFX! 📺👽
⚙ Made with Wonder Studio + Meta SAM + Mocha + After Effects
🧵 Workflow below 👇
ElectropixTV retweeted
It's no secret that Amazon collects huge amounts of data for targeted ads and Alexa. Follow these tips to reduce the amount of data they collect. pcworld.com/article/1663367/…
ElectropixTV retweeted
Jah Wobble's ideal playlist for walking along the Thames #BrianEno bbc.co.uk/programmes/p0fbpvf…
ElectropixTV retweeted
The year is 1440 and the Catholic Church has called for a 6 months moratorium on the use of the printing press and the movable type.
Imagine what could happen if commoners get access to books!
They could read the Bible for themselves and society would be destroyed.
This @theinformation scoop is crazy: a top google ai engineer quit recently because Google was training its AI on OpenAI’s ChatGPT.
The models are copying each other! Makes an even bigger mush of authorship
theinformation.com/articles/…
ElectropixTV retweeted
things we need for a good AGI future:
1) the technical ability to align a superintelligence
2) sufficient coordination among most of the leading AGI efforts
3) an effective global regulatory framework including democratic governance
ElectropixTV retweeted
"any sufficiently advanced technology is indistinguishable from magic" ✨ p sure i've never said this about anything we've made.
meet uncle rabbit—the first conversational holographic ai being powered by #ChatGPT @OpenAI powered by @LKGGlass
(hey @DBtodomundo 👋🏼)
ElectropixTV retweeted
I'm excited to announce the release of GPT4All, a 7B param language model finetuned from a curated set of 400k GPT-Turbo-3.5 assistant-style generation.
We release💰800k data samples💰 for anyone to build upon and a model you can run on your laptop!
Real-time Sampling on M1 Mac
ElectropixTV retweeted
I created an iOS shortcut that allows you to replace Siri with ChatGPT.
It’s super simple:
- Install extension
- Enter OpenAI API key
- Add to home
- Tell it what you want
Here’s a video of Hey GPT in action.
It blows Siri out of the water.
Install: icloud.com/shortcuts/8bcc297…
ElectropixTV retweeted
In “On Distillation of Guided Diffusion Models”, @Chenlin_Meng et al. trained a distilled version of #StableDiffusion to produce hi-quality images in just 2-4 steps, 20x speedup. This is huge since it’ll make generation very fast & cheap!
arxiv.org/abs/2210.03142
2-step samples:
ElectropixTV retweeted
⭐️Claude + AI Plugins⭐️
AI Plugins (the ones ChatGPT is using) are usable by ANY language model
It takes a tiny bit of prompt engineering, but here is @AnthropicAI's Claude using them
Code: gist.github.com/hwchase17/55…




























