Craque (@techcraque) header
Craque (@techcraque) profile picture
Joined March 2024
Photo by Craque (@techcraque)Photo by Craque (@techcraque)Photo by Craque (@techcraque)Photo by Craque (@techcraque)Photo by Craque (@techcraque)Photo by Craque (@techcraque)Photo by Craque (@techcraque)Photo by Craque (@techcraque)Photo by Craque (@techcraque)Photo by Craque (@techcraque)
i'm not quite done with this coz well i lazed out, and well, college. anyways, this block sums up the basic algo in flash attn 1, i'll commit this in some time was too lazy to type the entire algo in simple, so i juss took the snippet of the algo might do a writeup......
moving on, as flash attn' gets implemented here's a from iclr '24 this will be the improvement part, implementation coming up tonight (most likely 🤞). all these components will work together eventually.......
2
6
223
Craque retweeted
tawakkul in the face of uncertainty? this is what its all about, lessgooo
3
27
425
Craque retweeted
🚨🎙️| Max Verstappen: “I REALLY like Barcelona style of play, that’s a club that’s in my heart” 🔵🔴
26
463
42
10,886
92,817
india put up a formidable total, hope bumrah gets 2-3 wickets early, we can win then head won't be a problem tbh, we need to get Smith out
4
3
1
105
4,678
Craque retweeted
People who hurt you in the past do not possess any part in your present.
1
7
122
1
7
1
34
495
Craque retweeted
ye 19 nov ki itni tweets kyu hai? kuch hua tha kya is din?
2
1
13
375
We got gta 6 before gta 7 😳😳😳🔥🔥🔥🔥🔥🔥
1
5
30
926
Craque retweeted
لما الكلام يكون بيوجع لدرجه انك متقدرش تقول لحد أنه اتقال لك
108
13,588
504
67,593
1,417,917
Craque retweeted
Need some Hyderabadi oomfs to invite me to their house and cook authentic Hyderabadi food
2
2
2
37
1,367
Craque retweeted
Otamendi, kevin de bruyne, fernandinho, silva, sterling, aguero...
1
1
12
683
Craque retweeted
2 3 new account interact kar rahe hai pta nhi kiske alt hai 😒
1
9
203
Craque retweeted
I JUST FREAKING LOVEE MATHEMATICS BROO LIKE UGGHHH IK I'M NOT GIVING YOU ENOUGH TIME BUT I LOVEE YOUUU SOO MUCHH ENGINEERING MATHEMATICS IS WAYY TOO BEAUTIFULLL, TRUE BEAUTYY
3
1
19
489
Craque retweeted
Went to my favorite masjid today
2
2
70
1,339
online softmax basic implementation it's a 2 pass algo pass 1- maintain two variables- the running maximum (say m) and the denominator (s = sum j exp(x_j − m)), updating both as we process the scores. pass 2: Calculate each probability: P_i = exp(x_i − m)/s 1/n
good read, was totally out of touch from ml sys stuff, had to annotate and write things down to get the mental model back will finish the code for this by night........
1
5
20
463
pedri fans unite!
15
252
3
1,660
15,740
Craque retweeted
Kal Monday hai
2
2
23
378
Craque retweeted
Life lately :
6
4
33
409
Craque retweeted
Call me dramatic but i delete messages when i’m left on seen or delivered for too long.
144
1,608
196
9,145
224,124
Craque retweeted
I recorded a message for my kids
34
1
146
3,364