ReproIndex

We have released a new CM-MLPerf automation to benchmark commodity hardware for AI performance, power and cost efficiency - it helped to automate ~90% of MLPerf inference v4.0 submissions while achieving several top performance and power results: linkedin.com/pulse/new-cm-ml…

Wow, #ChatGPT knows how to run #MLPerf benchmarks using the @MLCommons Collective Knowledge framework! Join our weekly conf-calls to learn how to run the MLPerf inference benchmark and automate your v3.0 submissions (deadline March 3): groups.google.com/g/collecti… #CollectiveKnowledge

Please help the community to reproduce and validate accepted research papers at @ASPLOSConf 2023 !!!

Asking for a favor to test our automated workflow for the #MLPerf inference benchmark from @MLCommons with a live @wandb dashboard before students run it at the @SCCompSC in a few days: github.com/mlcommons/ck/blob… . Thank you for supporting this community project!

Please subscribe to our mailing list and weekly meetings here: forms.gle/i5gCDtBC8gMtcvRw6 - your feedback is very important to us!

I am so excited to be preparing a new working group at @MLCommons to help the community #modularize ML & AI systems and automate their #benchmarking, #optimization and #deployment in the real world. Join this community effort at github.com/mlcommons/ck/blob… !

I am very pleased to announce the release of the next generation of the @MLCommons CK framework to modularize AI&ML systems and automate their benchmarking, optimization and deployment: linkedin.com/pulse/releasing… via @LinkedIn

Self-nominations for the @ASPLOSConf'21 Artifact Evaluation Committee are open! We are looking for senior students, postdocs and engineers to help with this reproducibility initiative. You can find more info at cTuning.org/ae/asplos2021.ht… . Please respond before December 16th! Thanks

I am honored that the #CollectiveKnowledge project overview was accepted for the Philosophical Transactions of the @RoyalSociety, the world's longest-running journal since it started in 1665. The preprint is available at @ArXiv and @PapersWithCode : paperswithcode.com/paper/col… .

This is such a great course! It helped our collaborative project with @Raspberry_Pi to teach students how to use ML to build more efficient computer systems: cknowledge.io/use-ml-to-opti… . Thank you @AndrewYNg !

We have released all AI and ML components in the #CollectiveKnowledge format in a single @github repository as suggested by our users (portable workflows, packages, automation actions, adaptive containers, etc): github.com/ctuning/ai . Happy hacking ;) !

I am very excited to share the news about the #CollectiveKnowledge project and the CK-powered automation of #MLPerf submissions: linkedin.com/posts/grigorifu… . Please help us shape the future of the CK project by answering a few questions here: docs.google.com/forms/d/e/1F… ! Thank you!

You can now report failing or working AI & ML packages, MLPerf workflows, program pipelines, Docker images and other CK components shared by our users at cKnowledge.io! See these examples: * cknowledge.io/c/program/obje… * cknowledge.io/c/docker/mlper… * cknowledge.io/c/docker/objec…

The slides from the FastPath'20 talk about "enabling reproducible ML and Systems research: the good, the bad and the ugly": doi.org/10.5281/zenodo.40057… #reproducibility #reusability #machinelearning #systems #collectiveknowledge #fair

Feel free to participate in the discussion on Reddit: reddit.com/r/MachineLearning…

I am excited to give an invited talk about my 10-year quest to enable #reproducible ML&systems research at the International Workshop on Performance Analysis of Machine Learning Systems (#FastPath 2020 co-located with #ISPASS) on August 23: linkedin.com/posts/grigorifu…