<h2>Overview</h2><p><a target="_blank" rel="noopener noreferrer" href="https://gitlab.com/mlrep/mldev">MLDev </a>facilitates running data science experiments, helps in results presentation and eases paper preparation for students, data scientists and researchers.</p><p>The MLDev software provides the following features to help with automating machine learning experiments:</p><ul><li>Configure stages and parameters of a data science experiment separately from your code</li><li>Conduct a repeatable experiment locally, on Google Colab or PaperSpace</li><li>Keep versions of your code, results and intermediate files on Google Drive (other repos coming soon)</li><li>Use a variety of pre-built templates to get started: see <a target="_blank" rel="noopener noreferrer" href="https://gitlab.com/mlrep/template-default">template-default</a> and <a target="_blank" rel="noopener noreferrer" href="https://gitlab.com/mlrep/template-intelligent-systems">template-intelligent-systems</a></li></ul><p>MLDev also provides experiment services that run alongside your pipeline:</p><ul><li>You can have the notifications via Telegram about the exeptions while training your model</li><li>Keep updated on current experiment state using TensorBoard (even on Colab)</li><li>Deploy and demo your model with a model controller (feature in progress)</li></ul><h2>Installation</h2><p>MLDev is currently in the Development stage and supports Ubuntu 16.04+.</p><p>Get the latest version of the install script to your local machine and run it.</p><pre><code class="language-bash">$ curl https://gitlab.com/mlrep/mldev/-/raw/develop/install_mldev.sh -o install_mldev.sh
$ chmod +x ./install_mldev.sh
$ ./install_mldev.sh base
</code></pre><p>You may be asked for <code>root</code> privileges if there are system packages to be installed.</p><p>Wait a couple of minutes until installation is done. You are almost ready to use our instrument, congrats!</p><p>Then get the default demo experiment</p><pre><code class="language-bash">$ mldev init &lt;new_folder&gt;</code></pre><p>Answer the questions the setup wizard asks or skip where possible.</p><p>Then run the default pipeline of the experiment</p><pre><code class="language-bash">$ cd &lt;new_folder&gt;
$ mldev run</code></pre><h2>How to use</h2><ul><li><a target="_blank" rel="noopener noreferrer" href="http://mlrep.gitlab.io/mldev/wikis/mldev-tutorial-basic.html">A Quickstart Tutorial for MLDev</a><ul><li><a target="_blank" rel="noopener noreferrer" href="http://mlrep.gitlab.io/mldev/wikis/mldev-tutorial-basic.html#contents">Contents</a></li><li><a target="_blank" rel="noopener noreferrer" href="http://mlrep.gitlab.io/mldev/wikis/mldev-tutorial-basic.html#installation-instructions">Installation instructions</a></li><li><a target="_blank" rel="noopener noreferrer" href="http://mlrep.gitlab.io/mldev/wikis/mldev-tutorial-basic.html#hello-world">Hello World!</a></li><li><a target="_blank" rel="noopener noreferrer" href="http://mlrep.gitlab.io/mldev/wikis/mldev-tutorial-basic.html#simple-classification-task-on-template-default">Simple classification task on template-default</a></li><li><a target="_blank" rel="noopener noreferrer" href="http://mlrep.gitlab.io/mldev/wikis/mldev-tutorial-basic.html#how-to-get-help">How to get help</a></li></ul></li><li><a target="_blank" rel="noopener noreferrer" href="http://mlrep.gitlab.io/mldev/mldev-user-guide.html">User Guide</a><ul><li><a target="_blank" rel="noopener noreferrer" href="http://mlrep.gitlab.io/mldev/wikis/mldev-user-guide.html">Contents</a></li><li><a target="_blank" rel="noopener noreferrer" href="http://mlrep.gitlab.io/mldev/wikis/mldev-user-guide.html#installation">Installation</a></li><li><a target="_blank" rel="noopener noreferrer" href="http://mlrep.gitlab.io/mldev/wikis/mldev-user-guide.html#experiment-setup">Experiment setup</a></li><li><a target="_blank" rel="noopener noreferrer" href="http://mlrep.gitlab.io/mldev/wikis/mldev-user-guide.html#running-the-experiment-locally">Running the experiment (locally)</a></li><li><a target="_blank" rel="noopener noreferrer" href="http://mlrep.gitlab.io/mldev/wikis/mldev-user-guide.html#running-the-experiment-google-colab">Running the experiment (Google Colab)</a></li><li><a target="_blank" rel="noopener noreferrer" href="http://mlrep.gitlab.io/mldev/wikis/mldev-user-guide.html#advanced-usage">Advanced usage</a></li></ul></li></ul><p>See more at the project <a target="_blank" rel="noopener noreferrer" href="https://gitlab.com/mlrep/mldev/-/wikis">Wiki</a></p><h2>Examples</h2><p>Here are several examples where MLDev has been applied</p><p><a target="_blank" rel="noopener noreferrer" href="https://github.com/Intelligent-Systems-Phystech/2021-Project-74">https://github.com/Intelligent-Systems-Phystech/2021-Project-74</a><br><a target="_blank" rel="noopener noreferrer" href="https://github.com/prog-autom/hidden-demo">https://github.com/prog-autom/hidden-demo</a>&nbsp;<br><a target="_blank" rel="noopener noreferrer" href="https://gitlab.com/prog-autom/ganrl_nps_solution/-/tree/mldev">https://gitlab.com/prog-autom/ganrl_nps_solution/-/tree/mldev</a>&nbsp;</p><p>More to come…</p><h2>License</h2><p>The source code of the project is licensed under Apache 2.0 license.</p><h2>How to contribute</h2><p>MLDev is a community open source project. Everyone is welcome to participate!&nbsp;</p><p>For python developers and ML enthusiasts we have tasks on experiment management and visualizations.</p><p>Data scientists may find it interesting to contribute model analysis and AutoML tool integrations.</p><p>You may also wish to get your MLDev experiment project listed on the project web page or contribute a reproduction of a research paper.&nbsp;</p><p>We also welcome data science experts and educators for collaboration on teaching materials and advice on the use of MLDev in the teaching process (like data analysis lab or homeworks).</p><p>Please, see also <a target="_blank" rel="noopener noreferrer" href="https://gitlab.com/mlrep/mldev/-/blob/develop/CONTRIBUTIONG.md">CONTRIBUTING.md</a> and <a target="_blank" rel="noopener noreferrer" href="http://mlrep.gitlab.io/mldev/#developer-docs">developer docs</a>.</p><h2>References and links</h2><p><a target="_blank" rel="noopener noreferrer" href="https://gitlab.com/mlrep/mldev">MLDev project webpage</a></p><p><a target="_blank" rel="noopener noreferrer" href="http://mlrep.gitlab.io/mldev">MLDev docs</a></p><p><a target="_blank" rel="noopener noreferrer" href="https://www.youtube.com/watch?v=Ahtkec-0kGE">A short talk on the goals of the MLDev project (in Russian)</a></p><p><a target="_blank" rel="noopener noreferrer" href="https://tiny.cc/mldev-colab">An example of running template-intelligent-systems on Google Colab</a></p><p><a target="_blank" rel="noopener noreferrer" href="https://www.youtube.com/watch?v=v-nbcdA37eA">Why reproducibility is important (roundtable, video in Russian)</a></p><p><a target="_blank" rel="noopener noreferrer" href="https://habr.com/ru/post/562262/">Reproducibility requirements from machine learning conferences (in Russian)</a></p><p><a target="_blank" rel="noopener noreferrer" href="https://www.youtube.com/watch?v=IbkTCFWYXYw">A short talk on conference requirements on reproducibility (in Russian)</a></p><p><a target="_blank" rel="noopener noreferrer" href="https://habr.com/ru/post/535694/">Why should you consider testing your ML code (in Russian)</a></p><p>slack ods.ai channel:&nbsp;#proj_mldev</p>

Anton Kh

<h2>moved to <a href="https://ods.ai/hubs/ml4sg" rel="noopener noreferrer" target="_blank">ods.ai/hubs/ml4sg</a></h2>

<p>u are welcome</p>

MLDev. Experiment reproduciblyFounded 4 years ago

MLDev. Experiment reproducibly
Founded 4 years ago