Distributed machine learning platform

Overview
Issues
  • init script issue

    init script issue

    The init script produces:

    fatal: reference is not a tree: 4e8093554080bde69bc66ca15f6fe63de573ef8a
    Unable to checkout '4e8093554080bde69bc66ca15f6fe63de573ef8a' in submodule path 'veles/znicz'
    Failed to checkout submodules, retrying...
    fatal: reference is not a tree: 4e8093554080bde69bc66ca15f6fe63de573ef8a
    Unable to checkout '4e8093554080bde69bc66ca15f6fe63de573ef8a' in submodule path 'veles/znicz'
    Failed to checkout submodules, retrying...
    fatal: reference is not a tree: 4e8093554080bde69bc66ca15f6fe63de573ef8a
    Unable to checkout '4e8093554080bde69bc66ca15f6fe63de573ef8a' in submodule path 
    ...
    

    during a fresh install.

    opened by vshvedov 5
  • Refactor InputJoiner

    Refactor InputJoiner

    Add link_inputs method to InputJoiner class, add input_0, input_1, ..., offset_0, offset_1, ..., length_0, length_1, ... properties for each of the input.

    enhancement 
    opened by ajkxyz 2
  • Add automatically saving plotters to pdf after training

    Add automatically saving plotters to pdf after training

    It is necessary to add the ability to save the results in PDF after the trainings, in any case. This is particularly necessary for a long time training models (for example, imagenet)

    enhancement wontfix migrated from jira 
    opened by Lyubava 1
  • Add the way to extract dereferenced, real unit objects from links_from/to

    Add the way to extract dereferenced, real unit objects from links_from/to

    Unit.links_from and Unit.links_to may contain weak references in order to enable garbage collection. It may confuse users who try to read linked units.

    enhancement 
    opened by vmarkovtsev 1
  • Fix runing veles from python2

    Fix runing veles from python2

    [email protected]:~/Projects/Veles$ python Python 2.7.6 (default, Jun 22 2015, 17:58:13) [GCC 4.8.2] on linux2 Type "help", "copyright", "credits" or "license" for more information.

    import veles veles/init.py:67: UserWarning: Cannot expand variables generated by Git, setting them to None warn("Cannot expand variables generated by Git, setting them to None") kwargs={"dry_run": "init", "snapshot": file_name, "stealth": True} Traceback (most recent call last): File "", line 1, in NameError: name 'file_name' is not defined kwargs={"dry_run": "init", "stealth": True} path_to_model = "veles/znicz/samples/MNIST/mnist.py" launcher = veles(path_to_model, **kwargs) Traceback (most recent call last): File "", line 1, in File "veles/init.py", line 179, in call Main = import_module("veles.main").Main TypeError: 'NoneType' object is not callable

    bug invalid 
    opened by Lyubava 0
  • Fix ImagenetAE fine tuning and loader

    Fix ImagenetAE fine tuning and loader

    Data is in a new format after refactoring preparation_imagenet, so we need to fix loader in ImagenetAE. And plotters does not work at fine tuning stage.

    invalid 
    opened by Lyubava 0
  • Can't install on ubuntu 16.04

    Can't install on ubuntu 16.04

    using

    wget -O - https://velesnet.ml/ubuntu-install.sh | bash -
    

    got

    ...
    Reading package lists... Done
    W: The repository 'https://velesnet.ml/apt xenial Release' does not have a Release file.
    N: Data from such a repository can't be authenticated and is therefore potentially dangerous to use.
    N: See apt-secure(8) manpage for repository creation and user configuration details.
    E: Failed to fetch https://velesnet.ml/apt/dists/xenial/main/binary-amd64/Packages  404  Not Found
    E: Some index files failed to download. They have been ignored, or old ones used instead.
    Reading package lists... Done
    Building dependency tree       
    Reading state information... Done
    E: Unable to locate package python3-veles
    

    Is project even alive? As for now it seems the only ML framework with full OpenCL support - would sad if you buried it.

    opened by inferrna 4
  • veles documentation is unavailable

    veles documentation is unavailable

    Hello,

    on veles website, the "docs" tab leads to a 404 : https://velesnet.ml/docs Same problem with https://velesnet.ml/jenkins

    I just wanted to warn you Many thanks !

    opened by LTMXcitrus 1
  • Does veles supports opencl 1.1 EP

    Does veles supports opencl 1.1 EP

    Hello,

    we are looking for a deep learning platform to train against a vivante gc2000 gpu from the imx6q board which supports only opencl 1.1 Embedded Profile.

    Does Veles supports that limited version of opencl?

    Thanks

    opened by Mezzano 0
  • description cause mis-understanding.

    description cause mis-understanding.

    Veles actually is a deep learning(DNN) application. But its description says "Distributed machine learning platform". Deep Learning is a subset of Machine Learning, so it should be "Distributed deep learning platform". Thanks.

    opened by glke 1
  • Fix registration on VelesForge

    Fix registration on VelesForge

    ERROR:tornado.application:Future <tornado.concurrent.Future object at 0x7fa0a9283518> exception was never retrieved: tornado.iostream.StreamClosedError ERROR:tornado_smtpclient.client: Traceback (most recent call last): File "/usr/local/lib/python3.4/dist-packages/tornado_smtpclient/client.py", line 101, in getreply response = yield self.stream.read_until(CRLF) File "/usr/local/lib/python3.4/dist-packages/tornado/gen.py", line 870, in run value = future.result() File "/usr/local/lib/python3.4/dist-packages/tornado/concurrent.py", line 215, in result raise_exc_info(self._exc_info) File "", line 3, in raise_exc_info tornado.iostream.StreamClosedError ERROR:tornado.application:Uncaught exception GET /forge/service?query=register&[email protected] (127.0.0.1) HTTPServerRequest(protocol='http', host='velesnet.ml', method='GET', uri='/forge/service?query=register&[email protected]', version='HTTP/1.0', remote_ip='127.0.0.1', headers={'Host': 'velesnet.ml', 'Cookie': '__utma=223305372.1977894979.1433147698.1447756335.1447842103.14; __utmc=223305372; __utmz=223305372.1447677400.9.2.utmcsr=t.co|utmccn=(referral)|utmcmd=referral|utmcct=/Ubbg2QnW6l; ga=GA1.2.1977894979.1433147698; gat=1', 'Accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,/;q=0.8', 'Accept-Encoding': 'gzip, deflate, sdch', 'Accept-Language': 'en-US,en;q=0.8', 'X-Forwarded-For': '212.44.150.238', 'Connection': 'close', 'Upgrade-Insecure-Requests': '1', 'User-Agent': 'Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Ubuntu Chromium/45.0.2454.101 Chrome/45.0.2454.101 Safari/537.36'}) Traceback (most recent call last): File "/usr/local/lib/python3.4/dist-packages/tornado_smtpclient/client.py", line 101, in getreply response = yield self.stream.read_until(CRLF) File "/usr/local/lib/python3.4/dist-packages/tornado/gen.py", line 870, in run value = future.result() File "/usr/local/lib/python3.4/dist-packages/tornado/concurrent.py", line 215, in result raise_exc_info(self._exc_info) File "", line 3, in raise_exc_info tornado.iostream.StreamClosedError During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.4/dist-packages/tornado/web.py", line 1369, in _stack_context_handle_exception raise_exc_info((type, value, traceback)) File "", line 3, in raise_exc_info File "/usr/local/lib/python3.4/dist-packages/tornado/stack_context.py", line 314, in wrapped ret = fn(_args, *_kwargs) File "/usr/local/lib/python3.4/dist-packages/tornado/web.py", line 1581, in future_complete f.result() File "/usr/local/lib/python3.4/dist-packages/tornado/concurrent.py", line 215, in result raise_exc_info(self._exc_info) File "", line 3, in raise_exc_info File "/usr/local/lib/python3.4/dist-packages/tornado/gen.py", line 876, in run yielded = self.gen.throw(_exc_info) File "/usr/lib/python3/dist-packages/veles/forge/forge_server.py", line 243, in get yield self.handlersself.get_argument("query") File "/usr/local/lib/python3.4/dist-packages/tornado/gen.py", line 870, in run value = future.result() File "/usr/local/lib/python3.4/dist-packages/tornado/concurrent.py", line 215, in result raise_exc_info(self._exc_info) File "", line 3, in raise_exc_info File "/usr/local/lib/python3.4/dist-packages/tornado/gen.py", line 876, in run yielded = self.gen.throw(_exc_info) File "/usr/lib/python3/dist-packages/veles/forge/forge_server.py", line 163, in handle_register smtp = yield self.server.smtp() File "/usr/local/lib/python3.4/dist-packages/tornado/gen.py", line 870, in run value = future.result() File "/usr/local/lib/python3.4/dist-packages/tornado/concurrent.py", line 215, in result raise_exc_info(self._exc_info) File "", line 3, in raise_exc_info File "/usr/local/lib/python3.4/dist-packages/tornado/gen.py", line 876, in run yielded = self.gen.throw(_exc_info) File "/usr/lib/python3/dist-packages/veles/forge/forge_server.py", line 641, in smtp yield smtp.connect(self.smtp_host, int(self.smtp_port)) File "/usr/local/lib/python3.4/dist-packages/tornado/gen.py", line 870, in run value = future.result() File "/usr/local/lib/python3.4/dist-packages/tornado/concurrent.py", line 215, in result raise_exc_info(self._exc_info) File "", line 3, in raise_exc_info File "/usr/local/lib/python3.4/dist-packages/tornado/gen.py", line 876, in run yielded = self.gen.throw(_exc_info) File "/usr/local/lib/python3.4/dist-packages/tornado_smtpclient/client.py", line 136, in connect (code, msg) = yield self.getreply() File "/usr/local/lib/python3.4/dist-packages/tornado/gen.py", line 870, in run value = future.result() File "/usr/local/lib/python3.4/dist-packages/tornado/concurrent.py", line 215, in result raise_exc_info(self._exc_info) File "", line 3, in raise_exc_info File "/usr/local/lib/python3.4/dist-packages/tornado/gen.py", line 876, in run yielded = self.gen.throw(*exc_info) File "/usr/local/lib/python3.4/dist-packages/tornado_smtpclient/client.py", line 105, in getreply raise smtplib.SMTPServerDisconnected("Connection unexpectedly closed") smtplib.SMTPServerDisconnected: Connection unexpectedly closed ERROR:tornado.access:500 GET /forge/service?query=register&[email protected] (127.0.0.1) 127300.53ms

    bug 
    opened by Lyubava 0
Owner
Samsung
Samsung Electronics Co.,Ltd.
Samsung
A fast, distributed, high performance gradient boosting (GBT, GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, used for ranking, classification and many other machine learning tasks.

Light Gradient Boosting Machine LightGBM is a gradient boosting framework that uses tree based learning algorithms. It is designed to be distributed a

Microsoft 14.1k Aug 10, 2022
Deep Scalable Sparse Tensor Network Engine (DSSTNE) is an Amazon developed library for building Deep Learning (DL) machine learning (ML) models

Amazon DSSTNE: Deep Scalable Sparse Tensor Network Engine DSSTNE (pronounced "Destiny") is an open source software library for training and deploying

Amazon Archives 4.4k Jul 30, 2022
A library for creating Artificial Neural Networks, for use in Machine Learning and Deep Learning algorithms.

iNeural A library for creating Artificial Neural Networks, for use in Machine Learning and Deep Learning algorithms. What is a Neural Network? Work on

Fatih Küçükkarakurt 5 Apr 5, 2022
Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library, for Python, R, Java, Scala, C++ and more. Runs on single machine, Hadoop, Spark, Dask, Flink and DataFlow

eXtreme Gradient Boosting Community | Documentation | Resources | Contributors | Release Notes XGBoost is an optimized distributed gradient boosting l

Distributed (Deep) Machine Learning Community 23k Aug 6, 2022
Machine Learning Platform for Kubernetes

Reproduce, Automate, Scale your data science. Welcome to Polyaxon, a platform for building, training, and monitoring large scale deep learning applica

polyaxon 3.1k Aug 4, 2022
Gesture Recognition Toolkit (GRT) is a cross-platform, open-source, C++ machine learning library designed for real-time gesture recognition.

Gesture Recognition Toolkit (GRT) The Gesture Recognition Toolkit (GRT) is a cross-platform, open-source, C++ machine learning library designed for re

Nicholas Gillian 780 Aug 5, 2022
Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Scala, Go, Javascript and more

Apache MXNet (incubating) for Deep Learning Apache MXNet is a deep learning framework designed for both efficiency and flexibility. It allows you to m

The Apache Software Foundation 20k Aug 5, 2022
An Open Source Machine Learning Framework for Everyone

Documentation TensorFlow is an end-to-end open source platform for machine learning. It has a comprehensive, flexible ecosystem of tools, libraries, a

null 167.1k Aug 13, 2022
An open source machine learning library for performing regression tasks using RVM technique.

Introduction neonrvm is an open source machine learning library for performing regression tasks using RVM technique. It is written in C programming la

Siavash Eliasi 33 May 31, 2022
A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.

Website | Documentation | Tutorials | Installation | Release Notes CatBoost is a machine learning method based on gradient boosting over decision tree

CatBoost 6.7k Aug 12, 2022
A lightweight C++ machine learning library for embedded electronics and robotics.

Fido Fido is an lightweight, highly modular C++ machine learning library for embedded electronics and robotics. Fido is especially suited for robotic

The Fido Project 412 Jun 25, 2022
High performance, easy-to-use, and scalable machine learning (ML) package, including linear model (LR), factorization machines (FM), and field-aware factorization machines (FFM) for Python and CLI interface.

What is xLearn? xLearn is a high performance, easy-to-use, and scalable machine learning package that contains linear model (LR), factorization machin

Chao Ma 3k Aug 1, 2022
Feature Store for Machine Learning

Overview Feast (Feature Store) is an operational data system for managing and serving machine learning features to models in production. Please see ou

Feast 3.5k Aug 11, 2022
In-situ data analyses and machine learning with OpenFOAM and Python

PythonFOAM: In-situ data analyses with OpenFOAM and Python Using Python modules for in-situ data analytics with OpenFOAM 8. NOTE that this is NOT PyFO

Argonne Leadership Computing Facility - ALCF 105 Aug 5, 2022
CNStream is a streaming framework for building Cambricon machine learning pipelines

CNStream is a streaming framework for building Cambricon machine learning pipelines

Cambricon Technologies 174 Aug 4, 2022
SecMML: Secure MPC(multi-party computation) Machine Learning Framework

SecMML 介绍 SecMML是FudanMPL(Multi-Party Computation + Machine Learning)的一个分支,是用于训练机器学习模型的高效可扩展的安全多方计算(MPC)框架,基于BGW协议实现。此框架可以应用到三个及以上参与方联合训练的场景中。目前,SecMM

null 77 Jul 14, 2022
In this tutorial, we will use machine learning to build a gesture recognition system that runs on a tiny microcontroller, the RP2040.

Pico-Motion-Recognition This Repository has the code used on the 2 parts tutorial TinyML - Motion Recognition Using Raspberry Pi Pico The first part i

Marcelo Rovai 16 Jun 18, 2022
Edge ML Library - High-performance Compute Library for On-device Machine Learning Inference

Edge ML Library (EMLL) offers optimized basic routines like general matrix multiplications (GEMM) and quantizations, to speed up machine learning (ML) inference on ARM-based devices. EMLL supports fp32, fp16 and int8 data types. EMLL accelerates on-device NMT, ASR and OCR engines of Youdao, Inc.

NetEase Youdao 176 Jul 21, 2022
A flexible, high-performance serving system for machine learning models

XGBoost Serving This is a fork of TensorFlow Serving, extended with the support for XGBoost, alphaFM and alphaFM_softmax frameworks. For more informat

iQIYI 120 Aug 1, 2022