Hopsworks - Data-Intensive AI platform with a Feature Store

Overview

Give us a star if you appreciate what we do

What is Hopsworks?
Quick Start
Development and Operational ML on Hopsworks
Docs
Who’s behind Hopsworks?
Open-Source
Join the community
Contribute

What is Hopsworks?

Hopsworks and its Feature Store are an open source data-intensive AI platform used for the development and operation of machine learning models at scale.

Quick Start

bash <(curl -s https://repo.hops.works/installer/latest/hopsworks-installer.sh)

Recommended minimum specification.

The Hopsworks Installer takes roughly 1-2 hrs to complete, depending on your bandwidth.

Installer Quick Start with Azure CLI or GCP CLI

bash <(curl -s https://repo.hops.works/installer/latest/hopsworks-cloud-installer.sh)

If you have the Azure or GCP CLI utilities installed (on a Linux machine), then the Hopsworks Cloud Installer (Hopsworks-cloud-installer.sh) will both install Hopsworks and provision the VMs in one command.

Hopsworks IDE Plugin

To work with the Hopsworks IDE plugin for IntelliJ/PyCharm, you can install it directly from the plugins menu of the IDE or clone it and follow the README.

Build with Maven

mvn install

Maven uses yeoman-maven-plugin to build both the front-end and the backend. Maven first executes the Gruntfile in the yo directory, then builds the back-end in Java. The yeoman-maven-plugin copies the dist folder produced by grunt from the yo directory to the target folder of the backend.

You can also build Hopsworks without the frontend (for Java EE development and testing):

mvn install -P-web

Development and Operational ML on Hopsworks

You can develop and run Python, Spark, and Flink applications on Hopsworks - in Jupyter notebooks, as jobs, or even notebooks as jobs. You can build production pipelines with the bundled Airflow, and even run ML training pipelines with GPUs in notebooks on Airflow. You can train models on as many GPUs as are installed in a Hopsworks cluster and easily share them among users.

Docs

Hopsworks documentation includes a user-guide, Feature Store documentation, and an Administrator Guide. There is also dedicated documentation for the Hopsworks Feature Store.

Hopsworks REST API is documented with Swagger and hosted by SwaggerHub.

To build and deploy swagger on your own Hopsworks instance you can follow the instructions found in this guide.

Who’s behind Hopsworks?

Hopsworks started as an open-source collaborative project at KTH University, RISE, and has more recently been taken on by Logical Clocks. Several funding bodies have helped contribute to its development including: European Commission (FP7, H2020), EIT, SSF, Vinnova and Celtic-Next.

Open-Source

Hopsworks is available under the AGPL-V3 license. In plain English this means that you are free to use Hopsworks and even build paid services on it, but if you modify the source code, you should also release your changes and any systems built around it as AGPL-V3.

Join the community

Contribute

We are building the most complete and modular ML platform available in the market and we count on your support to continuously improve Hopsworks. Feel free to give us suggestions, report bugs and add features to our library anytime.

We’re the best in what we do and want our community to succeed as well.
Our many thanks to the top contributors of Hopsworks!

Enjoy!

Comments
  • [HOPSWORKS-1276] Anaconda import yml file not working, removal of explicitly enabling python kernel

    [HOPSWORKS-1276] Anaconda import yml file not working, removal of explicitly enabling python kernel

    …licit enabling of python kernel

    Make sure there is no duplicate PR for this issue

    • Please check if the PR meets the following requirements
    • [ ] Adds tests for the submitted changes (for bug fixes & features)
    • [x] Passes the tests
    • [x] HOPSWORKS JIRA issue has been opened for this PR
    • [x] All commits have been squashed down to a single commit
    • Post a link to the associated JIRA issue

    • What kind of change does this PR introduce? (Bug fix, feature, docs update, ...)

    • What is the new behavior (if this is a feature change)?

    • Does this PR introduce a breaking change? (What changes might users need to make in their application due to this PR?)

    • Other information:

    opened by robzor92 12
  • Unable to create a project

    Unable to create a project

    Hi there,

    I am trying to deploy Hopsworks with the main objective of trying the Feature Store component. To do so, I have followed this guide where it is explained how to deploy the whole stack using a GCE image. I followed all the steps and managed to get an instance up and running.

    However, when I try to create a project with the service Feature Store (or any other service), nothing happens:

    hopsworks

    It stays like that and the project is never created. I have tried to create a user, thinking that maybe the problem is that I am not assigning users to the project, but the confirmation email is never sent to my email. I can see the pending request in the admin section, and can click on resend email, but nothing happens.

    The main problem is that I don't know how to debug this, could you point me in the correct direction?

    Also, this is probably another issue to open, but have you considered providing a docker-based deployment? I think it would be easier to deploy than full images or native services installs.

    Thanks for your help!

    opened by guillermo-carrasco 6
  • [HOPSWORKS-1070] Refactor HdfsLeDescriptorsFacade to return a random NN for bootstrapping the client

    [HOPSWORKS-1070] Refactor HdfsLeDescriptorsFacade to return a random NN for bootstrapping the client

    …ing the client

    Make sure there is no duplicate PR for this issue

    • Please check if the PR meets the following requirements
    • [ ] Adds tests for the submitted changes (for bug fixes & features)
    • [ ] Passes the tests
    • [x] HOPSWORKS JIRA issue has been opened for this PR
    • [x] All commits have been squashed down to a single commit
    • Post a link to the associated JIRA issue

    • What kind of change does this PR introduce? (Bug fix, feature, docs update, ...)

    • What is the new behavior (if this is a feature change)?

    • Does this PR introduce a breaking change? (What changes might users need to make in their application due to this PR?)

    • Other information:

    opened by robzor92 6
  • [HOPSWORKS-903] Jupyter cleanup and timer bugfixes

    [HOPSWORKS-903] Jupyter cleanup and timer bugfixes

    Make sure there is no duplicate PR for this issue

    • Please check if the PR meets the following requirements
    • [x] Adds tests for the submitted changes (for bug fixes & features)
    • [x] Passes the tests
    • [x] HOPSWORKS JIRA issue has been opened for this PR
    • [x] All commits have been squashed down to a single commit
    • Post a link to the associated JIRA issue

    • What kind of change does this PR introduce? (Bug fix, feature, docs update, ...)

    • What is the new behavior (if this is a feature change)?

    • Does this PR introduce a breaking change? (What changes might users need to make in their application due to this PR?)

    • Other information:

    opened by robzor92 4
  • [HOPSWORKS-718] Add Feature Store to Hopsworks

    [HOPSWORKS-718] Add Feature Store to Hopsworks

    • Adds a REST API for the feature store service ([HOPSWORKS-720])
    • Adds a UI for the feature store service ([HOPSWORKS-719])
    • Adds tests for the feature store service
    • Adds managed training datasets to the feature store ([HOPSWORKS-839])

    Make sure there is no duplicate PR for this issue

    • Please check if the PR meets the following requirements
    • [x] Adds tests for the submitted changes (for bug fixes & features)
    • [x] Passes the tests
    • [x] HOPSWORKS JIRA issue has been opened for this PR
    • [x] All commits have been squashed down to a single commit
    • Post a link to the associated JIRA issue https://logicalclocks.atlassian.net/browse/HOPSWORKS-718

    • What kind of change does this PR introduce? (Bug fix, feature, docs update, ...) Feature: Feature Store for HopsML

    • What is the new behavior (if this is a feature change)? A feature store service in hopsworks

    • Does this PR introduce a breaking change? (What changes might users need to make in their application due to this PR?) Hive becomes a first-class dependency to Hopsworks

    • Other information:

    Dependent on:

    • https://github.com/logicalclocks/hops-hadoop-chef/pull/119
    • https://github.com/logicalclocks/hopsworks-chef/pull/233
    • https://github.com/logicalclocks/spark-chef/pull/57

    Tests:

    https://github.com/logicalclocks/hops-testing/pull/248

    opened by Limmen 4
  • [HOPSWORKS-825] Remove member from project and jobs review

    [HOPSWORKS-825] Remove member from project and jobs review

    Make sure there is no duplicate PR for this issue

    • Please check if the PR meets the following requirements
    • [x] Adds tests for the submitted changes (for bug fixes & features)
    • [ ] Passes the tests
    • [x] HOPSWORKS JIRA issue has been opened for this PR
    • [x] All commits have been squashed down to a single commit
    • Post a link to the associated JIRA issue

    • What kind of change does this PR introduce? (Bug fix, feature, docs update, ...)

      • Data owner should be able to remove data scientists

      • Timers for jobs will be cancelled if the user is not a member of the project where the job is created

    • What is the new behavior (if this is a feature change)?

    • Does this PR introduce a breaking change? (What changes might users need to make in their application due to this PR?)

    • Other information:

    opened by robzor92 4
  • [HOPSWORKS-1538] add endpoint to download the client archive for auto…

    [HOPSWORKS-1538] add endpoint to download the client archive for auto…

    … install on remote machine

    Make sure there is no duplicate PR for this issue

    • Please check if the PR meets the following requirements
    • [ ] Adds tests for the submitted changes (for bug fixes & features)
    • [ ] Passes the tests
    • [x] HOPSWORKS JIRA issue has been opened for this PR
    • [x] All commits have been squashed down to a single commit
    • Post a link to the associated JIRA issue https://logicalclocks.atlassian.net/browse/HOPSWORKS-1538

    • What kind of change does this PR introduce? (Bug fix, feature, docs update, ...) New feature

    • What is the new behavior (if this is a feature change)? add an endpoint to download the hopsfs and hive clients for remote access.

    • Does this PR introduce a breaking change? (What changes might users need to make in their application due to this PR?)

    • Other information:

    opened by berthoug 3
  • localhost is not accessible

    localhost is not accessible

    Hi, I have completed the installation for a single machine i.e my laptop running ubuntu 18.04 LTS. steps I have followed: https://hopsworks.readthedocs.io/en/0.9/getting_started/setups/single_machine.html installation takes around 1hr and i am able to see it on VirtualBox.

    On accessing the "tail -f karamel-chef/nohup" it say's

    cat karamel-chef/nohup.out Bringing machine 'default' up with 'virtualbox' provider... ==> default: Checking if box 'ubuntu/bionic64' version '20191218.0.0' is up to date... ==> default: Clearing any previously set forwarded ports... ==> default: Using hostname "hopsworks0.logicalclocks.com" as node name for Chef... ==> default: Clearing any previously set network interfaces... ==> default: Preparing network interfaces based on configuration... default: Adapter 1: nat ==> default: Forwarding ports... default: 22 (guest) => 29206 (host) (adapter 1) default: 3306 (guest) => 20048 (host) (adapter 1) default: 9090 (guest) => 27889 (host) (adapter 1) default: 8080 (guest) => 20766 (host) (adapter 1) default: 8181 (guest) => 39758 (host) (adapter 1) default: 9009 (guest) => 25500 (host) (adapter 1) default: 4848 (guest) => 20001 (host) (adapter 1) default: 5601 (guest) => 33923 (host) (adapter 1) default: 3000 (guest) => 61755 (host) (adapter 1) default: 8083 (guest) => 51157 (host) (adapter 1) default: 8084 (guest) => 35895 (host) (adapter 1) default: 8086 (guest) => 55799 (host) (adapter 1) default: 2003 (guest) => 64851 (host) (adapter 1) default: 8888 (guest) => 28717 (host) (adapter 1) default: 11112 (guest) => 64246 (host) (adapter 1) default: 12358 (guest) => 29026 (host) (adapter 1) default: 8787 (guest) => 53652 (host) (adapter 1) default: 42011 (guest) => 42011 (host) (adapter 1) default: 42012 (guest) => 42012 (host) (adapter 1) default: 42013 (guest) => 42013 (host) (adapter 1) default: 2181 (guest) => 47596 (host) (adapter 1) default: 9092 (guest) => 54353 (host) (adapter 1) default: 16000 (guest) => 52593 (host) (adapter 1) default: 8000 (guest) => 25931 (host) (adapter 1) ==> default: Running 'pre-boot' VM customizations... ==> default: Booting VM... ==> default: Waiting for machine to boot. This may take a few minutes... default: SSH address: 127.0.0.1:29206 default: SSH username: vagrant default: SSH auth method: private key default: Warning: Connection reset. Retrying... ==> default: Machine booted and ready! ==> default: Checking for guest additions in VM... ==> default: Setting hostname... ==> default: Mounting shared folders... default: /vagrant => /home/machine/Downloads/karamel-chef default: /tmp/vagrant-chef/03ca3913f1400189ae6be0273a9b8488/cookbooks => /home/machine/Downloads/karamel-chef/cookbooks ==> default: Machine already provisioned. Run vagrant provision or use the --provision ==> default: flag to force provisioning. Provisioners marked to run always will still run.

    I am unable to connect the GUI on the browser, in other words, What URL I need to open. Please help me.

    opened by maneeshdisodia 3
  • [HOPSWORKS-1338] [featurestore] Configurable in-bucket path for exporting training datasets to S3

    [HOPSWORKS-1338] [featurestore] Configurable in-bucket path for exporting training datasets to S3

    Make sure there is no duplicate PR for this issue

    • Please check if the PR meets the following requirements
    • [ ] Adds tests for the submitted changes (for bug fixes & features)
    • [ ] Passes the tests
    • [x] HOPSWORKS JIRA issue has been opened for this PR
    • [ ] All commits have been squashed down to a single commit
    • Post a link to the associated JIRA issue https://logicalclocks.atlassian.net/browse/HOPSWORKS-1338

    • What kind of change does this PR introduce? (Bug fix, feature, docs update, ...)

    • What is the new behavior (if this is a feature change)?

    • Does this PR introduce a breaking change? (What changes might users need to make in their application due to this PR?)

    • Other information:

    opened by moritzmeister 3
  • [HOPSWORKS-1284] add install lib without search

    [HOPSWORKS-1284] add install lib without search

    Make sure there is no duplicate PR for this issue

    • Please check if the PR meets the following requirements
    • [ ] Adds tests for the submitted changes (for bug fixes & features)
    • [x] Passes the tests
    • [x] HOPSWORKS JIRA issue has been opened for this PR
    • [x] All commits have been squashed down to a single commit
    • Post a link to the associated JIRA issue

    • What kind of change does this PR introduce? (Bug fix, feature, docs update, ...)

    • What is the new behavior (if this is a feature change)?

    • Does this PR introduce a breaking change? (What changes might users need to make in their application due to this PR?)

    • Other information:

    opened by ErmiasG 3
  • [HOPSWORKS-1124] optimize scp-deploy-frontend.sh

    [HOPSWORKS-1124] optimize scp-deploy-frontend.sh

    Make sure there is no duplicate PR for this issue

    • Please check if the PR meets the following requirements
    • [ ] Adds tests for the submitted changes (for bug fixes & features)
    • [ ] Passes the tests
    • [x] HOPSWORKS JIRA issue has been opened for this PR
    • [x] All commits have been squashed down to a single commit
    • Post a link to the associated JIRA issue https://logicalclocks.atlassian.net/browse/HOPSWORKS-1124

    • What kind of change does this PR introduce? (Bug fix, feature, docs update, ...) Improvement to the script.

    • What is the new behavior (if this is a feature change)? Reduced the time from ~90 seconds to ~20 seconds.

    • Does this PR introduce a breaking change? (What changes might users need to make in their application due to this PR?)

    • Other information:

    opened by kai-chi 3
  • Bump jackson-databind from 2.12.4 to 2.12.7.1

    Bump jackson-databind from 2.12.4 to 2.12.7.1

    Bumps jackson-databind from 2.12.4 to 2.12.7.1.

    Commits

    Dependabot compatibility score

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    • @dependabot use these labels will set the current labels as the default for future PRs for this repo and language
    • @dependabot use these reviewers will set the current reviewers as the default for future PRs for this repo and language
    • @dependabot use these assignees will set the current assignees as the default for future PRs for this repo and language
    • @dependabot use this milestone will set the current milestone as the default for future PRs for this repo and language

    You can disable automated security fix PRs for this repo from the Security Alerts page.

    dependencies java 
    opened by dependabot[bot] 0
  • [HWORKS-197] Remove old gh-pages workflows for hopsworks repo

    [HWORKS-197] Remove old gh-pages workflows for hopsworks repo

    Make sure there is no duplicate PR for this issue

    • Please check if the PR meets the following requirements
    • [ ] Adds tests for the submitted changes (for bug fixes & features)
    • [ ] Passes the tests
    • [ ] HOPSWORKS JIRA issue has been opened for this PR
    • [ ] All commits have been squashed down to a single commit
    • Post a link to the associated JIRA issue

    • What kind of change does this PR introduce? (Bug fix, feature, docs update, ...)

    • What is the new behavior (if this is a feature change)?

    • Does this PR introduce a breaking change? (What changes might users need to make in their application due to this PR?)

    • Other information:

    opened by robzor92 0
  • [HWORKS-197] Remove old gh-pages workflows for hopsworks repo

    [HWORKS-197] Remove old gh-pages workflows for hopsworks repo

    Make sure there is no duplicate PR for this issue

    • Please check if the PR meets the following requirements
    • [ ] Adds tests for the submitted changes (for bug fixes & features)
    • [ ] Passes the tests
    • [ ] HOPSWORKS JIRA issue has been opened for this PR
    • [ ] All commits have been squashed down to a single commit
    • Post a link to the associated JIRA issue

    • What kind of change does this PR introduce? (Bug fix, feature, docs update, ...)

    • What is the new behavior (if this is a feature change)?

    • Does this PR introduce a breaking change? (What changes might users need to make in their application due to this PR?)

    • Other information:

    opened by robzor92 0
  • Bump jettison from 1.1 to 1.5.1

    Bump jettison from 1.1 to 1.5.1

    Bumps jettison from 1.1 to 1.5.1.

    Release notes

    Sourced from jettison's releases.

    Jettison 1.5.1

    What's Changed

    Full Changelog: https://github.com/jettison-json/jettison/compare/jettison-1.5.0...jettison-1.5.1

    Commits
    • bdb3982 [maven-release-plugin] prepare release jettison-1.5.1
    • 1268b75 Prevent infinite loop when a /* comment is not terminated
    • cff9f28 Create codeql-analysis.yml
    • 395f862 Stack Overflow fix on malformed JSON
    • a5d2223 [maven-release-plugin] prepare for next development iteration
    • e1bf529 [maven-release-plugin] prepare release jettison-1.5.0
    • 9ccf9d0 Update some deps/plugin versions
    • cfc7382 Performance improvement
    • d371468 Use BigDecimal instead of Double to avoid loss of precision
    • 23a64ee Avoid NullPointerException when used with Axis2 1.5
    • Additional commits viewable in compare view

    Dependabot compatibility score

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    • @dependabot use these labels will set the current labels as the default for future PRs for this repo and language
    • @dependabot use these reviewers will set the current reviewers as the default for future PRs for this repo and language
    • @dependabot use these assignees will set the current assignees as the default for future PRs for this repo and language
    • @dependabot use this milestone will set the current milestone as the default for future PRs for this repo and language

    You can disable automated security fix PRs for this repo from the Security Alerts page.

    dependencies java 
    opened by dependabot[bot] 0
  • Bump snakeyaml from 1.27 to 1.31

    Bump snakeyaml from 1.27 to 1.31

    Bumps snakeyaml from 1.27 to 1.31.

    Commits
    • a3e641b Remove unused code for comments
    • d2ed568 Remove unused code
    • ab76f86 Add @​Deprecated annotation to constructs marked with @​deprecated javadoc.
    • bc7869b Make billionLaughsAttackTest.billionLaughsAttackExpanded() robust
    • 4cfb7b7 Merged in make-billion-laughs-attack-test-robust (pull request #7)
    • da5ba16 Update changes.xml
    • 23fbcef add test with JavaBean property of parameterized Collection
    • 6385279 change how we set detected type to JavaBean Collection property item
    • 0468784 force keyNode to be String for JavaBeans
    • 467bcc9 expect node to be scalar when enforcings String keys
    • Additional commits viewable in compare view

    Dependabot compatibility score

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    • @dependabot use these labels will set the current labels as the default for future PRs for this repo and language
    • @dependabot use these reviewers will set the current reviewers as the default for future PRs for this repo and language
    • @dependabot use these assignees will set the current assignees as the default for future PRs for this repo and language
    • @dependabot use this milestone will set the current milestone as the default for future PRs for this repo and language

    You can disable automated security fix PRs for this repo from the Security Alerts page.

    dependencies java 
    opened by dependabot[bot] 0
  • Bump protobuf-java from 3.9.1 to 3.16.3

    Bump protobuf-java from 3.9.1 to 3.16.3

    Bumps protobuf-java from 3.9.1 to 3.16.3.

    Release notes

    Sourced from protobuf-java's releases.

    Protobuf Release v3.16.3

    Java

    • Refactoring java full runtime to reuse sub-message builders and prepare to migrate parsing logic from parse constructor to builder.
    • Move proto wireformat parsing functionality from the private "parsing constructor" to the Builder class.
    • Change the Lite runtime to prefer merging from the wireformat into mutable messages rather than building up a new immutable object before merging. This way results in fewer allocations and copy operations.
    • Make message-type extensions merge from wire-format instead of building up instances and merging afterwards. This has much better performance.
    • Fix TextFormat parser to build up recurring (but supposedly not repeated) sub-messages directly from text rather than building a new sub-message and merging the fully formed message into the existing field.
    • This release addresses a Security Advisory for Java users

    Protocol Buffers v3.16.1

    Java

    • Improve performance characteristics of UnknownFieldSet parsing (#9371)

    Protocol Buffers v3.16.0

    C++

    • Fix compiler warnings issue found in conformance_test_runner #8189 (#8190)
    • Fix MinGW-w64 build issues. (#8286)
    • [Protoc] C++ Resolved an issue where NO_DESTROY and CONSTINIT are in incorrect order (#8296)
    • Fix PROTOBUF_CONSTINIT macro redefinition (#8323)
    • Delete StringPiecePod (#8353)
    • Fix gcc error: comparison of unsigned expression in '>= 0' is always … (#8309)
    • Fix cmake install on iOS (#8301)
    • Create a CMake option to control whether or not RTTI is enabled (#8347)
    • Fix endian.h location on FreeBSD (#8351)
    • Refactor util::Status (#8354)
    • Make util::Status more similar to absl::Status (#8405)
    • Fix -Wsuggest-destructor-override for generated C++ proto classes. (#8408)
    • Refactor StatusOr and StringPiece (#8406)
    • Refactor uint128 (#8416)
    • The ::pb namespace is no longer exposed due to conflicts.
    • Allow MessageDifferencer::TreatAsSet() (and friends) to override previous calls instead of crashing.
    • Reduce the size of generated proto headers for protos with string or bytes fields.
    • Move arena() operation on uncommon path to out-of-line routine
    • For iterator-pair function parameter types, take both iterators by value.
    • Code-space savings and perhaps some modest performance improvements in RepeatedPtrField.
    • Eliminate nullptr check from every tag parse.
    • Remove unused _$name$cached_byte_size fields.
    • Serialize extension ranges together when not broken by a proto field in the middle.
    • Do out-of-line allocation and deallocation of string object in ArenaString.

    ... (truncated)

    Commits
    • b8c2488 Updating version.json and repo version numbers to: 16.3
    • 42e47e5 Refactoring Java parsing (3.16.x) (#10668)
    • 98884a8 Merge pull request #10556 from deannagarcia/3.16.x
    • 450b648 Cherrypick ruby fixes for monterey
    • b17bb39 Merge pull request #10548 from protocolbuffers/3.16.x-202209131829
    • c18f5e7 Updating changelog
    • 6f4e817 Updating version.json and repo version numbers to: 16.2
    • a7d4e94 Merge pull request #10547 from deannagarcia/3.16.x
    • 55815e4 Apply patch
    • 152d7bf Update version.json with "lts": true (#10535)
    • Additional commits viewable in compare view

    Dependabot compatibility score

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    • @dependabot use these labels will set the current labels as the default for future PRs for this repo and language
    • @dependabot use these reviewers will set the current reviewers as the default for future PRs for this repo and language
    • @dependabot use these assignees will set the current assignees as the default for future PRs for this repo and language
    • @dependabot use this milestone will set the current milestone as the default for future PRs for this repo and language

    You can disable automated security fix PRs for this repo from the Security Alerts page.

    dependencies java 
    opened by dependabot[bot] 0
Releases(v3.0.0)
Owner
Logical Clocks AB
Developers of Hopsworks
Logical Clocks AB
An open source python library for automated feature engineering

"One of the holy grails of machine learning is to automate more and more of the feature engineering process." ― Pedro Domingos, A Few Useful Things to

alteryx 6.4k Nov 23, 2022
Unofficial third-party implementation of FFD (fast feature detector) published in IEEE TIP 2020.

fast_feature_detector Unofficial third-party implementation of FFD (fast feature detector) published in IEEE TIP 2020. Caution I have not got any perm

kamino410 12 Feb 17, 2022
FG-Net: Fast Large-Scale LiDAR Point Clouds Understanding Network Leveraging Correlated Feature Mining and Geometric-Aware Modelling

FG-Net: Fast Large-Scale LiDAR Point Clouds Understanding Network Leveraging Correlated Feature Mining and Geometric-Aware Modelling Comparisons of Running Time of Our Method with SOTA methods RandLA and KPConv:

Kangcheng LIU 76 Nov 8, 2022
LIDAR(Livox Horizon) point cloud preprocessing, including point cloud filtering and point cloud feature extraction (edge points and plane points)

LIDAR(Livox Horizon) point cloud preprocessing, including point cloud filtering and point cloud feature extraction (edge points and plane points)

hongyu wang 11 Nov 11, 2022
Implementation of Sift feature detection and matching in C + +

Sift-In-CPP This is SIFT feature detection and matching implemented in C + + Environment version information: VS2017、Opencv3.4.3 Reference link: 1.htt

null 1 Nov 19, 2021
Distributed machine learning platform

Veles Distributed platform for rapid Deep learning application development Consists of: Platform - https://github.com/Samsung/veles Znicz Plugin - Neu

Samsung 898 Nov 9, 2022
Machine Learning Platform for Kubernetes

Reproduce, Automate, Scale your data science. Welcome to Polyaxon, a platform for building, training, and monitoring large scale deep learning applica

polyaxon 3.2k Nov 25, 2022
MediaPipe offers cross-platform, customizable ML solutions for live and streaming media.

Cross-platform, customizable ML solutions for live and streaming media.

Google 19.5k Nov 27, 2022
ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

ONNX Runtime is a cross-platform inference and training machine-learning accelerator compatible with deep learning frameworks, PyTorch and TensorFlow/Keras, as well as classical machine learning libraries such as scikit-learn, and more.

Microsoft 7.8k Nov 30, 2022
from Microsoft STL, but multi-platform

mscharconv <charconv> from Microsoft STL, but multi-platform. Tested with MSVC, gcc, and clang on Windows, Linux, and macOS (will likely work on other

Borislav Stanimirov 36 Nov 3, 2022
Zero-latency convolution on Bela platform

bela-zlc Zero-latency convolution on Bela platform | Report | Video | Overview Convolution has many applications in audio, such as equalization and ar

Christian J. Steinmetz 19 Jun 25, 2022
Read and write rosbag on a platform without ROS installed, using MQTT for message delivery.

EasyRosBag x86_64: Test on Ubuntu18.04 arm64 : Test on Ubuntu21.04(raspberry Pi4) Introducton ROS(Robot Operation System) is too fat!!! We do not ins

afei 9 May 23, 2022
A C++-based, cross platform ray tracing library

Visionaray A C++ based, cross platform ray tracing library Getting Visionaray The Visionaray git repository can be cloned using the following commands

Stefan Zellmann 411 Nov 24, 2022
ncnn is a high-performance neural network inference framework optimized for the mobile platform

ncnn ncnn is a high-performance neural network inference computing framework optimized for mobile platforms. ncnn is deeply considerate about deployme

Tencent 16k Nov 24, 2022
A Cross platform implement of Wenet ASR. It's based on ONNXRuntime and Wenet. We provide a set of easier APIs to call wenet models.

RapidASR: a new member of RapidAI family. Our visio is to offer an out-of-box engineering implementation for ASR. A cpp implementation of recognize-on

RapidAI-NG 97 Nov 17, 2022
RapidOCR - A cross platform OCR Library based on PaddleOCR & OnnxRuntime

RapidOCR (捷智OCR) 简体中文 | English 目录 RapidOCR (捷智OCR) 简介 近期更新 ?? 2021-12-18 update 2021-11-28 update 2021-11-13 update 2021-10-27 update 2021-09-13 upda

RapidAI-NG 686 Dec 1, 2022
ClanLib is a cross platform C++ toolkit library.

ClanLib ClanLib is a cross platform toolkit library with a primary focus on game creation. The library is Open Source and free for commercial use, und

Kenneth Gangstø 306 Nov 24, 2022
Insight Toolkit (ITK) is an open-source, cross-platform toolkit for N-dimensional scientific image processing, segmentation, and registration

ITK: The Insight Toolkit C++ Python Linux macOS Windows Linux (Code coverage) Links Homepage Download Discussion Software Guide Help Examples Issue tr

Insight Software Consortium 1.1k Nov 24, 2022
Gesture Recognition Toolkit (GRT) is a cross-platform, open-source, C++ machine learning library designed for real-time gesture recognition.

Gesture Recognition Toolkit (GRT) The Gesture Recognition Toolkit (GRT) is a cross-platform, open-source, C++ machine learning library designed for re

Nicholas Gillian 791 Nov 27, 2022