A JavaScript deep learning and reinforcement learning library.

Last update: Jan 4, 2023

Overview

neurojs is a JavaScript framework for deep learning in the browser. It mainly focuses on reinforcement learning, but can be used for any neural network based task. It contains neat demos to visualise these capabilities, for instance a 2D self-driving car.

Feel free to contribute. The development on such projects is more awesome in a community!

Note: this repo is no longer maintained since more general frameworks such as TensorFlow-JS emerged, which I recommend you to use.

Features

Implements a full-stack neural-network based machine learning framework
Extended reinforcement-learning support
- Uniform and prioritised replay buffers
- Advantage-learning (increasing the action-gap) https://arxiv.org/pdf/1512.04860v1.pdf
- Support for deep-q-networks and actor-critic models (via deep-deterministic-policy-gradients)
Binary import and export of network configurations (weights etc.)
High-performance

Examples

Self-driving car
Advanced XOR
Andrej Karpathy's Waterworld (ConvNetJS replaced with NeuroJS)

Running the examples

npm install
npm start

Open http://localhost:8080/examples/ in your browser and select the demo you want to run.

What's next?

More examples (pong, pendulum, snake,improved cars, etc.)
Support for web workers
LSTM and backpropagation through time

Comments

Example files don't rebuild?

Hey, awesome project!

I might be missing something, but I'm not able to change any of the source files in src or example/cars, the files aren't rebuilt, even after running npm run build. Is there a step/configuration I'm missing?
bug

opened by donnielrt 4
Bump mixin-deep from 1.3.1 to 1.3.2
⚠️ Dependabot is rebasing this PR ⚠️

If you make any changes to it yourself then they will take precedence over the rebase.

Bumps mixin-deep from 1.3.1 to 1.3.2.

Commits

754f0c2 1.3.2

90ee1fa ensure keys are valid when mixing in values

See full diff in compare view

Maintainer changes

This version was pushed to npm by doowb, a new releaser for mixin-deep since your current version.

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

@dependabot rebase will rebase this PR

@dependabot recreate will recreate this PR, overwriting any edits that have been made to it

@dependabot merge will merge this PR after your CI passes on it

@dependabot squash and merge will squash and merge this PR after your CI passes on it

@dependabot cancel merge will cancel a previously requested merge and block automerging

@dependabot reopen will reopen this PR if it is closed

@dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually

@dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)

@dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)

@dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

@dependabot use these labels will set the current labels as the default for future PRs for this repo and language

@dependabot use these reviewers will set the current reviewers as the default for future PRs for this repo and language

@dependabot use these assignees will set the current assignees as the default for future PRs for this repo and language

@dependabot use this milestone will set the current milestone as the default for future PRs for this repo and language

You can disable automated security fix PRs for this repo from the Security Alerts page.

dependencies
opened by dependabot[bot] 2
neurojs is not defined

I am trying to run the cars example. I ran npm install and then npm start. But when I go into the console of the page it says neurojs is not defined. It is trying to find a file called build/neurojs-v2.js and that just doesn't exist. Not quite sure why...

opened by samfultonjr 2
Having trouble understanding the Agent class
Hello! I'm trying to do reinforcement learning using NeuroJS. Looking at the code, it appears that the Agent class is the backbone for the reinforcement learning in NeuroJS. I'm having trouble understanding it.

Are these the only steps required to use this library for reinforcement learning:

Create Agent object (only feeding in number of states and actions)

Call Agent.policy() for some time (do I call act()? simulate()? evaluate()?)

Call Agent.learn()`

Is there anything else needed? Also, is there a .reset() "function" that lets me remove the history of the Agent, but keep the learned weights/values?

Thanks for creating this repository!
opened by UsaidPro 2
Bump acorn from 6.1.1 to 6.4.1
Bumps acorn from 6.1.1 to 6.4.1.

Commits

9a2e9b6 Mark version 6.4.1

90a9548 More rigorously check surrogate pairs in regexp validator

df0cf1a Mark version 6.4.0

5303412 Also export Parser via Parser.acorn

efe273e give token types and etc to plugins

ac6decb Mark version 6.3.0

7e9817d Allow sourceType: module even with ecmaVersion < 6

e2b8cc0 Fix broken parsing of new expressions when allowReserved=="never"

1555c52 Update acorn.d.ts

77c20fa Mark version 6.2.1

Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

@dependabot rebase will rebase this PR

@dependabot recreate will recreate this PR, overwriting any edits that have been made to it

@dependabot merge will merge this PR after your CI passes on it

@dependabot squash and merge will squash and merge this PR after your CI passes on it

@dependabot cancel merge will cancel a previously requested merge and block automerging

@dependabot reopen will reopen this PR if it is closed

@dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually

@dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)

@dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)

@dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

@dependabot use these labels will set the current labels as the default for future PRs for this repo and language

@dependabot use these reviewers will set the current reviewers as the default for future PRs for this repo and language

@dependabot use these assignees will set the current assignees as the default for future PRs for this repo and language

@dependabot use this milestone will set the current milestone as the default for future PRs for this repo and language

You can disable automated security fix PRs for this repo from the Security Alerts page.

dependencies
opened by dependabot[bot] 1
Bump lodash from 4.17.11 to 4.17.15
Bumps lodash from 4.17.11 to 4.17.15.

Commits

ddfd9b1 Bump to v4.17.15.

b185fce Rebuild lodash and docs.

be87d30 Bump to v4.17.14.

a6fe6b1 Rebuild lodash and docs.

e371828 Bump to v4.17.13.

357e899 Rebuild lodash and docs.

fd9a062 Bump to v4.17.12.

e77d681 Rebuild lodash and docs.

629d186 Update OpenJS references.

2406eac Fix minified build.

Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

@dependabot rebase will rebase this PR

@dependabot recreate will recreate this PR, overwriting any edits that have been made to it

@dependabot merge will merge this PR after your CI passes on it

@dependabot squash and merge will squash and merge this PR after your CI passes on it

@dependabot cancel merge will cancel a previously requested merge and block automerging

@dependabot reopen will reopen this PR if it is closed

@dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually

@dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)

@dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)

@dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

@dependabot use these labels will set the current labels as the default for future PRs for this repo and language

@dependabot use these reviewers will set the current reviewers as the default for future PRs for this repo and language

@dependabot use these assignees will set the current assignees as the default for future PRs for this repo and language

@dependabot use this milestone will set the current milestone as the default for future PRs for this repo and language

You can disable automated security fix PRs for this repo from the Security Alerts page.

dependencies
opened by dependabot[bot] 0
Episodes support

Is it possible to train this network with episodes? E.g. in Karpathy Waterworld, one can add a rule "the character dies if it eats a green pill". After death the "character" shall be revived, how do I tell the network to switch to a new episode? The same could be done for cars example, if a car "explodes" when it touches a wall.

Great lib anyway, and code is well written.
enhancement

opened by andreagentili 6
Add eslint to normalize code style

Maybe it's not a problem for one person, but i think a uniform code style is important for collaborating. So i add airbnb to normalize code, but i find warnings and errors are too much that i finally comment it. But i reserve the basic config so you can custom your own code style. By the way, webpack 2 replace loaders with rules, and i fix it.

opened by XatMassacrE 2

Owner

Jan

Cut the buzzwords

GitHub http://janhuenermann.com/projects/learning-to-drive

Deep Learning in Javascript. Train Convolutional Neural Networks (or ordinary ones) in your browser.

ConvNetJS ConvNetJS is a Javascript implementation of Neural networks, together with nice browser-based demos. It currently supports: Common Neural Ne

10.4k Dec 31, 2022

🤖chat discord bot powered by Deep learning algorithm🧠

✨ Akaya ✨ ❗ Discord integration functionality not implemented yet! Only the deep-learning module working. Install git clone https://github.com/LyeZinh

3 Jun 23, 2022

Deep Neural Network Sandbox for JavaScript.

Deep Neural Network Sandbox for Javascript Train a neural network with your data & save it's trained state! Demo • Installation • Getting started • Do

420 Jan 4, 2023

Machine Learning library for node.js

shaman Machine Learning library for node.js Linear Regression shaman supports both simple linear regression and multiple linear regression. It support

108 Feb 26, 2021

machinelearn.js is a Machine Learning library written in Typescript

machinelearn.js is a Machine Learning library written in Typescript. It solves Machine Learning problems and teaches users how Machine Learning algorithms work.

522 Jan 2, 2023

Machine learning tools in JavaScript

ml.js - Machine learning tools in JavaScript Introduction This library is a compilation of the tools developed in the mljs organization. It is mainly

2.3k Jan 1, 2023

JavaScript Machine Learning Toolkit

The JavaScript Machine Learning Toolkit, or JSMLT, is an open source JavaScript library for education in machine learning.

25 Nov 23, 2022

K-nearest neighbors algorithm for supervised learning implemented in javascript

kNear Install npm install knear --save About kNear is a javascript implementation of the k-nearest neighbors algorithm. It is a supervised machine lea

45 Mar 7, 2022

Train and test machine learning models for your Arduino Nano 33 BLE Sense in the browser.

Tiny Motion Trainer Train and test IMU based TFLite models on the Web Overview Since 2009, coders have created thousands of experiments using Chrome,

59 Nov 21, 2022

Unsupervised machine learning with multivariate Gaussian mixture model which supports both offline data and real-time data stream.

Gaussian Mixture Model Unsupervised machine learning with multivariate Gaussian mixture model which supports both offline data and real-time data stre