Detect copy-pasted and structurally similar JavaScript code. Requires Node.js 6.0+, and supports ES6, JSX as well as Flow. Note: the project has been mostly rewritten for the 0.10 release and saw several breaking changes.
Overview
We've all had to deal with code smell, and duplicate code is a common source. While some instances are easy to spot, this type of searching is the perfect use-case for a helpful CLI tool.
Existing solutions do exist for this purpose, but some struggle with code that has wildly varying identifiers or literals, and others have lackluster support for the JS ecosystem: ES6, JSX, Flow, ignoring module declarations and imports, etc.
And copy-pasted code is but one type of code duplication. Common boilerplate and repeated logic can be identified as well using jsinspect, since it doesn't operate directly on tokens - it uses the ASTs of the parsed code.
You have the freedom to specify a threshold determining the smallest subset of nodes to analyze. This will identify code with a similar structure, based on the AST node types, e.g. BlockStatement, VariableDeclaration, ObjectExpression, etc. By default, it searches nodes with matching identifiers and literals for copy-paste oriented detection, but this can be disabled. For context, identifiers include the names of variables, methods, properties, etc, while literals are strings, numbers, etc.
The tool accepts a list of paths to parse and prints any found matches. Any directories among the paths are walked recursively, and only .js and .jsx files are analyzed. You can explicitly pass file paths that include a different extension as well. Any node_modules and bower_components dirs are also ignored.
Installation
It can be installed via npm using:
npm install -g jsinspect
Usage
Usage: jsinspect [options] <paths ...>
Detect copy-pasted and structurally similar JavaScript code
Example use: jsinspect -I -L -t 20 --ignore "test" ./path/to/src
Options:
-h, --help output usage information
-V, --version output the version number
-t, --threshold <number> number of nodes (default: 30)
-m, --min-instances <number> min instances for a match (default: 2)
-c, --config [config] path to config file (default: .jsinspectrc)
-r, --reporter [default|json|pmd] specify the reporter to use
-I, --no-identifiers do not match identifiers
-L, --no-literals do not match literals
-C, --no-color disable colors
--ignore <pattern> ignore paths matching a regex
--truncate <number> length to truncate lines (default: 100, off: 0)
--debug print debug information
If a .jsinspectrc file is located in the project directory, its values will be used in place of the defaults listed above. For example:
{
"threshold": 30,
"identifiers": true,
"literals": true,
"color": true,
"minInstances": 2,
"ignore": "test|spec|mock",
"reporter": "json",
"truncate": 100,
}
On first use with a project, you may want to run the tool with the following options, while running explicitly on the lib/src directories, and not the test/spec dir.
jsinspect -t 50 --ignore "test" ./path/to/src
From there, feel free to try decreasing the threshold, ignoring identifiers using the -I flag and ignoring literals with -L. A lower threshold may lead you to discover new areas of interest for refactoring or cleanup.
Integration
It's simple to run jsinspect on your library source as part of a build process. It will exit with an error code of 0 when no matches are found, resulting in a passing step, and a positive error code corresponding to its failure. For example, with Travis CI, you could add the following entries to your .travis.yml:
before_script:
- "npm install -g jsinspect"
script:
- "jsinspect ./path/to/src"
Note that in the above example, we're using a threshold of 30 for detecting structurally similar code. A higher threshold may be appropriate as well.
To have jsinspect run with each job, but not block or fail the build, you can use something like the following:
script:
- "jsinspect ./path/to/src || true"
Reporters
Aside from the default reporter, both JSON and PMD CPD-style XML reporters are available. Note that in the JSON example below, indentation and formatting has been applied. Furthermore, the id property available in these reporters is useful for parsing by automatic scripts to determine whether or not duplicate code has changed between builds.
JSON
[{
"id":"6ceb36d5891732db3835c4954d48d1b90368a475",
"instances":[
{
"path":"spec/fixtures/intersection.js",
"lines":[1,5],
"code":"function intersectionA(array1, array2) {\n array1.filter(function(n) {\n return array2.indexOf(n) != -1;\n });\n}"
},
{
"path":"spec/fixtures/intersection.js",
"lines":[7,11],
"code":"function intersectionB(arrayA, arrayB) {\n arrayA.filter(function(n) {\n return arrayB.indexOf(n) != -1;\n });\n}"
}
]
}]
PMD CPD XML
<?xml version="1.0" encoding="utf-8"?>
<pmd-cpd>
<duplication lines="10" id="6ceb36d5891732db3835c4954d48d1b90368a475">
<file path="/jsinspect/spec/fixtures/intersection.js" line="1"/>
<file path="/jsinspect/spec/fixtures/intersection.js" line="7"/>
<codefragment>
spec/fixtures/intersection.js:1,5
function intersectionA(array1, array2) {
array1.filter(function(n) {
return array2.indexOf(n) != -1;
});
}
spec/fixtures/intersection.js:7,11
function intersectionB(arrayA, arrayB) {
arrayA.filter(function(n) {
return arrayB.indexOf(n) != -1;
});
}
</codefragment>
</duplication>
</pmd-cpd>
![[feature request] support suffix other than .js or .jsx](https://avatars.githubusercontent.com/u/19888681?v=4)
21.9k Dec 31, 2022
44.5k Dec 30, 2022
3.5k Jan 6, 2023
27.8k Dec 31, 2022
118 Dec 16, 2022
1.7k Dec 9, 2022
3.5k Dec 26, 2022
19 Oct 7, 2022
5 Dec 14, 2022
8.8k Jan 2, 2023
1 Oct 2, 2022
34 Nov 29, 2022
37 Dec 24, 2022
19 Dec 17, 2022
57 Dec 26, 2022
5.1k Dec 29, 2022
380 Nov 15, 2022
4 Oct 19, 2022
8 Sep 5, 2022
33 Dec 26, 2022