A few months ago I started to look under the hood of my SPA and Nodejs applications and found code and practices that caught my attention. I found packages that other packages depended on, have very few lines of code. Packages with dependencies that are out of date or dependencies that had warnings such as, this package version is subject to a denial of service attack.
Upon further reflection, I got very concerned about the damage a bad person could inflict on trusting developers that download packages that have a dependency that has been replaced by evil code. My system and software that I write could be compromised. Now imagine ticking time bomb code replicated over Docker Containers and placed on servers. Damage could be immeasurable.
cave lupum – Beware the wolf disguised as a lamb.
Publicly articulating details of the many attack scenarios I’ve thought of would be irresponsible. Instead, it’s time to start the conversation around the problem that our international community is currently faced with and how we can protect our precious open-source.
Again, this blog post is about getting the conversation started.
Over the last few weeks, I’ve met with high profile MVP’s and a few corporate executives that share similar quality and security concerns that I’m sharing in this blog post.
I’ll have a section down below for compiled downloads such as NuGet, Visual Studio Gallery, and the Visual Studio Marketplace.
- Not add any burdens to the open-source developer
- Provide package consumers a measured level of confidence in the package and its dependencies
- Raise the quality of packages by having them evaluated
- Have repositories provide evaluation services and reporting for their packages
Package evaluation is performed in the cloud. An MVP friend also thought about a command line tool that could be used locally.
Package evaluation should be opt-in. Allow developers wanting their packages evaluated to submit their package for evaluation. An opt-in approach would not add any burdens to developers not wanting to participate, while at the same time, driving up quality for the packages that are evaluated, giving those developers additional credibility for their efforts.
Consumers of packages could choose to use evaluated packages or continue to use non-evaluated packages at their own risk.
Evaluation and Download
Where packages are evaluated (centralized vs. non-centralized) is a topic that will generate much discussion and debate.
Where evaluated packages are downloaded from (centralized vs. non-centralized) is another topic that will generate much discussion and debate.
Below is a short “starter list” of metrics. Additional metrics should include the warnings such as those that npm emits when packages are installed.
Most evaluation metrics are yes or no. Some are numeric; others are a simple list. When a package is evaluated, all of its dependencies are also evaluated. A package’s evaluation can only be as good as its weakest dependency.
- Package signed
- Included software license
- Number of dependencies
- Package is out of date
- Package has warnings
- Have out of date dependencies
- Has dependencies with warnings
- Has unit tests
- Has 100% unit test coverage
- All tests pass
- Makes network calls
- Writes to file system
- Threat assessment
- Package capabilities (what API’s are being used)
NuGet, Visual Studio Gallery, Visual Studio Marketplace
This proposal affects developers and infrastructures from all over the world.
As a software engineer, I know that while there will be challenges, the problems identified in this proposal are solvable.
Getting big corporations and government to proactively and cooperatively, take on and complete a task because it’s the right thing to do is a challenge that must be initiated.
Waiting until there is a problem and then trying to stem the tide and roll back the damage is a poor strategy. Benjamin Franklin said, “an ounce of prevention is worth a pound of cure,” he is correct.
I honestly do not believe getting funding for a project of this scope will be any problem.
Big players need to meet and solve this problem.
Developers, start the conversation in your sphere of influence and contact big players and let them know your concerns. Request that they take proactive action now.
Have a great day.
Just a grain of sand on the worlds beaches.