Mutation testing of smart contracts at scale

September 27, 2019 · Entered Twilight · 🏛 TAP@STAF

"Last commit was 5.0 years ago (≥5 year threshold)"

Evidence collected by the PWNC Scanner

Repo contents: DBToken_5287BE.csv, MultiSigWallet_fbd121.csv, NumberBoard_9E7505.csv, README.md, Traces, Vitaluck_3b400b.dir, casinoProxy_c0b022.csv, chainsol.js, comments.js, comparison.xlsx, contract_loop.sh, diff.sh, diff_loop.sh, evm_decoder.js, kill_detail.pdf, kill_detail_TxEvMethLimit.csv, kill_summary.pdf, kill_summary_000_1120.csv, make.sh, make_loop.sh, mall_7f683d.csv, mutasol.js, prepare.js, scrapedContractsVerified.json, soljson.js

Authors Pieter Hartel, Richard Schumi arXiv ID 1909.12563 Category cs.SE: Software Engineering Citations 19 Venue TAP@STAF Repository https://github.com/pieterhartel/Mutation-at-scale ⭐ 1 Last Checked 2 months ago

Abstract

It is crucial that smart contracts are tested thoroughly due to their immutable nature. Even small bugs in smart contracts can lead to huge monetary losses. However, testing is not enough; it is also important to ensure the quality and completeness of the tests. There are already several approaches that tackle this challenge with mutation testing, but their effectiveness is questionable since they only considered small contract samples. Hence, we evaluate the quality of smart contract mutation testing at scale. We choose the most promising of the existing (smart contract specific) mutation operators, analyse their effectiveness in terms of killability and highlight severe vulnerabilities that can be injected with the mutations. Moreover, we improve the existing mutation methods by introducing a novel killing condition that is able to detect a deviation in the gas consumption, i.e., in the monetary value that is required to perform transactions. This paper has a replication package at https://github.com/pieterhartel/Mutation-at-scale