danog/dart-sass
1
0
Fork 0
mirror of https://github.com/danog/dart-sass.git synced 2024-12-02 09:37:49 +01:00
Code Issues Packages Projects Releases Wiki Activity

Update benchmarks (#1196)

Browse Source
This commit is contained in:
Natalie Weizenbaum 2021-01-11 16:54:14 -08:00 committed by GitHub
parent 0cae33007f
commit b9f313295b
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
2 changed files with 90 additions and 64 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

128
perf.md
View File

@ -3,13 +3,10 @@ the benefit Dart Sass could provide relative to other implementations.
This was tested against: This was tested against:
* libsass ac338dfd and sassc a873899 compiled with g++ (Debian 7.3.0-18) 7.3.0. * libsass d4d74ef5 and sassc 66f0ef3 compiled with g++ (Debian 10.2.0-16) 10.2.0.
* Dart Sass 143e02a on Dart 2.4.0 and Node v12.0.0. * Dart Sass ae967c7 on Dart 2.10.4 (stable) (Wed Nov 11 13:35:58 2020 +0100) on "linux_x64" and Node v14.7.0.
on Debian x64 with Intel Xeon E5-1650 v3 @ 3.50GHz. The Dart Sass on Debian x64 with Intel Core i7-8650U CPU @ 1.90GHz.
[application snapshot][] was trained on the `tool/app-snapshot-input.scss` file.
[application snapshot]: https://github.com/dart-lang/sdk/wiki/Snapshots
# Measurements # Measurements
@ -19,130 +16,143 @@ I ran five instances of each configuration and recorded the fastest time.
Running on a file containing 4 instances of `.foo {a: b}`: Running on a file containing 4 instances of `.foo {a: b}`:
* sassc: 0.005s * sassc: 0.002s
* Dart Sass from a script snapshot: 0.219s * Dart Sass from a script snapshot: 0.179s
* Dart Sass native executable: 0.019s * Dart Sass native executable: 0.009s
* Dart Sass on Node.js: 0.195s * Dart Sass on Node.js: 0.248s
Based on these numbers, Dart Sass from a native executable is approximately: Based on these numbers, Dart Sass from a native executable is approximately:
* 3.8x slower than libsass * 4.5x slower than libsass
* 10.3x faster than Dart Sass on Node * 27.6x faster than Dart Sass on Node
## Large Plain CSS ## Large Plain CSS
Running on a file containing 2^17 instances of `.foo {a: b}`: Running on a file containing 2^17 instances of `.foo {a: b}`:
* sassc: 1.735s * sassc: 1.770s
* Dart Sass from a script snapshot: 1.573s * Dart Sass from a script snapshot: 1.548s
* Dart Sass native executable: 1.460s * Dart Sass native executable: 1.379s
* Dart Sass on Node.js: 2.729s * Dart Sass on Node.js: 2.587s
Based on these numbers, Dart Sass from a native executable is approximately: Based on these numbers, Dart Sass from a native executable is approximately:
* 1.2x faster than libsass * 1.3x faster than libsass
* 1.9x faster than Dart Sass on Node * 1.9x faster than Dart Sass on Node
## Preceding Sparse `@extend` ## Preceding Sparse `@extend`
Running on a file containing `.x {@extend .y}`, 2^17 instances of `.foo {a: b}`, and then `.y {a: b}`: Running on a file containing `.x {@extend .y}`, 2^17 instances of `.foo {a: b}`, and then `.y {a: b}`:
* sassc: 1.739s * sassc: 1.797s
* Dart Sass from a script snapshot: 1.634s * Dart Sass from a script snapshot: 1.594s
* Dart Sass native executable: 1.574s * Dart Sass native executable: 1.490s
* Dart Sass on Node.js: 2.877s * Dart Sass on Node.js: 2.783s
Based on these numbers, Dart Sass from a native executable is approximately: Based on these numbers, Dart Sass from a native executable is approximately:
* 1.1x faster than libsass * 1.2x faster than libsass
* 1.8x faster than Dart Sass on Node * 1.9x faster than Dart Sass on Node
## Following Sparse `@extend` ## Following Sparse `@extend`
Running on a file containing `.y {a: b}`, 2^17 instances of `.foo {a: b}`, and then `.x {@extend .y}`: Running on a file containing `.y {a: b}`, 2^17 instances of `.foo {a: b}`, and then `.x {@extend .y}`:
* sassc: 1.726s * sassc: 1.902s
* Dart Sass from a script snapshot: 1.536s * Dart Sass from a script snapshot: 1.587s
* Dart Sass native executable: 1.512s * Dart Sass native executable: 1.425s
* Dart Sass on Node.js: 2.768s * Dart Sass on Node.js: 2.550s
Based on these numbers, Dart Sass from a native executable is approximately: Based on these numbers, Dart Sass from a native executable is approximately:
* 1.1x faster than libsass * 1.3x faster than libsass
* 1.8x faster than Dart Sass on Node * 1.8x faster than Dart Sass on Node
## Preceding Dense `@extend` ## Preceding Dense `@extend`
Running on a file containing `.bar {@extend .foo}` followed by 2^17 instances of `.foo {a: b}`: Running on a file containing `.bar {@extend .foo}` followed by 2^17 instances of `.foo {a: b}`:
* sassc: 2.356s * sassc: 2.556s
* Dart Sass from a script snapshot: 2.556s * Dart Sass from a script snapshot: 2.426s
* Dart Sass native executable: 2.628s * Dart Sass native executable: 2.293s
* Dart Sass on Node.js: 5.737s * Dart Sass on Node.js: 4.843s
Based on these numbers, Dart Sass from a native executable is approximately: Based on these numbers, Dart Sass from a native executable is approximately:
* 1.1x slower than libsass * 1.1x faster than libsass
* 2.2x faster than Dart Sass on Node * 2.1x faster than Dart Sass on Node
## Following Dense `@extend` ## Following Dense `@extend`
Running on a file containing 2^17 instances of `.foo {a: b}` followed by `.bar {@extend .foo}`: Running on a file containing 2^17 instances of `.foo {a: b}` followed by `.bar {@extend .foo}`:
* sassc: 2.377s * sassc: 2.567s
* Dart Sass from a script snapshot: 2.420s * Dart Sass from a script snapshot: 2.270s
* Dart Sass native executable: 2.440s * Dart Sass native executable: 2.174s
* Dart Sass on Node.js: 5.841s * Dart Sass on Node.js: 4.285s
Based on these numbers, Dart Sass from a native executable is approximately: Based on these numbers, Dart Sass from a native executable is approximately:
* identical to libsass * 1.2x faster than libsass
* 2.4x faster than Dart Sass on Node * 2.0x faster than Dart Sass on Node
## Bootstrap ## Bootstrap
Running on a file containing 16 instances of importing the Bootstrap framework: Running on a file containing 16 instances of importing the Bootstrap framework:
* sassc: 0.820s * sassc: 0.798s
* Dart Sass from a script snapshot: 1.558s * Dart Sass from a script snapshot: 1.417s
* Dart Sass native executable: 0.927s * Dart Sass native executable: 0.708s
* Dart Sass on Node.js: 3.129s * Dart Sass on Node.js: 2.832s
Based on these numbers, Dart Sass from a native executable is approximately: Based on these numbers, Dart Sass from a native executable is approximately:
* 1.1x slower than libsass * 1.1x faster than libsass
* 3.4x faster than Dart Sass on Node * 4.0x faster than Dart Sass on Node
## a11ycolor ## a11ycolor
Running on a file containing test cases for a computation-intensive color-processing library: Running on a file containing test cases for a computation-intensive color-processing library:
* sassc: 0.264s * sassc: 0.239s
* Dart Sass from a script snapshot: 0.699s * Dart Sass from a script snapshot: 0.661s
* Dart Sass native executable: 0.375s * Dart Sass native executable: 0.319s
* Dart Sass on Node.js: 0.792s * Dart Sass on Node.js: 0.882s
Based on these numbers, Dart Sass from a native executable is approximately: Based on these numbers, Dart Sass from a native executable is approximately:
* 1.4x slower than libsass * 1.3x slower than libsass
* 2.1x faster than Dart Sass on Node * 2.8x faster than Dart Sass on Node
## Susy ## Susy
Running on a file containing test cases for the computation-intensive Susy grid framework: Running on a file containing test cases for the computation-intensive Susy grid framework:
* sassc: 0.233s * sassc: 0.201s
* Dart Sass from a script snapshot: 0.694s * Dart Sass from a script snapshot: 0.706s
* Dart Sass native executable: 0.184s * Dart Sass native executable: 0.141s
* Dart Sass on Node.js: 0.909s * Dart Sass on Node.js: 1.187s
Based on these numbers, Dart Sass from a native executable is approximately: Based on these numbers, Dart Sass from a native executable is approximately:
* 1.3x faster than libsass * 1.4x faster than libsass
* 4.9x faster than Dart Sass on Node * 8.4x faster than Dart Sass on Node
## Duomo
Running on a file containing the output of the numerically-intensive Duomo framework:
* Dart Sass from a script snapshot: 2.017s
* Dart Sass native executable: 1.213s
* Dart Sass on Node.js: 3.632s
Based on these numbers, Dart Sass from a native executable is approximately:
* 3.0x faster than Dart Sass on Node
# Prior Measurements # Prior Measurements
* [1.22.6](https://github.com/sass/dart-sass/blob/eec6ccc9d96fdb5dd30122a0c824efe8a6bfd168/perf.md).
* [1.22.5](https://github.com/sass/dart-sass/blob/ed73c2c053435703cfbee8709f0dfb110cd31487/perf.md). * [1.22.5](https://github.com/sass/dart-sass/blob/ed73c2c053435703cfbee8709f0dfb110cd31487/perf.md).
* [1.22.4](https://github.com/sass/dart-sass/blob/a7172a2b1dd48b339e5d57159ed364ffb9f5812e/perf.md). * [1.22.4](https://github.com/sass/dart-sass/blob/a7172a2b1dd48b339e5d57159ed364ffb9f5812e/perf.md).
* [1.20.2](https://github.com/sass/dart-sass/blob/4b7699291c9f69533d25980d23b0647266b665f2/perf.md). * [1.20.2](https://github.com/sass/dart-sass/blob/4b7699291c9f69533d25980d23b0647266b665f2/perf.md).
@ -169,4 +179,4 @@ Solutions for this such as [the embedded protocol][] or [WebAssembly support][]
are becoming more and more important. are becoming more and more important.
[the embedded protocol]: https://github.com/sass/sass-embedded-protocol [the embedded protocol]: https://github.com/sass/sass-embedded-protocol
[WebAssembly support]: https://github.com/dart-lang/sdk/issues/32894 [WebAssembly support]: https://github.com/dart-lang/sdk/issues/32894

26
tool/grind/benchmark.dart
View File

@ -59,6 +59,10 @@ Future<void> benchmarkGenerate() async {
await runAsync("npm", arguments: ["install"], workingDirectory: susy); await runAsync("npm", arguments: ["install"], workingDirectory: susy);
File("${sources.path}/susy.scss") File("${sources.path}/susy.scss")
.writeAsStringSync("@import '../susy/test/scss/test.scss'"); .writeAsStringSync("@import '../susy/test/scss/test.scss'");
await cloneOrCheckout("https://github.com/zaydek/duomo", "v0.7.12");
File("${sources.path}/duomo.scss")
.writeAsStringSync("@import '../duomo/scripts/duomo.scss'");
} }
/// Writes [times] instances of [text] to [path]. /// Writes [times] instances of [text] to [path].
@ -160,8 +164,15 @@ I ran five instances of each configuration and recorded the fastest time.
"Susy", "Susy",
"test cases for the computation-intensive Susy grid framework" "test cases for the computation-intensive Susy grid framework"
], ],
[
"duomo.scss",
"Duomo",
"the output of the numerically-intensive Duomo framework"
],
]; ];
var libsassIncompatible = {"Duomo"};
for (var info in benchmarks) { for (var info in benchmarks) {
var path = p.join('build/benchmark', info[0]); var path = p.join('build/benchmark', info[0]);
var title = info[1]; var title = info[1];
@ -172,17 +183,20 @@ I ran five instances of each configuration and recorded the fastest time.
buffer.writeln("Running on a file containing $description:"); buffer.writeln("Running on a file containing $description:");
buffer.writeln(); buffer.writeln();
var sasscTime = await _benchmark(p.join(sassc, 'bin', 'sassc'), [path]); Duration sasscTime;
buffer.writeln("* sassc: ${_formatTime(sasscTime)}"); if (!libsassIncompatible.contains(info[1])) {
sasscTime = await _benchmark(p.join(sassc, 'bin', 'sassc'), [path]);
buffer.writeln("* sassc: ${_formatTime(sasscTime)}");
}
var scriptSnapshotTime = await _benchmark(Platform.executable, var scriptSnapshotTime = await _benchmark(Platform.executable,
['--no-enable-asserts', p.join('build', 'sass.dart.snapshot'), path]); ['--no-enable-asserts', p.join('build', 'sass.snapshot'), path]);
buffer.writeln("* Dart Sass from a script snapshot: " buffer.writeln("* Dart Sass from a script snapshot: "
"${_formatTime(scriptSnapshotTime)}"); "${_formatTime(scriptSnapshotTime)}");
var nativeExecutableTime = await _benchmark( var nativeExecutableTime = await _benchmark(
p.join(sdkDir.path, 'bin/dartaotruntime'), p.join(sdkDir.path, 'bin/dartaotruntime'),
[p.join('build', 'sass.dart.native'), path]); [p.join('build', 'sass.native'), path]);
buffer.writeln("* Dart Sass native executable: " buffer.writeln("* Dart Sass native executable: "
"${_formatTime(nativeExecutableTime)}"); "${_formatTime(nativeExecutableTime)}");
@ -194,7 +208,9 @@ I ran five instances of each configuration and recorded the fastest time.
buffer.writeln('Based on these numbers, Dart Sass from a native executable ' buffer.writeln('Based on these numbers, Dart Sass from a native executable '
'is approximately:'); 'is approximately:');
buffer.writeln(); buffer.writeln();
buffer.writeln('* ${_compare(nativeExecutableTime, sasscTime)} libsass'); if (sasscTime != null) {
buffer.writeln('* ${_compare(nativeExecutableTime, sasscTime)} libsass');
}
buffer.writeln( buffer.writeln(
'* ${_compare(nativeExecutableTime, nodeTime)} Dart Sass on Node'); '* ${_compare(nativeExecutableTime, nodeTime)} Dart Sass on Node');
buffer.writeln(); buffer.writeln();