1 2012-03-11 Maciej Stachowiak <mjs@apple.com>
3 Add --instruments option to sunspider to profile with Instruments
4 https://bugs.webkit.org/show_bug.cgi?id=80783
6 Reviewed by Filip Pizlo.
8 * resources/TimeProfile20us.tracetemplate: Added.
12 2011-11-15 Andy Wingo <wingo@igalia.com>
14 Extend sunspider driver to be able to run kraken
15 https://bugs.webkit.org/show_bug.cgi?id=71799
17 Reviewed by Filip Pizlo.
19 * resources/sunspider-standalone-driver.js: Try to load a -data
20 file. If that succeeds, we have a kraken-like test, so we time
21 the test using `load'. Otherwise fall back to using `run'.
23 2011-08-11 Mark Rowe <mrowe@apple.com>
25 Fix sunspider-compare-results to default to the same suite version as the sunspider script.
27 Rubber-stamped by Maciej Stachowiak.
29 * sunspider-compare-results:
31 2011-07-02 Maciej Stachowiak <mjs@apple.com>
33 Update SunSpider versioning to 1.0
34 https://bugs.webkit.org/show_bug.cgi?id=63870
36 Reviewed by Dan Bernstein.
38 * hosted/sunspider.html:
39 * hosted/versions.html:
40 * resources/driver-TEMPLATE.html:
41 * resources/results-TEMPLATE.html:
44 2011-07-02 Maciej Stachowiak <mjs@apple.com>
46 Sunspider 0.9.1 harness doesn't actually close() its test documents
47 https://bugs.webkit.org/show_bug.cgi?id=47045
49 Reviewed by Daniel Bates.
51 * hosted/versions.html:
52 * resources/driver-TEMPLATE.html:
54 2011-07-02 Maciej Stachowiak <mjs@apple.com>
58 Fix obviou typo in previous commit.
60 * tests/sunspider-1.0/bitops-bitwise-and.js:
62 2011-07-02 Maciej Stachowiak <mjs@apple.com>
64 Reviewed by Anders Carlsson.
66 SunSpider: all four bitops benchmarks can be replaced with NOP
67 https://bugs.webkit.org/show_bug.cgi?id=38446
69 * tests/sunspider-1.0/bitops-3bit-bits-in-byte.js:
70 (TimeFunc): Save the result.
71 * tests/sunspider-1.0/bitops-bits-in-byte.js:
72 (TimeFunc): Save the result.
73 * tests/sunspider-1.0/bitops-bitwise-and.js: More explicitly
75 * tests/sunspider-1.0/bitops-nsieve-bits.js:
76 (sieve): Save the result.
78 2011-07-02 Maciej Stachowiak <mjs@apple.com>
80 SunSpider: string-validate-input.js uses an undeclared variable named 'name', which is a DOM API
81 https://bugs.webkit.org/show_bug.cgi?id=60937
83 Reviewed by Dan Bernstein.
85 * tests/sunspider-1.0/string-validate-input.js:
86 (doTest): Rename the variable to username
88 2011-07-02 Maciej Stachowiak <mjs@apple.com>
90 Reviewed by Darin Adler.
92 SunSpider: The main function of math-cordic is dead code
93 https://bugs.webkit.org/show_bug.cgi?id=63863
95 Try to prevent math-cordic from being eliminated as dead code or
96 compiled down to a constant.
98 * tests/sunspider-1.0/math-cordic.js:
102 2011-06-30 Maciej Stachowiak <mjs@apple.com>
104 Reviewed by Adam Barth.
106 Create sunspider-1.0 directory in preparation for fixing a bunch of bugs
107 https://bugs.webkit.org/show_bug.cgi?id=63782
109 * make-hosted: Learn about the new directory.
110 * tests/sunspider-1.0: Copied from PerformanceTests/SunSpider/tests/sunspider-0.9.1.
112 2010-11-29 Geoffrey Garen <ggaren@apple.com>
114 Reviewed by Gavin Barraclough.
116 Improved accuracy of command-line SunSpider.
118 * resources/sunspider-standalone-driver.js: Use the returned number of
119 elapsed milliseconds from "run" and "checkSyntax" instead of measuring
120 ourselves, for slightly more accurate numbers.
122 2010-09-16 Gavin Barraclough <barraclough@apple.com>
124 Reviewed by Mark Rowe.
125 https://bugs.webkit.org/show_bug.cgi?id=45924
127 Modify the SunSpider harness to allow a path to be passed to the --suite
128 argument, supress the normal prepend-"tests/" behaviour for suite names
131 Also wrap the code in an anonymous function to move variables out of global
132 scope (currently the harness cannot handle running tests the overwrite the
135 * resources/sunspider-standalone-driver.js:
138 2010-08-27 Michael Saboff <msaboff@apple.com>
140 Reviewed by Stephanie Lewis.
142 Added version 5 and version 6 of V8 tests with modifications similar
143 to the version 4 tests so they'll work with the SunSpider test harness.
144 Note that these files are external source and therefore don't conform
145 to WebKit coding standards.
146 https://bugs.webkit.org/show_bug.cgi?id=44638
148 * tests/v8-v5: Added.
149 * tests/v8-v5/LIST: Added.
150 * tests/v8-v5/v8-crypto.js: Added.
151 * tests/v8-v5/v8-deltablue.js: Added.
152 * tests/v8-v5/v8-earley-boyer.js: Added.
153 * tests/v8-v5/v8-raytrace.js: Added.
154 * tests/v8-v5/v8-regexp.js: Added.
155 * tests/v8-v5/v8-richards.js: Added.
156 * tests/v8-v5/v8-splay.js: Added.
157 * tests/v8-v6: Added.
158 * tests/v8-v6/LIST: Added.
159 * tests/v8-v6/v8-crypto.js: Added.
160 * tests/v8-v6/v8-deltablue.js: Added.
161 * tests/v8-v6/v8-earley-boyer.js: Added.
162 * tests/v8-v6/v8-raytrace.js: Added.
163 * tests/v8-v6/v8-regexp.js: Added.
164 * tests/v8-v6/v8-richards.js: Added.
165 * tests/v8-v6/v8-splay.js: Added.
167 2010-07-15 Stephanie Lewis <slewis@apple.com>
169 Reviewed by Geoff Garen.
171 http://bugs.webkit.org/show_bug.cgi?id=42406
172 Output location of results file.
176 2010-05-17 Maciej Stachowiak <mjs@apple.com>
178 Reviewed by Mark Rowe.
180 Browser-hosted version of SunSpider runs tests twice as many times as advertised
181 https://bugs.webkit.org/show_bug.cgi?id=39201
183 * make-hosted: Make sure to reset test list after every test suite.
185 2010-05-07 Adam Roben <aroben@apple.com>
187 Fix typo in sunspider-compare-results.js that caused incorrect
188 two-sample t statistics to be computed
190 Fixes <http://webkit.org/b/38768> SunSpider computes incorrect
191 two-sample t statistics
193 Reviewed by Darin Adler.
195 * resources/sunspider-compare-results.js:
196 (sunspiderCompareResults.resultLine): Fixed the calculation of the t
197 variable to match the definition of a two-sample t statistic. Looks
198 like this was just a simple typo.
200 2010-04-05 Darin Adler <darin@apple.com>
202 Updated the ignore property for changes to the contents here.
204 * .: Modified property svn:ignore.
206 2010-02-20 Maciej Stachowiak <mjs@apple.com>
208 Reviewed by Adam Barth.
210 Add sunspider-0.9.1 to the site in preparation for announcing it.
211 https://bugs.webkit.org/show_bug.cgi?id=35206
213 * hosted/sunspider.css: Remove tabs, which I noticed where present while
214 copying to the WebKitSite directory.
216 2010-01-11 Oliver Hunt <oliver@apple.com>
218 Reviewed by Darin Adler.
220 Sunspider parse-only tests don't run
221 https://bugs.webkit.org/show_bug.cgi?id=33489
223 Fix parse-only test list
225 * tests/parse-only/LIST:
227 2009-12-15 Maciej Stachowiak <mjs@apple.com>
229 Reviewed by Adele Peterson.
231 Make SunSpider version more prominent in the title
232 https://bugs.webkit.org/show_bug.cgi?id=32574
234 * hosted/sunspider.html:
235 * hosted/versions.html:
236 * resources/driver-TEMPLATE.html:
237 * resources/results-TEMPLATE.html:
239 2009-12-15 Maciej Stachowiak <mjs@apple.com>
241 Reviewed by Darin Adler.
243 Make SunSpider refuse to compare results across content versions
244 https://bugs.webkit.org/show_bug.cgi?id=32573
246 The results URL now includes a version indicator, and compare mode
247 will refuse to compare between versions.
249 * resources/driver-TEMPLATE.html:
250 * resources/results-TEMPLATE.html:
252 2009-12-14 Maciej Stachowiak <mjs@apple.com>
254 Reviewed by Darin Adler.
256 Some Browser-hosted SunSpider files are not valid HTML5
257 https://bugs.webkit.org/show_bug.cgi?id=32536
259 Made various fixes to validate as HTML5 with no warnings (mainly removing bogus
260 close tags and adding a meta charset declaration).
262 * hosted/sunspider.html:
263 * hosted/versions.html:
264 * resources/TEMPLATE.html:
265 * resources/driver-TEMPLATE.html:
266 * resources/results-TEMPLATE.html:
268 2009-12-14 Maciej Stachowiak <mjs@apple.com>
270 Reviewed by Eric Seidel.
272 Make sunspider-0.9.1 the default content set (both command-line and hosted)
273 https://bugs.webkit.org/show_bug.cgi?id=32537
275 * hosted/sunspider.html: Change default suite link.
276 * sunspider: Change default suite.
277 * sunspider-compare-results: Likewise.
279 2009-12-14 Maciej Stachowiak <mjs@apple.com>
281 Reviewed by Sam Weinig.
283 in-browser SunSpider suffers excessive penalty under power management
284 https://bugs.webkit.org/show_bug.cgi?id=32505
286 I have made a few changes to address this:
288 1) Change how browser-hosted SunSpider loads tests - preload the content and write it in with
289 document.write to reduce triggering of progress UI.
290 2) Reduce time between tests to 10ms from 500ms, so that power management doesn't keep the CPU
291 stepped all the way down the whole time.
292 3) Run the test cycle an extra time for warmup before the runs that count.
294 * hosted/sunspider-record-result.js: Removed.
296 * resources/TEMPLATE.html:
297 * resources/driver-TEMPLATE.html:
299 2009-12-13 Maciej Stachowiak <mjs@apple.com>
301 Reviewed by Gavin Barraclough.
303 SunSpider/tests/string-base64.js does not compute a valid base64 encoded string
304 https://bugs.webkit.org/show_bug.cgi?id=16806
306 Based on a patch by Eric Seidel.
308 Fix the base64 computation to actually compute correct results. The impact on runtime of
309 the test is pretty small, but noticeable for some browsers. But at least it's not
310 doing a wrong and meaningless computation any more.
312 * tests/sunspider-0.9.1/string-base64.js:
316 2009-12-13 Maciej Stachowiak <mjs@apple.com>
318 Fixing commit error...
320 I accidentally committed my last patch in a form that broke Web-hosted SunSpider. Fixing.
322 * resources/driver-TEMPLATE.html:
324 2009-12-13 Maciej Stachowiak <mjs@apple.com>
326 Reviewed by Sam Weinig.
328 Use JSON.parse instead of eval for Web-hosted SunSpider results processing
329 https://bugs.webkit.org/show_bug.cgi?id=32490
331 * hosted/json2.js: Added. Incorporated from json.org
332 * resources/driver-TEMPLATE.html: Fix an HTML validation bug I noticed.
333 * resources/results-TEMPLATE.html: Use JSON.parse instead of eval to process
336 2009-12-12 Maciej Stachowiak <mjs@apple.com>
338 Reviewed by Oliver Hunt.
340 Enable Web-hosted version of SunSpider to handle multiple versions
341 https://bugs.webkit.org/show_bug.cgi?id=32478
343 * make-hosted: Now generate the hosted version to be able to run both the
344 0.9 and the 0.9.1 test suites.
345 * hosted: Modified property svn:ignore.
346 * hosted/sunspider-driver.html: Removed.
347 * hosted/sunspider-results.html: Removed.
348 * hosted/sunspider.html:
349 * hosted/versions.html: Added.
350 * resources/TEMPLATE.html:
351 * resources/driver-TEMPLATE.html: Copied from hosted/sunspider-driver.html.
352 * resources/driver-TEMPLATE.html: Copied from hosted/sunspider-results.html.
354 2009-12-12 Maciej Stachowiak <mjs@apple.com>
356 Reviewed by Oliver Hunt.
358 Give command-line sunspider the ability to handle multiple suites and versions
359 https://bugs.webkit.org/show_bug.cgi?id=32477
361 Each suite/version's set of tests are now in a separate subdirectory of tests/, with a file named LIST
362 enumerating the tests. Current suites are:
364 sunspider-0.9 - riginal SunSpider content
365 sunspider-0.9.1 - SunSpider suite with a few tests fixed (and a few more to come)
366 ubench - "ubench" microbenchmark suite
367 v8-v4 - version 4 of the v8 benchmark
368 parse-only - some parser tests
370 Sunspider can now be run with the --suite= parameter to select a
371 suite. The default is --suite=sunspider-0.9.
373 * .: Modified property svn:ignore to ignore new results directories.
374 * make-hosted: Generate based on sunspider-0.9 suite.
375 * resources/TEMPLATE.html: Fix an HTML compliance problem.
376 * resources/sunspider-standalone-driver.js: Become aware of suite names.
377 * sunspider: Modified to handle multiple suites as described above.
378 * sunspider-compare-results: ditto
379 * tests/LIST: Moved to tests/sunspider-0.9/ and tests/sunspider-0.9.1/
380 * tests/LIST-PARSE-ONLY: Moved to parse-only/LIST
381 * tests/LIST-UBENCH: Removed.
382 * tests/LIST-V8: Removed.
383 * tests/3d-cube.js: Moved to tests/sunspider-0.9 and tests/sunspider-0.9.1
384 * tests/3d-morph.js: ditto
385 * tests/3d-raytrace.js: ditto
386 * tests/access-binary-trees.js: ditto
387 * tests/access-fannkuch.js: ditto
388 * tests/access-nbody.js: ditto
389 * tests/access-nsieve.js: ditto
390 * tests/bitops-3bit-bits-in-byte.js: ditto
391 * tests/bitops-bits-in-byte.js: ditto
392 * tests/bitops-bitwise-and.js: ditto
393 * tests/bitops-nsieve-bits.js: ditto
394 * tests/controlflow-recursive.js: ditto
395 * tests/crypto-aes.js: ditto
396 * tests/crypto-md5.js: ditto
397 * tests/crypto-sha1.js: ditto
398 * tests/date-format-tofte.js: ditto
399 * tests/date-format-xparb.js: ditto
400 * tests/math-cordic.js: ditto
401 * tests/math-partial-sums.js: ditto
402 * tests/math-spectral-norm.js: ditto
403 * tests/regexp-dna.js: ditto
404 * tests/string-base64.js: ditto
405 * tests/string-fasta.js: ditto
406 * tests/string-tagcloud.js: ditto
407 * tests/string-unpack-code.js: ditto
408 * tests/string-validate-input.js: ditto
409 * tests/sunspider-0.9/: Added
410 * tests/sunspider-0.9/*.js: Moved from one level up
411 * tests/sunspider-0.9.1: Added.
412 * tests/sunspider-0.9.1/*.js: Moved from one level up.
413 * tests/v8-crypto.js: Moved to v8-v4/ directory.
414 * tests/v8-deltablue.js: ditto
415 * tests/v8-earley-boyer.js: ditto
416 * tests/v8-raytrace.js: ditto
417 * tests/v8-regexp.js: ditto
418 * tests/v8-richards.js: ditto
419 * tests/v8-splay.js: ditto
420 * tests/v8-v4: Added.
422 2009-09-30 Csaba Osztrogonac <oszi@inf.u-szeged.hu>
424 Reviewed by Darin Adler.
426 Platform specific null device replaced with a platform independent.
427 https://bugs.webkit.org/show_bug.cgi?id=29544
429 * sunspider: Using File::Spec->devnull() instead of /dev/null and NUL.
431 2009-09-21 Csaba Osztrogonac <oszi@inf.u-szeged.hu>
433 Reviewed by Maciej Stachowiak.
435 [Qt] Make sunspider script work on Windows platform.
436 https://bugs.webkit.org/show_bug.cgi?id=29544
439 Using platform specific null device instead of /dev/null.
441 2009-06-19 Adam Treat <adam.treat@torchmobile.com>
443 Reviewed by Oliver Hunt.
445 https://bugs.webkit.org/show_bug.cgi?id=26540
446 Currently the SunSpider test driver lacks an option to run a test suite that
447 will test JavaScriptCore parsing performance only. This patch adds just such
448 a test suite and option to SunSpider as well as the jsc test shell. I've included
449 three large javascript source files found in the wild: jquery, mootools and prototype.
450 Combined with the concatenation of all three, these form a new testsuite to measure
451 and test pure JavaScriptCore parsing performance.
453 * resources/sunspider-standalone-driver.js:
454 Load the js with parse-only flag if it is part of the parse-only suite.
456 Add the parse-only suite to the list of options.
457 * sunspider-compare-results:
458 Add the parse-only suite to the list of options.
459 * tests/LIST-PARSE-ONLY: Added.
460 * tests/parse-only/concat-jquery-mootools-prototype.js: Added.
461 A very large concatenation of the scripts found below. This js takes ~30ms to parse on my machine.
462 * tests/parse-only/jquery-1.3.2.js: Added.
463 Latest version from jquery.com.
464 * tests/parse-only/mootools-1.2.2-core-nc.js: Added.
465 Latest version from mootools.net.
466 * tests/parse-only/prototype-1.6.0.3.js: Added.
467 Latest version from prototypejs.org.
469 2009-06-13 Steve Falkenburg <sfalken@apple.com>
471 Update V8 benchmark to version 4.
473 Reviewed by Cameron Zwarich.
476 * tests/v8-crypto.js:
477 * tests/v8-deltablue.js:
478 * tests/v8-earley-boyer.js:
479 * tests/v8-raytrace.js:
480 * tests/v8-regexp.js: Added.
481 * tests/v8-richards.js:
482 * tests/v8-splay.js: Added.
484 2009-05-26 Olivier DOLE <odole@pleyo.com>
488 Store sunspider test suite results in a specific directory for each
489 different type of benchmark (sunspider, V8 or ubench).
492 * sunspider-compare-results:
494 2009-05-12 Steve Falkenburg <sfalken@apple.com>
500 2009-05-11 Steve Falkenburg <sfalken@apple.com>
502 Include SunSpider tests in production builds.
504 Reviewed by Adam Roben.
506 * SunSpider.make: Added.
507 * xcopy.excludes: Added.
509 2009-03-04 Oliver Hunt <oliver@apple.com>
511 Added a few more tests to ubench
515 Adding a couple of test to cover too few and too many arguments. This
516 is needed to prevent regressions in all call paths from my current refactoring.
519 * tests/ubench/function-correct-args.js: Added.
521 * tests/ubench/function-excess-args.js: Added.
524 2008-10-30 Zoltan Horvath <Horvath.Zoltan.6@stud.u-szeged.hu>
526 Fix a bug where when V8's or UBENCH's test suite list file is missing
527 the error message is suggesting that SunSpider's list file is missing.
529 Reviewed by Sam Weinig.
532 (loadTestsList): Fix the error message to use the right list name.
534 2008-10-07 David Hyatt <hyatt@apple.com>
536 https://bugs.webkit.org/show_bug.cgi?id=18989
538 Remove global substitution from SunSpider regexp test, since only Firefox was honoring it and
539 we want all browsers to be doing the same thing on the test.
543 * tests/regexp-dna.js:
545 2008-09-09 Cameron Zwarich <cwzwarich@uwaterloo.ca>
547 Rubber-stamped by Maciej Stachowiak.
549 The bleeding edge branch of V8 now supports passing fileanmes after
550 '-f', so the SunSpider script should be changed to do this again.
551 This allows all 3 major JavaScript engines to be used with the
552 unmodified SunSpider script.
556 2008-09-04 Cameron Zwarich <cwzwarich@uwaterloo.ca>
558 Reviewed by Maciej Stachowiak.
560 Add a '--args' option to SunSpider, so that we can pass '-j' to TraceMonkey
561 and '--expose-gc' to V8. Also, rename the '--v8' option to '--v8-suite' and
562 correct the punctuation in its documentation.
566 2008-09-04 Cameron Zwarich <cwzwarich@uwaterloo.ca>
568 Reviewed by Oliver Hunt.
570 Bug 20616: Incorporate V8 benchmarks in testing
571 <https://bugs.webkit.org/show_bug.cgi?id=20616>
573 This is a first attempt at running the V8 benchmarks within SunSpider,
574 with the --v8 option. The number of iterations is fixed for each
575 benchmark, and was chosen to make each of the benchmarks run between
576 500 ms and 600 ms in V8 on my machine, a 2.16 GHz MacBook Pro.
579 * tests/LIST-V8: Added.
580 * tests/v8-crypto.js: Added.
581 * tests/v8-deltablue.js: Added.
582 * tests/v8-earley-boyer.js: Added.
583 * tests/v8-raytrace.js: Added.
584 * tests/v8-richards.js: Added.
586 2008-09-02 Cameron Zwarich <cwzwarich@uwaterloo.ca>
590 Remove a local change that was accidentally committed in r36034.
592 * resources/sunspider-standalone-driver.js:
594 2008-09-02 Cameron Zwarich <cwzwarich@uwaterloo.ca>
596 Rubber-stamped by Oliver Hunt.
598 Make SunSpider work with JavaScript shells that don't take filenames
599 after a '-f' argument.
603 2008-06-07 Cameron Zwarich <cwzwarich@uwaterloo.ca>
607 Remove the --squirrelfish option from SunSpider, as it is no longer needed.
610 * tests/LIST-SQUIRRELFISH: Removed.
612 2008-06-03 Alexey Proskuryakov <ap@webkit.org>
614 Rubber-stamped by Mark Rowe.
616 Roll out r31215 - with Mac OS X 10.5.3, there is no need to pause update daemon any more.
620 2008-04-15 Maciej Stachowiak <mjs@apple.com>
622 Rubber stamped by Oliver.
624 - add newly working tests to squirrelfish list
626 * tests/LIST-SQUIRRELFISH: Add 3d-raytrace and string-unpack-code
628 2008-04-14 Maciej Stachowiak <mjs@apple.com>
630 Rubber stamped by Oliver.
632 - move ubench tests properly.
634 * tests/ubench: Added.
635 * tests/ubench/function-closure.js: Added.
636 * tests/ubench/function-empty.js: Added.
637 * tests/ubench/function-missing-args.js: Added.
638 * tests/ubench/function-sum.js: Added.
639 * tests/ubench/loop-empty-resolve.js: Added.
640 * tests/ubench/loop-empty.js: Added.
641 * tests/ubench/loop-sum.js: Added.
643 2008-04-14 Maciej Stachowiak <mjs@apple.com>
645 Rubber stamped by Oliver.
647 * sunspider: Don't force --runs=1 in squirrelfish mode any more.
649 2008-04-14 Maciej Stachowiak <mjs@apple.com>
653 - make --squirrelfish mode use the real harness, but a reduced set of tests
655 Also add a new ubench mode which runs the older squirrelfish microbenchmarks.
658 * tests/LIST-SQUIRRELFISH:
659 * tests/LIST-UBENCH: Added.
660 * tests/squirrelfish: Moved to tests/ubench
662 2008-04-14 Geoffrey Garen <ggaren@apple.com>
664 Reviewed by Maciej Stachowiak.
666 Removed an unused test.
668 * tests/squirrelfish/loop-resolve.js: Removed.
670 2008-04-10 Maciej Stachowiak <mjs@apple.com>
674 Add newly runnable tests to --squirrelfish mode.
676 * tests/LIST-SQUIRRELFISH:
678 2008-04-06 Geoffrey Garen <ggaren@apple.com>
680 Reviewed by Maciej Stachowiak.
682 A little more love for --squirrelfish mode:
684 Fixed a misplaced sort. Results properly sort now.
686 Added a test list just for squirrelfish, and updated it to include
687 all currently passing SunSpider tests.
689 Fixed the pruning regexp to match 3d-morph.js.
693 2008-03-26 Geoffrey Garen <ggaren@apple.com>
695 Reviewed by Oliver Hunt.
697 --squirrelfish mode: pared down tests for squirrelfish to chew on.
701 * tests/squirrelfish: Added.
702 * tests/squirrelfish/function-closure.js: Added.
703 * tests/squirrelfish/function-empty.js: Added.
704 * tests/squirrelfish/function-missing-args.js: Added.
705 * tests/squirrelfish/function-sum.js: Added.
706 * tests/squirrelfish/loop-empty-resolve.js: Added.
707 * tests/squirrelfish/loop-empty.js: Added.
708 * tests/squirrelfish/loop-resolve.js: Added.
709 * tests/squirrelfish/loop-sum.js: Added.
711 2008-03-21 Alexey Proskuryakov <ap@webkit.org>
715 * sunspider: Pause update daemon on Darwin to make results reliable
716 again (workaround for <rdar://problem/5811127>).
718 2008-02-07 Eric Seidel <eric@webkit.org>
722 * sunspider: add an error message when ./tests/LIST is not found
724 2007-12-29 Alp Toker <alp@atoker.com>
728 * hosted/sunspider.html:
730 2007-12-29 Alp Toker <alp@atoker.com>
734 Provide the current URL in the SunSpider results page. Useful for
735 copying benchmark results out of browsers without a location bar or
736 where the location bar can't handle long URLs.
738 * hosted/sunspider-results.html:
740 2007-12-20 Eric Seidel <eric@webkit.org>
744 * sunspider: increase default number of runs for more accurate numbers
746 2007-12-18 Mark Rowe <mrowe@apple.com>
750 * hosted/sunspider.html:
752 2007-12-18 Maciej Stachowiak <mjs@apple.com>
756 - give an extra digit of precision for small differences.
758 * resources/sunspider-compare-results.js:
760 2007-12-17 Maciej Stachowiak <mjs@apple.com>
764 - work around IE layout bugs
766 * hosted/sunspider.css:
768 2007-12-17 Maciej Stachowiak <mjs@apple.com>
772 - fix compare feature
774 * hosted/sunspider-results.html:
776 2007-12-17 Maciej Stachowiak <mjs@apple.com>
780 - Change the format of the output URL to be shorter, to meet IE constraints
782 * hosted/sunspider-driver.html:
783 * hosted/sunspider-results.html:
785 2007-12-13 Maciej Stachowiak <mjs@apple.com>
789 - Add some explanatory test and a dumb logo to SunSpider web hosted version
791 * hosted/sunspider-driver.html:
792 * hosted/sunspider-results.html:
793 * hosted/sunspider.css:
794 * hosted/sunspider.html:
796 2007-12-13 Maciej Stachowiak <mjs@apple.com>
800 - Make the web-hosted version of SunSpider look a little bit less drab.
802 * hosted/sunspider-driver.html:
803 * hosted/sunspider-results.html:
804 * hosted/sunspider.css: Added.
805 * hosted/sunspider.html:
806 * resources/TEMPLATE.html:
808 2007-12-12 Maciej Stachowiak <mjs@apple.com>
812 - Change sunspider-compare-results output from showing "% faster" values to "x as fast" values.
814 A sample of what new-style results would look like:
816 TEST COMPARISON FROM TO DETAILS
818 ** TOTAL **: 1.41x as fast 6613.6ms +/- 0.1% 4703.0ms +/- 0.1% significant
820 3bit-bits-in-byte: *1.36x as slow* 88.8ms +/- 0.6% 121.1ms +/- 0.6% significant
822 * resources/sunspider-compare-results.js:
824 2007-11-14 Eric Seidel <eric@webkit.org>
828 * sunspider: add --shark-cache for L2 Cache Miss profiling
830 2007-11-09 Alexey Proskuryakov <ap@webkit.org>
832 Reviewed by Darin Adler.
834 http://bugs.webkit.org/show_bug.cgi?id=15925
835 SunSpider should check for Shark being installed
837 * sunspider: Explicitly test that shark command line tool is installed.
839 2007-11-04 Darin Adler <darin@apple.com>
841 * hosted/sunspider.html: Tweaked formatting a bit.
843 2007-11-03 Maciej Stachowiak <mjs@apple.com>
845 Reviewed by Darin Adler.
847 - Add compare mode and a description of the benchmark to the hosted version.
849 * hosted/sunspider-results.html: Add compare mode - you can just paste in another results URL.
850 * hosted/sunspider.html: Added intro text.
851 * make-hosted: Copy new file.
852 * resources/sunspider-compare-results.js: Made more reusable by putting the implementation in
854 * resources/sunspider-standalone-compare.js: Added. Calls the function in the way standalone mode
856 * sunspider-compare-results: Use sunspider-standalone-compare.js.
858 2007-11-02 Darin Adler <darin@apple.com>
860 * sunspider: Changed "--base" to "--set-baseline".
862 2007-11-02 Darin Adler <darin@apple.com>
866 * sunspider: Added a "--base" option that records the current test as a baseline.
867 Moved the code to find the newest .mshark file into a function (since I needed to use
868 it in the other script and I prefer to copy/paste a function).
870 * sunspider-compare-results: Added logic to compare the baseline with the last
871 run when you don't pass any parameters.
873 2007-10-29 Maciej Stachowiak <mjs@apple.com>
877 - Added list of ECMAScript3 features that SunSpider does not cover currently.
881 2007-10-29 Maciej Stachowiak <mjs@apple.com>
885 - Give better error messages when sunspider-compare-results fails
887 * sunspider-compare-results:
889 2007-10-29 Maciej Stachowiak <mjs@apple.com>
891 Reviewed by Darin Adler.
893 - fix Date tests to work in command-line SpiderMonkey
895 * tests/date-format-tofte.js:
896 * tests/date-format-xparb.js:
898 2007-10-29 Darin Adler <darin@apple.com>
902 * sunspider: Added --shark20 option, to run Shark at its highest sample
903 resolution instead of its default.
905 2007-10-28 Adam Roben <aroben@apple.com>
907 Fix SunSpider on Windows
911 * sunspider: Don't use colons in filenames.
913 2007-10-28 Darin Adler <darin@apple.com>
917 * resources/sunspider-analyze-results.js: Tweak the output format a little.
918 Change so that when there's only one run we don't write out confidence
919 intervals at all rather than writing "NaN" over and over again.
921 * sunspider: Use the time and date as a suffix on the results file, that way
922 all the results are left behind in the tmp directory. This will make it easy
923 for us to add features that compare past results in the future. Also rename
924 the .mshark files using the same scheme.
926 * sunspider-compare-results: Relax the parsing rules so we can parse the
927 results file exactly as it's emitted from sunspider.
929 2007-10-25 Adam Roben <aroben@apple.com>
931 Strip carriage returns from results
933 Carriage returns were screwing up sunspider-compare-results on
936 Rubberstamped by Oliver.
940 2007-10-24 Darin Adler <darin@apple.com>
944 * sunspider: Open the profile in shark after completing a run.
945 * sunspider-compare-results: Tiny perl tweaks.
947 2007-10-23 Maciej Stachowiak <mjs@apple.com>
949 Reviewed by Darin Adler.
951 - Don't hardcode my path to testkjs
953 * sunspider-compare-results:
955 2007-10-23 Maciej Stachowiak <mjs@apple.com>
957 Reviewed by Darin Adler.
959 - Add a compare script to compare results, and improve formatting of standard results a bit.
961 * resources/sunspider-analyze-results.js:
962 * resources/sunspider-compare-results.js: Added.
963 * sunspider-compare-results: Added.
965 2007-10-23 Maciej Stachowiak <mjs@apple.com>
967 Reviewed by Darin Adler.
969 * resources/sunspider-analyze-results.js: Do the error range
970 properly, using the t-distribution instead of 1.96 (which was
971 based on the normal distribution).
973 * sunspider: Print results in a way that will be friendlier to the
974 soon-to-come compare mode.
976 2007-10-22 Maciej Stachowiak <mjs@apple.com>
980 - add more tests (probably the final set for now)
982 Already balanced. Added date, regexp, control flow, and a few
983 more string and object/array access tests.
986 * tests/access-fannkuch.js: Added.
987 * tests/access-nbody.js: Added.
988 * tests/controlflow-recursive.js: Added.
989 * tests/date-format-tofte.js: Added.
990 * tests/date-format-xparb.js: Added.
991 * tests/regexp-dna.js: Added.
992 * tests/string-validate-input.js: Added.
994 2007-10-21 Eric Seidel <eric@webkit.org>
998 * sunspider: make --shark only sample from testkjs
1000 2007-10-21 Maciej Stachowiak <mjs@apple.com>
1002 Rubber stamped by Eric.
1004 - added crypto tests (already balanced)
1007 * tests/crypto-aes.js: Added.
1008 * tests/crypto-md5.js: Added.
1009 * tests/crypto-sha1.js: Added.
1011 2007-10-21 Maciej Stachowiak <mjs@apple.com>
1015 - rebalance new tests
1017 Scaled the new tests so they take 400-600ms on a reasonably normal user setup:
1019 Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
1021 This balances them with the existing tests.
1023 * tests/access-binary-trees.js:
1024 * tests/access-nsieve.js:
1025 * tests/bitops-nsieve-bits.js:
1026 * tests/math-partial-sums.js:
1027 * tests/math-spectral-norm.js:
1028 * tests/string-fasta.js:
1030 2007-10-20 Eric Seidel <eric@webkit.org>
1034 Add improved argument handling to sunspider, including
1035 --runs=<number>, --tests=<pattern, --shark, and --help
1036 Also re-factor code into subroutines
1038 * sunspider: improved argument handling
1040 2007-10-20 Maciej Stachowiak <mjs@apple.com>
1044 - Add more new tests, mostly from the computer language shootout. Not normalized yet.
1048 * tests/access-binary-trees.js: Added.
1049 * tests/access-nsieve.js: Added.
1050 * tests/bitops-nsieve-bits.js: Added.
1051 * tests/math-partial-sums.js: Added.
1052 * tests/math-spectral-norm.js: Added.
1053 * tests/string-fasta.js: Added.
1055 2007-10-20 Maciej Stachowiak <mjs@apple.com>
1057 Reviewed by Darin Adler.
1059 * TODO: Updated to note areas that are now well-covered.
1061 - Change the tests and the driver to avoid leaving large object
1062 graphs hanging around, since that throws off the subsequent tests.
1064 * resources/sunspider-standalone-driver.js:
1066 * tests/3d-morph.js:
1067 * tests/3d-raytrace.js:
1068 * tests/bitops-bitwise-and.js:
1069 * tests/string-base64.js:
1070 * tests/string-tagcloud.js:
1072 2007-10-20 Maciej Stachowiak <mjs@apple.com>
1074 Reviewed by Nikolas.
1076 - Rebalance test complexity.
1078 Scaled all the tests so they take 400-600ms on a reasonably normal user setup:
1080 Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
1082 However, for some tests, IE7 was a huge outlier compared to other
1083 major browsers. For those tests, I used Firefox 2.0.0.8 on the
1084 same OS and hardware as a normalization basis.
1086 * tests/3d-morph.js:
1087 * tests/3d-raytrace.js:
1088 * tests/bitops-3bit-bits-in-byte.js:
1089 * tests/bitops-bits-in-byte.js:
1090 * tests/bitops-bitwise-and.js:
1091 * tests/math-cordic.js:
1092 * tests/string-base64.js:
1093 * tests/string-tagcloud.js:
1094 * tests/string-unpack-code.js:
1096 2007-10-20 Maciej Stachowiak <mjs@apple.com>
1100 - Fix the browser-hosted driver to be compatible with Safari 2
1102 * hosted/sunspider-driver.html:
1104 2007-10-20 Maciej Stachowiak <mjs@apple.com>
1106 Rubber stamped by Hyatt.
1108 - Add BSD license notice to cordic test, the original author said to do so.
1110 * tests/math-cordic.js:
1112 2007-10-18 Maciej Stachowiak <mjs@apple.com>
1116 - Support Windows and Windows browsers.
1118 * hosted/sunspider-results.html: Display results correctly in IE.
1119 * sunspider: tweaks to work on Windows, and with spaces in the path.
1121 2007-10-18 Maciej Stachowiak <mjs@apple.com>
1123 Rubber stamped by Oliver.
1125 * tests/string-tagcloud.js: Remove stray print()
1127 2007-10-17 Maciej Stachowiak <mjs@apple.com>
1131 Add some string test cases.
1133 * tests/string-base64.js: Added. Does base64 encoding and decoding.
1134 * tests/string-tagcloud.js: Added. Parses a JSON string and
1135 generates tagcloud HTML markup based on the data.
1136 * tests/string-unpack-code.js: Added. Unpack compressed versions of
1137 four of the most popular JavaScript libraries.
1138 * tests/LIST: Added the new tests.
1140 2007-10-16 Maciej Stachowiak <mjs@apple.com>
1144 * TODO: Updated with info on how to do the stats properly.
1146 * hosted/sunspider-driver.html: Reduce timeout from 500 to 200 to
1147 avoid overly slowing down the benchmark.
1149 Added some 3D-related test cases.
1151 * tests/3d-cube.js: Added.
1152 * tests/3d-morph.js: Added.
1153 * tests/3d-raytrace.js: Added.
1156 2007-10-14 Maciej Stachowiak <mjs@apple.com>
1158 Reviewed by Darin Adler.
1160 - New JavaScript benchmark
1161 http://bugs.webkit.org/show_bug.cgi?id=15515
1163 A start on a new JavaScript benchmark, with standalone and
1164 browser-hosted drivers.
1166 The test content is still incomplete and the drivers could use
1167 some more features but there is enough here to make a good start.
1169 The drivers compute a 95% confidence interval on the mean for the
1170 whole test, each category, and each individual test to make it
1171 easier to tell whether differences are statistically
1172 significant. The confidence interval can be narrowed by running
1173 the test more times.
1175 * TODO: Added. Remaining things that need to be done.
1176 * sunspider: Added. Perl script that acts as the standalone test driver.
1177 * resources/sunspider-standalone-driver.js: Added. JavaScript part
1178 of standalone test driver.
1179 * resources/sunspider-analyze-results.js: Added. JavaScript statistical
1181 * resources/TEMPLATE.html: Added. Template for browser-hosted tests.
1182 * make-hosted: Added. Script to generate browser-hosted tests.
1183 * hosted/sunspider.html: Added. Start page for browser-hosted test.
1184 * hosted/sunspider-driver.html: Added. Driver for browser-hosted tests.
1185 * hosted/sunspider-results.html: Added. Results page for browser-hosted
1187 * hosted/sunspider-record-result.js: Added. Helper file for browser-hosted
1189 * tests/LIST: Added. List of tests to use.
1190 * tests/bitops-3bit-bits-in-byte.js: Added. Some initial test content.
1191 * tests/bitops-bits-in-byte.js: Added. Ditto.
1192 * tests/bitops-bitwise-and.js: Added. Ditto.
1193 * tests/math-cordic.js: Added. Ditto.