Add broader custom test expectations for blink tests to detect crashes. Remove also...
authormachenbach@chromium.org <machenbach@chromium.org@ce2b1a6d-e550-0410-aec6-3dcde31c8c00>
Mon, 1 Jul 2013 11:08:01 +0000 (11:08 +0000)
committermachenbach@chromium.org <machenbach@chromium.org@ce2b1a6d-e550-0410-aec6-3dcde31c8c00>
Mon, 1 Jul 2013 11:08:01 +0000 (11:08 +0000)
Most of these tests had some problems (failure, crash or timeout), but which problem exactly cannot be retrieved anymore.

We let them rum for a while with a broader test expectation (pass fail slow) and analyse the results.

Tests that crash get a crash expectation. Timeouts will get a timeout expectation.

R=jkummerow@chromium.org

Review URL: https://codereview.chromium.org/18319005

git-svn-id: http://v8.googlecode.com/svn/branches/bleeding_edge@15409 ce2b1a6d-e550-0410-aec6-3dcde31c8c00

tools/blink_tests/TestExpectations

index fa3ce3c..5c75db0 100644 (file)
@@ -1,25 +1,19 @@
-# Created by test_result_analyzer.py
-# Date:          2013-06-07 15:09:29.286522
-# Waterfall:     v8_blink
-# Revision type: webkit
-# Fail ratio:    0.2
-[ Linux Release x86 ] fast/js/JSON-stringify.html [ Skip ]
-[ Linux Release x86 ] fast/text/atsui-multiple-renderers.html [ Skip ]
-[ Linux Release x86 ] fast/text/international/complex-joining-using-gpos.html [ Skip ]
-[ Linux Release x86 ] fast/text/international/danda-space.html [ Skip ]
-[ Linux Release x86 ] fast/text/international/thai-baht-space.html [ Skip ]
-[ Linux Release x86 ] fast/text/international/thai-line-breaks.html [ Skip ]
-[ Linux Release x86 ] inspector/profiler/memory-instrumentation-external-array.html [ Skip ]
-[ Linux Release x86_64 ] fast/text/atsui-multiple-renderers.html [ Skip ]
-[ Linux Release x86_64 ] fast/text/international/complex-joining-using-gpos.html [ Skip ]
-[ Linux Release x86_64 ] fast/text/international/danda-space.html [ Skip ]
-[ Linux Release x86_64 ] fast/text/international/thai-baht-space.html [ Skip ]
-[ Linux Release x86_64 ] fast/text/international/thai-line-breaks.html [ Skip ]
-[ Linux Release x86_64 ] inspector/profiler/memory-instrumentation-external-array.html [ Skip ]
-[ Linux Debug ] fast/text/atsui-multiple-renderers.html [ Skip ]
-[ Linux Debug ] fast/text/international/complex-joining-using-gpos.html [ Skip ]
-[ Linux Debug ] fast/text/international/danda-space.html [ Skip ]
-[ Linux Debug ] fast/text/international/thai-baht-space.html [ Skip ]
-[ Linux Debug ] fast/text/international/thai-line-breaks.html [ Skip ]
-
-# Manually added tests:
+# Tests that sometimes fail only on the V8 waterfall:
+[ Linux Release x86 ] fast/js/JSON-stringify.html [ Pass Failure Slow ]
+[ Linux Release x86 ] fast/text/atsui-multiple-renderers.html [ Pass Failure Slow ]
+[ Linux Release x86 ] fast/text/international/complex-joining-using-gpos.html [ Pass Failure Slow ]
+[ Linux Release x86 ] fast/text/international/danda-space.html [ Pass Failure Slow ]
+[ Linux Release x86 ] fast/text/international/thai-baht-space.html [ Pass Failure Slow ]
+[ Linux Release x86 ] fast/text/international/thai-line-breaks.html [ Pass Failure Slow ]
+[ Linux Release x86 ] inspector/profiler/memory-instrumentation-external-array.html [ Pass Failure Slow ]
+[ Linux Release x86_64 ] fast/text/atsui-multiple-renderers.html [ Pass Failure Slow ]
+[ Linux Release x86_64 ] fast/text/international/complex-joining-using-gpos.html [ Pass Failure Slow ]
+[ Linux Release x86_64 ] fast/text/international/danda-space.html [ Pass Failure Slow ]
+[ Linux Release x86_64 ] fast/text/international/thai-baht-space.html [ Pass Failure Slow ]
+[ Linux Release x86_64 ] fast/text/international/thai-line-breaks.html [ Pass Failure Slow ]
+[ Linux Release x86_64 ] inspector/profiler/memory-instrumentation-external-array.html [ Pass Failure Slow ]
+[ Linux Debug ] fast/text/atsui-multiple-renderers.html [ Pass Failure Slow ]
+[ Linux Debug ] fast/text/international/complex-joining-using-gpos.html [ Pass Failure Slow ]
+[ Linux Debug ] fast/text/international/danda-space.html [ Pass Failure Slow ]
+[ Linux Debug ] fast/text/international/thai-baht-space.html [ Pass Failure Slow ]
+[ Linux Debug ] fast/text/international/thai-line-breaks.html [ Pass Failure Slow ]