[cffi-devel] how to treat expected failures in tests

[Luís Oliveira]

On Sun, Mar 11, 2012 at 8:22 PM, Anton Vodonosov <avodonosov at yandex.ru> wrote:
> As for CFFI, you can see that from 14 Lisp / OS combination we've
> run the tests, only on two of the all the failures are known:
> http://common-lisp.net/project/cl-test-grid/pivot_lib-lisp_ql.html

Cool stuff!

However, the results are a bit depressing. So many fails. :-) Perhaps
you could show the ration of failed to total tests and maybe show
know-fail/unexpected-ok in yellow/orange rather than red.

I wonder if compilation errors could be printed. Error messages like
this are not very helpful:
<http://cl-test-grid.appspot.com/blob?key=AMIfv97suboJpeei-uBWzlkqcR7CTlyh0Izhvi7u_29HNBgu80ScYf0Mj6zWPjgbsosA-F0Q12HP8o9S5zhsEelTfss8_3C7sjgcuG_q_grR-jMfXPLLRzu6CNytLoNk23rwqlQ6AsajxTRYFubFbz3iBWl5uo8iZQ>.

Cheers,

-- 
Luís Oliveira
http://r42.eu/~luis/