Aman Gupta
f49cffeb19
framework is required
2015-10-07 18:28:57 -07:00
Aman Gupta
24ec975aa1
fix compile error
2015-10-07 18:15:59 -07:00
Aman Gupta
f0793a6d97
collect any output of appveyor command
2015-10-07 17:50:54 -07:00
Aman Gupta
582c5054a1
report duration to appveyor runner
2015-10-07 16:42:08 -07:00
Aman Gupta
3dfcaec25f
use category as filename, and full filename in test name
2015-10-07 16:27:06 -07:00
Aman Gupta
6af9ac18f1
clean up whitespace on error msg
2015-10-07 16:25:03 -07:00
Aman Gupta
c34cbe690c
tie into appveyor test results api
2015-10-07 16:06:51 -07:00
Aman Gupta
2240fd3f3f
add tfile/tline assertions for template expansion file/line
2015-10-06 15:47:07 -07:00
Aman Gupta
6e7759734e
show stderr w/ reExitcodesDiffer
2015-10-02 17:38:48 -07:00
Aman Gupta
b093c0abd0
show full compiler output with reNimcCrash
2015-09-30 19:32:09 -07:00
Aman Gupta
435fbbc943
allow testament/tester to run single file
2015-09-30 12:09:58 -07:00
Adam Strzelecki
e80465dacf
tests: Trim .nim files trailing whitespace
...
via OSX: find . -name '*.nim' -exec sed -i '' -E 's/[[:space:]]+$//' {} +
2015-09-04 23:04:32 +02:00
Oscar Campbell
ee3d390b3f
Revert from columnar layout. Remove temp-fix for 2857.
2015-06-10 19:52:26 +02:00
Oscar Campbell
0a810fd10f
Treat unitest's default esc.seq. output as empty.
2015-06-04 22:53:39 +02:00
Oscar Campbell
071ccf3d02
Add "safety compilation". Improved, fixed messages
...
- node ext searcher also looks for "iojs" if no node(js?) found.
- koch ensures the local work dir compiler is freshly compiled before executing the tests.
- the tester can only run in the repo dir - now the compiler and libs used are also explicitly the local dirs - so no confusion from system wide pathing ("sufficiently sandboxed").
- fixed expectations in tmitems.nim test to match changes in json mod.
- re-layouted the columns / row printing slightly, making test fails pop out more, and everything "normal" layed back.
2015-06-04 07:33:27 +02:00
Sergey Avseyev
411e602d13
Introduce pedantic mode for tester
...
Motivation
----------
External tools need to know whether or not any test in suite failed. For
example buildbot, or packaging tool would like to stop the execution and
mark it as failed if some tests does not pass.
Modification
------------
Add `--pedantic` switch to tester program which will force it to quit
with non-zero exit code if at least one failure detected. Also update
`tests()` proc in koch to inspect result from tester and propagate it to
user.
Result
------
Nothing has changed in default behaviour. But following invocations will
exit with non-zero code if there failed tests:
./koch tests --pedantic all
./tests/testament/tester --pedantic all
2015-05-25 22:37:30 +03:00
Simon Hafner
2bc1db7a30
run the C test too
2015-05-13 13:13:30 -05:00
Simon Hafner
9c4a74637d
Merge branch 'devel' into jpoirier-realtimeGCTest
2015-05-13 12:06:05 -05:00
Araq
6725aa3634
fixes #2517
2015-04-25 23:16:59 +02:00
Adam Strzelecki
505836385c
Tests: Optional error location column spec
...
This allows some test to specify error location column, to ensure compiler is
generating diagnostics pointing to exactly right place of an error.
2015-04-20 21:03:57 +02:00
Simon Hafner
c55f884b5c
integrated realtimegc stuff into testament
2015-04-13 22:36:35 -05:00
def
64903e7050
Use ^ instead of - in slices
2015-03-28 00:38:15 +01:00
def
cb3c99fe1f
Fix tests some more
2015-03-17 00:02:47 +01:00
Araq
f514be0772
fixes #2286
2015-03-12 01:45:15 +01:00
Araq
0032912d10
fixed the tester; more tests green
2015-03-10 12:32:48 +01:00
Simon Hafner
2b4dcc9f33
one result too much
2015-03-09 14:26:08 -05:00
Simon Hafner
8f8171a0c4
fixed tester back up
2015-03-09 11:30:40 -05:00
Simon Hafner
fb8c0280bd
better messages for nimout
2015-03-05 16:15:28 -06:00
Araq
335c19c869
tester reports ignored tests and supports 'nimout'; fixes #2211
2015-02-25 12:59:32 +01:00
def
c58573b34a
Fix name of generated C file in tester
...
- Makes tests/ccgbugs/tmissingvolatile work again
2015-02-04 20:41:29 +01:00
Dominik Picheta
6143393adb
Move lib/pure/nodejs to compiler/nodejs. Ref #2017 .
2015-01-28 14:58:31 +00:00
Andreas Rumpf
190cc01f24
Merge pull request #2017 from reactormonk/nodejs-binary
...
Algorithm to find the nodejs binary
2015-01-28 15:14:39 +01:00
Simon Hafner
2beaa7a2da
find the nodejs binary
...
upstream calls it node, debian calls it nodejs. We gotta look for both
of them.
2015-01-27 13:02:17 -06:00
Araq
efb5ec3e73
proper 'space in dir' test
2015-01-27 01:33:48 +01:00
Guillaume Gelin
3119fe087d
Happy new year!
2015-01-06 15:26:33 +01:00
Araq
cd2c6128d1
renamed babelcmd to nimblecmd; config files are now nim.cfg; other renamings
2014-08-29 09:03:00 +02:00
Araq
6713ebcd98
tester compiles again
2014-08-29 01:12:18 +02:00
Araq
bea1761da1
tester works again
2014-05-30 17:04:39 +02:00
Araq
f12a0820e0
added 'sortoutput' option to make output deterministic for threading tests
2014-05-29 13:19:26 +02:00
Dominik Picheta
e80930247f
Tester now ignores deprecation warnings.
2014-04-21 00:17:00 +01:00
Dominik Picheta
2fb5d62927
Tester now appreciates the test target. Modified 'cmd' in specs.
2014-04-16 21:28:19 +01:00
Dominik Picheta
6692d95ee2
Fixes incorrect nodejs detection in tester.
2014-04-16 21:02:34 +01:00
Dominik Picheta
c93c014bc6
Modified tester output. Fixed JS tests.
2014-04-16 12:26:02 +01:00
Zahary Karadjov
f49f2f38f0
fix the handling of "msg" tests
2014-03-20 23:12:24 +02:00
Zahary Karadjov
26890b6525
make some tests red :) (i.e. print failure details while running the tester)
2014-03-16 21:05:20 +02:00
Zahary Karadjov
49b0440c47
make some tests green
2014-03-16 20:42:49 +02:00
Araq
d29aa4c5ac
new tester produces json output
2014-02-02 00:41:04 +01:00
Araq
383fbca27e
better tester
2014-01-17 08:47:51 +01:00
Araq
fc452787e7
better html generator for the tester; fixes some VM bugs
2014-01-17 01:18:57 +01:00
Araq
c648a5774a
tester support html generation
2014-01-14 01:12:56 +01:00
