Andreas Rumpf
76c8d6164b
added 'koch testinstall' command; more installer related bugfixes
2016-06-09 17:34:57 +02:00
Andreas Rumpf
9a747828fe
Merge pull request #4049 from arnetheduck/tester-targets
...
tester: allow filtering tests by target
2016-04-07 13:34:01 +02:00
Dominik Picheta
082ba914bc
Prevent tester from checking for output diffs for actionRunNoSpec.
2016-04-05 21:45:52 +01:00
Jacek Sieka
796f4e917c
untaint command line option for parsing
2016-04-06 00:01:57 +08:00
Jacek Sieka
25abb7c2b6
tester: allow filtering tests by target
2016-04-05 20:51:13 +08:00
Adam Strzelecki
abb82554b7
compiler/msgs: Default to stderr for diagnostics
...
Previously we were defaulting to stdout for diagnostics, which could interfere
with scripts or `nim c -r' programs outputting their results to stdout,
possibly mixing their output with compiler messages.
This change makes now Nim to be inline with other compilers emitting
diagnostics to stderr. Also now --stdout option has proper meaning making all
diagnostics to be sent to stdout instead.
NOTE: Tester now calls compiler with --stdout.
2015-10-16 20:55:17 +02:00
Aman Gupta
e2dbf222e6
Merge remote-tracking branch 'origin/devel' into appveyor
2015-10-13 15:25:40 -07:00
Araq
8be9e46403
udpated the compiler and tester to use getOrDefault
2015-10-13 14:10:33 +02:00
Aman Gupta
a1750bd431
skip sdl/opengl/fsmonitor tests when unavailable
2015-10-08 10:58:52 -07:00
Aman Gupta
5bb0820596
show failure code
2015-10-08 10:58:37 -07:00
Aman Gupta
cadef43786
standardize on forward slashes for paths
2015-10-07 21:42:12 -07:00
Aman Gupta
f49cffeb19
framework is required
2015-10-07 18:28:57 -07:00
Aman Gupta
24ec975aa1
fix compile error
2015-10-07 18:15:59 -07:00
Aman Gupta
f0793a6d97
collect any output of appveyor command
2015-10-07 17:50:54 -07:00
Aman Gupta
582c5054a1
report duration to appveyor runner
2015-10-07 16:42:08 -07:00
Aman Gupta
3dfcaec25f
use category as filename, and full filename in test name
2015-10-07 16:27:06 -07:00
Aman Gupta
6af9ac18f1
clean up whitespace on error msg
2015-10-07 16:25:03 -07:00
Aman Gupta
c34cbe690c
tie into appveyor test results api
2015-10-07 16:06:51 -07:00
Aman Gupta
2240fd3f3f
add tfile/tline assertions for template expansion file/line
2015-10-06 15:47:07 -07:00
Aman Gupta
6e7759734e
show stderr w/ reExitcodesDiffer
2015-10-02 17:38:48 -07:00
Aman Gupta
b093c0abd0
show full compiler output with reNimcCrash
2015-09-30 19:32:09 -07:00
Aman Gupta
435fbbc943
allow testament/tester to run single file
2015-09-30 12:09:58 -07:00
Adam Strzelecki
e80465dacf
tests: Trim .nim files trailing whitespace
...
via OSX: find . -name '*.nim' -exec sed -i '' -E 's/[[:space:]]+$//' {} +
2015-09-04 23:04:32 +02:00
Oscar Campbell
ee3d390b3f
Revert from columnar layout. Remove temp-fix for 2857.
2015-06-10 19:52:26 +02:00
Oscar Campbell
0a810fd10f
Treat unitest's default esc.seq. output as empty.
2015-06-04 22:53:39 +02:00
Oscar Campbell
071ccf3d02
Add "safety compilation". Improved, fixed messages
...
- node ext searcher also looks for "iojs" if no node(js?) found.
- koch ensures the local work dir compiler is freshly compiled before executing the tests.
- the tester can only run in the repo dir - now the compiler and libs used are also explicitly the local dirs - so no confusion from system wide pathing ("sufficiently sandboxed").
- fixed expectations in tmitems.nim test to match changes in json mod.
- re-layouted the columns / row printing slightly, making test fails pop out more, and everything "normal" layed back.
2015-06-04 07:33:27 +02:00
Sergey Avseyev
411e602d13
Introduce pedantic mode for tester
...
Motivation
----------
External tools need to know whether or not any test in suite failed. For
example buildbot, or packaging tool would like to stop the execution and
mark it as failed if some tests does not pass.
Modification
------------
Add `--pedantic` switch to tester program which will force it to quit
with non-zero exit code if at least one failure detected. Also update
`tests()` proc in koch to inspect result from tester and propagate it to
user.
Result
------
Nothing has changed in default behaviour. But following invocations will
exit with non-zero code if there failed tests:
./koch tests --pedantic all
./tests/testament/tester --pedantic all
2015-05-25 22:37:30 +03:00
Simon Hafner
2bc1db7a30
run the C test too
2015-05-13 13:13:30 -05:00
Simon Hafner
9c4a74637d
Merge branch 'devel' into jpoirier-realtimeGCTest
2015-05-13 12:06:05 -05:00
Araq
6725aa3634
fixes #2517
2015-04-25 23:16:59 +02:00
Adam Strzelecki
505836385c
Tests: Optional error location column spec
...
This allows some test to specify error location column, to ensure compiler is
generating diagnostics pointing to exactly right place of an error.
2015-04-20 21:03:57 +02:00
Simon Hafner
c55f884b5c
integrated realtimegc stuff into testament
2015-04-13 22:36:35 -05:00
def
64903e7050
Use ^ instead of - in slices
2015-03-28 00:38:15 +01:00
def
cb3c99fe1f
Fix tests some more
2015-03-17 00:02:47 +01:00
Araq
f514be0772
fixes #2286
2015-03-12 01:45:15 +01:00
Araq
0032912d10
fixed the tester; more tests green
2015-03-10 12:32:48 +01:00
Simon Hafner
2b4dcc9f33
one result too much
2015-03-09 14:26:08 -05:00
Simon Hafner
8f8171a0c4
fixed tester back up
2015-03-09 11:30:40 -05:00
Simon Hafner
fb8c0280bd
better messages for nimout
2015-03-05 16:15:28 -06:00
Araq
335c19c869
tester reports ignored tests and supports 'nimout'; fixes #2211
2015-02-25 12:59:32 +01:00
def
c58573b34a
Fix name of generated C file in tester
...
- Makes tests/ccgbugs/tmissingvolatile work again
2015-02-04 20:41:29 +01:00
Dominik Picheta
6143393adb
Move lib/pure/nodejs to compiler/nodejs. Ref #2017 .
2015-01-28 14:58:31 +00:00
Andreas Rumpf
190cc01f24
Merge pull request #2017 from reactormonk/nodejs-binary
...
Algorithm to find the nodejs binary
2015-01-28 15:14:39 +01:00
Simon Hafner
2beaa7a2da
find the nodejs binary
...
upstream calls it node, debian calls it nodejs. We gotta look for both
of them.
2015-01-27 13:02:17 -06:00
Araq
efb5ec3e73
proper 'space in dir' test
2015-01-27 01:33:48 +01:00
Guillaume Gelin
3119fe087d
Happy new year!
2015-01-06 15:26:33 +01:00
Araq
cd2c6128d1
renamed babelcmd to nimblecmd; config files are now nim.cfg; other renamings
2014-08-29 09:03:00 +02:00
Araq
6713ebcd98
tester compiles again
2014-08-29 01:12:18 +02:00
Araq
bea1761da1
tester works again
2014-05-30 17:04:39 +02:00
Araq
f12a0820e0
added 'sortoutput' option to make output deterministic for threading tests
2014-05-29 13:19:26 +02:00