Nim/tests
LemonBoy f23b0a7dc8 Fix handling of reraise in effect tracking (#10582)
This is the MVP in order not to get a completely useless error message
from the compiler.

Fixes #10579
2019-02-07 17:07:03 +01:00
..
actiontable Merge tests into a larger file (part 1 of ∞) (#9318) 2018-10-12 17:02:46 +02:00
alias Remove expr/stmt (#5857) 2017-07-25 09:28:23 +02:00
ambsym require errormsg to be specified before file. 2018-12-11 21:23:21 +01:00
arithm Merge tests into a larger file (part 1 of ∞) (#9318) 2018-10-12 17:02:46 +02:00
array close #3899 by adding test case (#10424) 2019-01-23 08:44:19 +01:00
assert require errormsg to be specified before file. 2018-12-11 21:23:21 +01:00
assign require errormsg to be specified before file. 2018-12-11 21:23:21 +01:00
astoverload
async Remove deprecated modules (asyncio, sockets, ftpclient) (#10401) 2019-01-22 16:06:44 +01:00
bind Remove deprecated modules (asyncio, sockets, ftpclient) (#10401) 2019-01-22 16:06:44 +01:00
borrow require errormsg to be specified before file. 2018-12-11 21:23:21 +01:00
casestmt require errormsg to be specified before file. 2018-12-11 21:23:21 +01:00
ccgbugs properly deprecate parseopt2 (#10452) 2019-01-25 13:13:55 +01:00
clearmsg require errormsg to be specified before file. 2018-12-11 21:23:21 +01:00
closure Remove deprecated modules (asyncio, sockets, ftpclient) (#10401) 2019-01-22 16:06:44 +01:00
cnstseq require errormsg to be specified before file. 2018-12-11 21:23:21 +01:00
collections add isNamedTuple; make $(1, 2) be (1, 2) instead of (Field0: 1, Field1: 2) which leaked implementation detail (#10070) 2019-01-08 18:37:25 -08:00
compiler improve formatting in assertEquals 2019-01-14 17:00:54 -08:00
compilerapi megatest can be executed 2018-12-11 21:23:21 +01:00
compiles make run the default action of a test in tester 2018-11-23 11:58:28 +01:00
concat
concepts megatest checks output and nimout 2018-12-11 21:23:22 +01:00
constr Testament: refactoring; makes the test joiner green 2018-12-11 21:23:23 +01:00
constraints require errormsg to be specified before file. 2018-12-11 21:23:21 +01:00
constructors require errormsg to be specified before file. 2018-12-11 21:23:21 +01:00
controlflow Testament: refactoring; makes the test joiner green 2018-12-11 21:23:23 +01:00
converter require errormsg to be specified before file. 2018-12-11 21:23:21 +01:00
coroutines fix coro test 2018-11-23 11:58:29 +01:00
cpp Properly wrap discarded statements (#10322) 2019-01-17 07:55:29 +01:00
defaultprocparam updated tests to be executed 2018-11-23 11:58:28 +01:00
deprecated fix #8063 by adding a testcase for: Deprecation warnings for enum values print twice (#10508) 2019-01-31 11:44:11 +01:00
deps testament megatest: furher refactorings making more tests green 2018-12-11 21:23:24 +01:00
destructor isLastRead regression fix (#10463) 2019-01-28 08:32:14 +01:00
dir with space fixes #10042 (allow spaces in import) (#10504) 2019-01-31 08:20:00 +01:00
discard fix off by 1 error in col shown by toFileLineCol (#10138) 2018-12-31 15:42:01 +01:00
distinct lots of small changes 2018-12-11 21:23:22 +01:00
dll activated more tests, allow input in test spec 2018-11-23 11:58:28 +01:00
effects Fix handling of reraise in effect tracking (#10582) 2019-02-07 17:07:03 +01:00
enum Deprecated pragma is now supported on enum fields (#10113) 2018-12-30 09:43:59 +01:00
errmsgs closes #8610 ; adds test case (#10454) 2019-01-25 19:28:03 +01:00
exception Fix semantic analysis with noReturn proc in tail pos (#10422) 2019-01-23 07:30:49 +01:00
exprs require errormsg to be specified before file. 2018-12-11 21:23:21 +01:00
fields Merge tests into a larger file (part 2 of ∞) (#9335) 2018-10-13 14:58:31 +02:00
flags require errormsg to be specified before file. 2018-12-11 21:23:21 +01:00
float fix #10305 nim cpp is now nan-correct at CT (#10310) 2019-01-15 14:50:28 +01:00
fragmentation tests: disable flaky tests for now; closes #9421 2018-10-18 12:12:15 +02:00
friends tests: Trim .nim files trailing whitespace 2015-09-04 23:04:32 +02:00
gc ported havlak and gcbench benchmarks to work with --gc:regions 2019-01-19 12:48:39 +01:00
generics Fix for issue #10342. better message for generic subclass instantiation (#10354) 2019-01-22 17:05:26 -08:00
gensym equality check on NimSym has now support in the VM; refs #6139 2017-09-03 01:15:40 +02:00
global require errormsg to be specified before file. 2018-12-11 21:23:21 +01:00
implicit lots of small changes 2018-12-11 21:23:22 +01:00
import_in_config fixes a regression that caused --import in a config file to break things 2016-08-29 11:33:41 +02:00
init activated more tests, allow input in test spec 2018-11-23 11:58:28 +01:00
iter disable one more test for C++ 2019-01-15 10:02:09 +01:00
js Fixes 10202 (#10283) 2019-01-12 19:49:31 +01:00
lent basic 'lent T' test works 2018-01-21 03:04:22 +01:00
let require errormsg to be specified before file. 2018-12-11 21:23:21 +01:00
lexer megatest: make it green on Linux 2018-12-11 21:23:25 +01:00
lookups updated tests to be executed 2018-11-23 11:58:28 +01:00
macros fix #10591 regression (#10592) 2019-02-06 22:31:36 -06:00
magics megatest: make it green on Linux 2018-12-11 21:23:25 +01:00
manyloc Remove deprecated modules (asyncio, sockets, ftpclient) (#10401) 2019-01-22 16:06:44 +01:00
metatype make tests green again 2019-01-14 20:11:33 +01:00
method fix off by 1 error in col shown by toFileLineCol (#10138) 2018-12-31 15:42:01 +01:00
misc Implement {.booldefine.} (#10533) 2019-02-03 09:06:00 +01:00
modules fix off by 1 error in col shown by toFileLineCol (#10138) 2018-12-31 15:42:01 +01:00
namedparams require errormsg to be specified before file. 2018-12-11 21:23:21 +01:00
newconfig cleanup tests; don't use non-working 'msg' spec field 2018-11-23 13:16:45 +01:00
nimble Implement .nimble-link files in the compiler and add tests for them. 2017-09-02 15:28:25 +01:00
niminaction fix sdl_test test that failed in CI cpp mode (#10314) 2019-01-15 15:17:52 -08:00
notnil require errormsg to be specified before file. 2018-12-11 21:23:21 +01:00
objects disable one more test for C++ 2019-01-16 21:19:51 +01:00
objvariant fixes #10033 [backport] 2018-12-22 18:39:20 +01:00
openarray require errormsg to be specified before file. 2018-12-11 21:23:21 +01:00
osproc make tests green again 2018-12-11 21:23:26 +01:00
overflw require errormsg to be specified before file. 2018-12-11 21:23:21 +01:00
overload fixes #9149 [backport] 2019-01-29 14:31:43 +01:00
package_level_objects new feature: package level objects 2017-10-29 07:54:39 +01:00
parallel remove tdont_be_stupid, fixes #10386 2019-01-23 09:19:42 +01:00
parser gc: destructors is beginning to work (#10483) 2019-01-29 15:12:16 +01:00
pragmas Fix getCustomPragmaVal on var fields 2019-02-06 11:34:55 +01:00
proc typed/untyped return type is invalid for everything except templates and macros (#10275) 2019-01-15 08:08:12 +01:00
procvar Merge tests into a larger file (part 5 of ∞) (#9368) 2018-10-16 10:50:10 +02:00
range require errormsg to be specified before file. 2018-12-11 21:23:21 +01:00
rational require errormsg to be specified before file. 2018-12-11 21:23:21 +01:00
realtimeGC WIP, most tests are now skipped 2018-12-11 21:23:18 +01:00
rodfiles remove dead code elimination option (#7669) 2018-04-23 11:02:38 +02:00
seq Testament: refactoring; makes the test joiner green 2018-12-11 21:23:23 +01:00
sets require errormsg to be specified before file. 2018-12-11 21:23:21 +01:00
showoff Improved collection-to-string behavior (#6825) 2017-12-14 14:02:13 +01:00
specialops dotops: add a simple object delegation test 2017-12-01 02:05:48 +01:00
statictypes fix #10339 by returning type attached to nkEmpty (#10370) 2019-01-23 11:17:32 +01:00
stdlib New implementation of times.between (#10523) 2019-02-06 20:13:29 +01:00
system properly deprecate parseopt2 (#10452) 2019-01-25 13:13:55 +01:00
template Testament: refactoring; makes the test joiner green 2018-12-11 21:23:23 +01:00
testament lots of testament bug fixes and improvements: (#10044) 2018-12-20 11:49:32 +01:00
testdata Fix for #5134 (parseJson(string) should fail on leftover data) (#5203) 2017-01-11 06:50:18 +01:00
threads remove deprecated modules (#10215) 2019-01-07 10:37:49 +01:00
trmacros fixes #7524 2019-01-14 12:15:40 +01:00
tuples remove deprecated modules (#10215) 2019-01-07 10:37:49 +01:00
typerel Restrict ptr/ref to ptr/ref implicit conversion (#10411) 2019-01-22 11:17:20 +01:00
types Remove deprecated modules (asyncio, sockets, ftpclient) (#10401) 2019-01-22 16:06:44 +01:00
untestable lots of small changes 2018-12-11 21:23:22 +01:00
usingstmt Testament: refactoring; makes the test joiner green 2018-12-11 21:23:23 +01:00
varres require errormsg to be specified before file. 2018-12-11 21:23:21 +01:00
varstmt Testament: refactoring; makes the test joiner green 2018-12-11 21:23:23 +01:00
vm Fix vm signed xor (#10519) 2019-02-01 12:12:10 +01:00
config.nims followup on #10573: prevent common user config to interfere with testament (excessiveStackTrace) (#10590) 2019-02-07 12:29:31 +01:00
dummy.txt Remove install.txt and readme.txt (#9521) 2018-10-28 13:36:52 +01:00
js.html
js.nim tests: Trim .nim files trailing whitespace 2015-09-04 23:04:32 +02:00
mmaptest.nim tests: Trim .nim files trailing whitespace 2015-09-04 23:04:32 +02:00
readme.md Testament pre parallel (#9137) 2018-10-12 17:27:47 +02:00
rectest.nim tests: Trim .nim files trailing whitespace 2015-09-04 23:04:32 +02:00
stckovfl.nim tests: Trim .nim files trailing whitespace 2015-09-04 23:04:32 +02:00
test_nimscript.nims remove subexes 2019-01-10 09:17:12 +01:00

This directory contains the test cases.

Each test must have a filename of the form: t*.nim

Note: Tests are only compiled by default. In order to get the tester to execute the compiled binary, you need to specify a spec with an action key (see below for details).

Specs

Each test can contain a spec in a discard """ ... """ block.

Check out the parseSpec procedure in the specs module for a full and reliable reference

action

Specifies what action this test should take.

Default: compile

Options:

  • compile - compiles the module and fails the test if compilations fails.
  • run - compiles and runs the module, fails the test if compilation or execution of test code fails.
  • reject - compiles the module and fails the test if compilation succeeds.

There are certain spec keys that imply run, including output and outputsub.

cmd

Specifies the Nim command to use for compiling the test.

There are a number of variables that are replaced in this spec option:

  • $target - the compilation target, e.g. c.
  • $options - the options for the compiler.
  • $file - the filename of the test.
  • $filedir - the directory of the test file.

Example:

discard """
  cmd: "nim $target --nimblePath:./nimbleDir/simplePkgs $options $file"
"""

Categories

Each folder under this directory represents a test category, which can be tested by running koch tests cat <category>.

The folder rodfiles contains special tests that test incremental compilation via symbol files.

The folder dll contains simple DLL tests.

The folder realtimeGC contains a test for validating that the realtime GC can run properly without linking against the nimrtl.dll/so. It includes a C client and platform specific build files for manual compilation.