Nim/tests
genotrance e931f3b5a9 Fixes #802, #803 and #3775 - genscript issues (#7677)
* Fixes #802, #803 and #3775 - genscript issues

* Test case for genscript

* Test script

* Verify on Linux

* Update categories.nim

* Fix merge

* Improve test framework

* Windows fixes
2018-04-25 10:52:32 +02:00
..
actiontable tests: Trim .nim files trailing whitespace 2015-09-04 23:04:32 +02:00
alias Remove expr/stmt (#5857) 2017-07-25 09:28:23 +02:00
ambsym tests: Trim .nim files trailing whitespace 2015-09-04 23:04:32 +02:00
arithm breaking change: 'and' and 'mod' do not produce a subrange type anymore; fixes #5854 2017-10-30 00:27:30 +01:00
array semcheck negative array length (#7518) 2018-04-06 17:05:28 +02:00
assert Add column number to instantiation info (#7376) 2018-04-12 20:02:04 +02:00
assign make tests green again 2018-04-24 11:45:08 +02:00
astoverload new tester; all tests categorized 2014-01-13 02:10:03 +01:00
async Fix some usages of typedesc in async procs 2018-04-13 13:31:55 +03:00
benchmarks tests: Trim .nim files trailing whitespace 2015-09-04 23:04:32 +02:00
bind make more tests green 2018-02-10 20:55:22 +01:00
borrow tests: Trim .nim files trailing whitespace 2015-09-04 23:04:32 +02:00
caas Rename PNimrodNode to NimNode 2015-03-17 17:50:32 +01:00
casestmt Fixes #7407 (#7427) 2018-04-06 10:53:21 +02:00
ccgbugs fixes #7392 (#7395) 2018-03-23 13:28:22 +01:00
clearmsg make more tests green 2018-02-10 20:55:22 +01:00
closure make more tests green 2018-02-10 20:55:22 +01:00
cnstseq tests: Trim .nim files trailing whitespace 2015-09-04 23:04:32 +02:00
collections Don't escape multibyte characters (#7570) 2018-04-23 11:09:48 +02:00
compiles Remove expr/stmt (#5857) 2017-07-25 09:28:23 +02:00
concat new tester; all tests categorized 2014-01-13 02:10:03 +01:00
concepts Static[T] fixes (#7333) 2018-03-24 15:28:09 +01:00
constr the parser finally parses 'echo {1,2}' as it should 2017-09-30 21:35:30 +02:00
constraints make more tests green 2018-02-10 20:55:22 +01:00
constructors Fixes #5965 (#6237) 2017-08-14 17:43:39 +02:00
controlflow tests: Trim .nim files trailing whitespace 2015-09-04 23:04:32 +02:00
converter fixes #4537 2016-08-02 14:53:21 +02:00
coroutines attempt to make travis OSX tests green and mandatory 2017-03-29 10:14:03 +02:00
cpp make tests green again 2018-04-22 00:19:41 +02:00
defaultprocparam new tester; all tests categorized 2014-01-13 02:10:03 +01:00
deprecated fixes --gc:none regression; made some tests green 2015-03-10 12:32:47 +01:00
destructor more progress on destructors; removed old destructor based code as it proved confusing 2017-12-01 01:52:00 +01:00
dir with space tests: Trim .nim files trailing whitespace 2015-09-04 23:04:32 +02:00
discard more chatty error message for the 'discard' checking 2018-02-05 16:49:06 +01:00
distinct make tests on Windows green 2017-01-31 23:05:36 +01:00
dll tests: Trim .nim files trailing whitespace 2015-09-04 23:04:32 +02:00
effects make more tests green 2018-02-10 20:55:22 +01:00
enum remove dead code elimination option (#7669) 2018-04-23 11:02:38 +02:00
errmsgs fixes #6393 2018-04-21 22:49:15 +02:00
exception Cpp codegen: handling of imported exceptions. Fixes #3571 (#7360) 2018-04-10 12:14:59 +02:00
exprs fixes #6980 2017-12-27 21:26:37 +01:00
fields Improved collection-to-string behavior (#6825) 2017-12-14 14:02:13 +01:00
flags Fixes #802, #803 and #3775 - genscript issues (#7677) 2018-04-25 10:52:32 +02:00
float Fix for isssue in parseBiggestFloat #7060 (#7061) 2018-01-11 01:57:20 +01:00
fragmentation disable flaky fragmenation test for AppVeyor 2018-03-19 17:42:52 +01:00
friends tests: Trim .nim files trailing whitespace 2015-09-04 23:04:32 +02:00
gc Fix gc tests for BoehmGC (#7094) 2018-01-18 09:04:32 +01:00
generics fixes #7247 2018-02-23 11:42:19 +01:00
gensym equality check on NimSym has now support in the VM; refs #6139 2017-09-03 01:15:40 +02:00
global tests: Trim .nim files trailing whitespace 2015-09-04 23:04:32 +02:00
implicit unsigned array indexes work better; minor cleanups 2015-02-10 20:19:46 +01:00
import_in_config fixes a regression that caused --import in a config file to break things 2016-08-29 11:33:41 +02:00
init tests: Trim .nim files trailing whitespace 2015-09-04 23:04:32 +02:00
iter remove dead code elimination option (#7669) 2018-04-23 11:02:38 +02:00
js Fix cmpStrings in js mode (#7604) 2018-04-15 17:34:03 +02:00
lent basic 'lent T' test works 2018-01-21 03:04:22 +01:00
let make more tests green 2018-02-10 20:55:22 +01:00
lexer make tests green again 2017-11-05 13:02:46 +01:00
lookups fixes #4353 2016-08-04 19:36:13 +02:00
macros eqIdent new returns false on non identifier types (#7629) 2018-04-17 01:23:38 +02:00
magics the parser finally parses 'echo {1,2}' as it should 2017-09-30 21:35:30 +02:00
manyloc remove dead code elimination option (#7669) 2018-04-23 11:02:38 +02:00
metatype make tests green again 2018-04-07 00:39:33 +02:00
method added missing test for methods 2017-09-28 21:52:23 +02:00
misc Static[T] fixes (#7333) 2018-03-24 15:28:09 +01:00
modules make the 'canimport' template work 2018-03-06 15:57:46 +01:00
namedparams make more tests green 2018-02-10 20:55:22 +01:00
newconfig Add a few useful os calls to nimscript (#7442) 2018-04-10 18:50:23 +02:00
nimble Implement .nimble-link files in the compiler and add tests for them. 2017-09-02 15:28:25 +01:00
niminaction @dom96's comments: remove bountysource, revert configurator change. 2017-10-14 16:03:50 +03:00
notnil fixes #3993 2017-11-23 03:12:09 +01:00
objects fixes #7637; assignments are not allowed to slice object; minor breaking change 2018-04-21 21:22:36 +02:00
objvariant fixes a regression about static object case variant checking 2018-04-06 13:01:24 +02:00
openarray fixed #2240 and #3586 2016-01-05 07:52:56 +07:00
osproc osproc: fix double close on POSIX (#5724) 2018-04-16 20:02:26 +02:00
overflw tests: Trim .nim files trailing whitespace 2015-09-04 23:04:32 +02:00
overload make tests green again 2018-04-22 07:10:55 +02:00
package_level_objects new feature: package level objects 2017-10-29 07:54:39 +01:00
parallel .experimental can now be used to enable specific features 2018-04-24 09:34:29 +02:00
parser Get symbol kind (#7491) 2018-04-11 16:48:01 +02:00
pragmas remove dead code elimination option (#7669) 2018-04-23 11:02:38 +02:00
proc tests: Trim .nim files trailing whitespace 2015-09-04 23:04:32 +02:00
procvar tests: Trim .nim files trailing whitespace 2015-09-04 23:04:32 +02:00
range Fix typo in new test 2017-11-01 18:13:27 +03:00
rational make tests green again 2017-11-18 23:03:16 +01:00
realtimeGC Fix longgc category tests (#7095) 2018-01-22 15:08:27 +01:00
rodfiles remove dead code elimination option (#7669) 2018-04-23 11:02:38 +02:00
seq fixes #4973 2017-02-01 12:09:24 +01:00
sets Fix compile time set cardinality (#7558) 2018-04-10 10:38:16 +02:00
showoff Improved collection-to-string behavior (#6825) 2017-12-14 14:02:13 +01:00
specialops dotops: add a simple object delegation test 2017-12-01 02:05:48 +01:00
statictypes fixes #6843 2018-04-06 13:10:22 +02:00
stdlib Rename Time.nanoseconds to nanosecond (#7673) 2018-04-25 02:43:26 +02:00
system added toOpenArray builtin for zero-copy slices; syntax sugar yet to come 2018-03-24 20:26:34 +01:00
template test case for #2416 (#7649) 2018-04-18 21:19:23 +02:00
testament Fixes #802, #803 and #3775 - genscript issues (#7677) 2018-04-25 10:52:32 +02:00
testdata Fix for #5134 (parseJson(string) should fail on leftover data) (#5203) 2017-01-11 06:50:18 +01:00
threads the parser finally parses 'echo {1,2}' as it should 2017-09-30 21:35:30 +02:00
trmacros Remove expr/stmt (#5857) 2017-07-25 09:28:23 +02:00
tuples rename SomeReal to SomeFloat (#7617) 2018-04-15 19:59:11 +02:00
typerel better error messages: use <T1, T2> instead of (T1, T2) in order to prevent confusions with tuple types 2018-02-10 20:55:21 +01:00
types Improved collection-to-string behavior (#6825) 2017-12-14 14:02:13 +01:00
untestable Add OpenSSL 1.1.0 support #5000 2017-12-28 21:57:43 +00:00
usingstmt Remove expr/stmt (#5857) 2017-07-25 09:28:23 +02:00
varres fixes #5113 2018-04-21 23:58:24 +02:00
varstmt tests: Trim .nim files trailing whitespace 2015-09-04 23:04:32 +02:00
vm Added a few useful os calls to VM (#7440) 2018-04-12 13:59:14 +02:00
benchmark.nim tests: Trim .nim files trailing whitespace 2015-09-04 23:04:32 +02:00
js.html
js.nim tests: Trim .nim files trailing whitespace 2015-09-04 23:04:32 +02:00
mmaptest.nim tests: Trim .nim files trailing whitespace 2015-09-04 23:04:32 +02:00
readme.md Add readme to tests. Add fileDir option to testament & create nimble test. 2017-09-02 15:03:39 +01:00
rectest.nim tests: Trim .nim files trailing whitespace 2015-09-04 23:04:32 +02:00
stckovfl.nim tests: Trim .nim files trailing whitespace 2015-09-04 23:04:32 +02:00
test_nimscript.nims bugfix: make 'macros' module available for nimscript 2017-11-14 23:26:46 +01:00

This directory contains the test cases.

Each test must have a filename of the form: t*.nim

Note: Tests are only compiled by default. In order to get the tester to execute the compiled binary, you need to specify a spec with an action key (see below for details).

Specs

Each test can contain a spec in a discard """ ... """ block.

Check out the parseSpec procedure in the specs module for a full and reliable reference

action

Specifies what action this test should take.

Default: compile

Options:

  • compile - compiles the module and fails the test if compilations fails.
  • run - compiles and runs the module, fails the test if compilation or execution of test code fails.
  • reject - compiles the module and fails the test if compilation succeeds.

There are certain spec keys that imply run, including output and outputsub.

cmd

Specifies the Nim command to use for compiling the test.

There are a number of variables that are replaced in this spec option:

  • $target - the compilation target, e.g. c.
  • $options - the options for the compiler.
  • $file - the filename of the test.
  • $filedir - the directory of the test file.

Example:

discard """
  cmd: "nim $target --nimblePath:./nimbleDir/simplePkgs $options $file"
"""

Categories

Each folder under this directory represents a test category, which can be tested by running koch tests cat <category>.

The folder rodfiles contains special tests that test incremental compilation via symbol files.

The folder dll contains simple DLL tests.

The folder realtimeGC contains a test for validating that the realtime GC can run properly without linking against the nimrtl.dll/so. It includes a C client and platform specific build files for manual compilation.