Nim/tests
Clyybber 813dd1b670
repr_v2 improvements (#14992)
* Support proc in arc repr

* Typo

* Improve repr for strings and chars
2020-07-15 22:04:15 +02:00
..
actiontable Merge tests into a larger file (part 1 of ∞) (#9318) 2018-10-12 17:02:46 +02:00
alias Remove expr/stmt (#5857) 2017-07-25 09:28:23 +02:00
align fixes #13122 (#13126) 2020-01-13 14:11:51 +01:00
ambsym require errormsg to be specified before file. 2018-12-11 21:23:21 +01:00
arc repr_v2 improvements (#14992) 2020-07-15 22:04:15 +02:00
arithm fix operators containing percent for VM usage (#13536) 2020-03-11 01:01:25 +01:00
array disallow typedesc in arrays & move existing checks to types.typeAllowedAux (#13261) 2020-05-29 11:48:15 +02:00
assert init checks and 'out' parameters (#14521) 2020-06-23 10:53:57 +02:00
assign fix rtti sizeof for varargs in global scope (#13125) [backport] 2020-01-13 10:17:21 +01:00
astoverload
astspec Fix spellings (#12277) [backport] 2019-09-27 07:02:54 +02:00
async scoped memory management (#14790) 2020-07-04 07:37:24 +02:00
bind Add testcases for #11811 and #14315 (#14726) 2020-06-19 14:56:38 +02:00
borrow Add testcase for #14440 (#14771) 2020-06-23 14:17:12 +02:00
casestmt scoped memory management (#14790) 2020-07-04 07:37:24 +02:00
ccgbugs :D 2020-07-11 19:17:40 +02:00
ccgbugs2 Remove deprecated stuff from stdlib (#14699) 2020-06-17 15:25:02 +02:00
clearmsg require errormsg to be specified before file. 2018-12-11 21:23:21 +01:00
closure Make the fields of times.DateTime private (#14197) 2020-05-06 12:20:34 +02:00
cnstseq require errormsg to be specified before file. 2018-12-11 21:23:21 +01:00
collections remove a condition that table size must be passed as power of 2 (#14926) 2020-07-08 15:01:47 +02:00
compilepragma fixes #10299 (#11324) 2019-05-25 07:33:33 +02:00
compiler trunner was not actually being tested in non-CTFFI mode; minor testament cleanups (#14377) 2020-05-19 09:41:31 +02:00
compilerapi hotfix: make tcompilerapi green again 2020-04-30 22:48:10 +02:00
compilerfeatures new compiler feature: --expandMacro 2019-05-29 20:47:28 +02:00
compiles delete list comprehension (#12392) 2019-11-22 19:57:43 +01:00
concat
concepts Clean out Deprecated proc (#14797) 2020-06-29 09:33:07 +02:00
constr Add testcase for #10465 (#14943) 2020-07-09 01:51:18 +02:00
constraints require errormsg to be specified before file. 2018-12-11 21:23:21 +01:00
constructors Turn some of the errors back into warnings 2020-04-01 19:38:44 +02:00
controlflow Make unreachable code a warning instead of an error (#14816) 2020-06-29 08:49:53 +02:00
converter addQuitProc now works with closures, and c, js(node/browser) backend; fix some bugs in testament (#14342) 2020-06-16 11:43:48 +02:00
coroutines Close#5586 (#14682) 2020-06-16 16:24:26 +02:00
cpp fix typos and deprecation warnings for tconvariancerules.nim (#13772) 2020-03-27 08:36:21 +01:00
defaultprocparam updated tests to be executed 2018-11-23 11:58:28 +01:00
deprecated fix #11009 (#14935) 2020-07-09 09:57:35 +02:00
deps Remove deprecated stuff from stdlib (#14699) 2020-06-17 15:25:02 +02:00
destructor injectdestructors fixes and refactor (#14964) 2020-07-14 14:15:39 +02:00
dir with space fixes #10042 (allow spaces in import) (#10504) 2019-01-31 08:20:00 +01:00
discard improve the 'has to be discarded' error message 2020-05-02 22:31:19 +02:00
distinct fixes #11715 (#11721) 2019-07-13 07:55:56 +02:00
distros fix tdistros test which was failing on Nightlies 2020-04-28 15:59:32 +02:00
dll CI openbsd: 3x batching via NIM_TESTAMENT_BATCH ; overall CI finishes in 21m instead of 34m (#14851) 2020-06-30 14:21:30 +02:00
effects init checks and 'out' parameters (#14521) 2020-06-23 10:53:57 +02:00
enum fix enumtostr crash for enum-range (#13035) 2020-01-05 09:18:14 +01:00
errmsgs fix #6608 (#14963) 2020-07-14 09:22:48 +02:00
exception fix #10343 (#14789) 2020-06-24 18:00:35 +02:00
exprs update tests that tested for the 'discard' error messages 2020-05-02 22:31:19 +02:00
fields make tests green again 2019-05-27 21:29:02 +02:00
flags require errormsg to be specified before file. 2018-12-11 21:23:21 +01:00
float Error -> Defect for defects (#13908) 2020-04-28 19:56:01 +02:00
fragmentation tests: disable flaky tests for now; closes #9421 2018-10-18 12:12:15 +02:00
friends
gc Remove deprecated stuff from stdlib (#14699) 2020-06-17 15:25:02 +02:00
generics Fix #14990 (#14991) 2020-07-15 19:00:52 +02:00
gensym fixes yet another gensym regression (#12145) 2019-09-06 00:45:00 +02:00
global require errormsg to be specified before file. 2018-12-11 21:23:21 +01:00
ic Incremental compilation (IC): Improvements (#11881) 2019-08-08 08:41:05 +02:00
implicit lots of small changes 2018-12-11 21:23:22 +01:00
import_in_config fixes a regression that caused --import in a config file to break things 2016-08-29 11:33:41 +02:00
init init checks and 'out' parameters (#14521) 2020-06-23 10:53:57 +02:00
iter Add testcase for #13815 (#14956) 2020-07-10 17:31:15 +02:00
js fix #14475; unittest.require now works with nim c; require and check now works with -d:nodejs (#14676) 2020-07-14 13:14:32 +02:00
lent closes #14878 2020-07-08 12:22:55 +02:00
let Allow let to not have value when using importc (#14258) 2020-05-12 20:28:18 +02:00
lexer megatest: make it green on Linux 2018-12-11 21:23:25 +01:00
lookups implement the 'bind' statement for generics, it was an oversight that this was never implemented (#14584) 2020-06-07 09:55:56 +02:00
macros Closes #13253 2020-07-14 19:50:42 +02:00
magics close #12746; minor cleanup (#14379) 2020-05-17 13:28:18 +02:00
manyloc remove a condition that table size must be passed as power of 2 (#14926) 2020-07-08 15:01:47 +02:00
metatype typetraits.$: $((int, float), int) is now "((int, float), int)" instead of "(tuple of (int, float), int)" (#14812) 2020-07-02 16:19:43 +02:00
method Error -> Defect for defects (#13908) 2020-04-28 19:56:01 +02:00
misc fix #13086 (#14987) 2020-07-15 03:46:17 -04:00
modules Add testcase for #4796 (#14784) 2020-06-25 15:12:30 +02:00
namedparams fixes #12196 2019-09-16 12:12:44 +02:00
newconfig deprecate existsDir; use dirExists instead (#14884) 2020-07-03 23:04:23 +02:00
nimble tnimblepathdollarfail.nim -> tests/nimble/tnimblepathdollar_fault to reduce false positives when searching for fail in CI logs (#14450) 2020-05-25 13:54:30 -07:00
nimdoc fix bug in semgnrc: runnableExamples should not semcheck, even with > 1 arg (#14768) 2020-06-23 10:06:36 +02:00
niminaction Remove deprecated stuff from stdlib (#14699) 2020-06-17 15:25:02 +02:00
notnil Add tests for #8481, #6490 and #4061 (#14083) 2020-04-23 19:52:33 +02:00
objects Error -> Defect for defects (#13908) 2020-04-28 19:56:01 +02:00
objvariant Better case coverage error message for alias and range enum (#12913) 2019-12-18 10:29:01 +01:00
openarray clean up deprecated stuff and unused imports in tests (#13059) 2020-01-07 09:49:08 +01:00
osproc testament: generic N-fold batching: windows CI 37mn=>16m (#14823) 2020-06-27 16:51:17 +02:00
overflw Error -> Defect for defects (#13908) 2020-04-28 19:56:01 +02:00
overload exp. features now in correct manual, closes #11932 (#14195) 2020-05-02 22:30:08 +02:00
package_level_objects new feature: package level objects 2017-10-29 07:54:39 +01:00
parallel #12103 - CI for OpenBSD (#12105) 2020-04-21 15:05:21 +02:00
parser make from an operator (#14241) 2020-05-08 07:54:46 +02:00
pragmas add test for define, undef (#14443) 2020-05-25 11:17:25 +02:00
proc allow typed/untyped in magic procs (#12911) 2019-12-17 11:07:32 +01:00
procvar Merge tests into a larger file (part 5 of ∞) (#9368) 2018-10-16 10:50:10 +02:00
range Error -> Defect for defects (#13908) 2020-04-28 19:56:01 +02:00
rational Error -> Defect for defects (#13908) 2020-04-28 19:56:01 +02:00
realtimeGC WIP, most tests are now skipped 2018-12-11 21:23:18 +01:00
sets tables/sharedtables/intsets/etc: fix #13496, #13504, #13505; add lots of tests (#13498) [backport] 2020-02-26 22:07:09 +01:00
showoff Clean up macros (#14959) 2020-07-14 16:44:56 +02:00
specialops dotops: add a simple object delegation test 2017-12-01 02:05:48 +01:00
statictypes Add testcase for #12571 (#14955) 2020-07-10 17:13:37 +02:00
stdlib fix #14475; unittest.require now works with nim c; require and check now works with -d:nodejs (#14676) 2020-07-14 13:14:32 +02:00
system fix #14912, make --useVersion:1.0 work again (#14945) 2020-07-10 16:44:12 +02:00
template Add testcase for some old fixed issues (#14960) 2020-07-10 19:21:50 +02:00
testament misc testament cleanups (#14764) 2020-06-23 10:53:03 +02:00
testdata Fix for #5134 (parseJson(string) should fail on leftover data) (#5203) 2017-01-11 06:50:18 +01:00
threads faster CIs (#13803) 2020-03-30 13:18:12 +02:00
tools new feature: --staticBoundChecks:on to enforce static array index checking (#10965) 2020-03-18 14:25:10 +01:00
trmacros Reenable a few tests 2020-07-14 19:50:42 +02:00
tuples Fix #14911 (#14922) [backport] 2020-07-07 10:21:18 +02:00
typerel Reenable a few tests 2020-07-14 19:50:42 +02:00
types fix #14007 (#14012) [backport] 2020-04-18 16:15:17 +02:00
untestable Deprecate and/or remove ospaths (#14767) 2020-06-23 10:51:33 +02:00
usingstmt Clean up macros (#14959) 2020-07-14 16:44:56 +02:00
valgrind attempt to add valgrind support to the CIs and testament (#12646) 2019-11-18 09:10:48 +01:00
varres fix #13848: make var result work with nim cpp (#13959) 2020-04-13 14:16:06 +02:00
varstmt Testament: refactoring; makes the test joiner green 2018-12-11 21:23:23 +01:00
vm Remove deprecated stuff from stdlib (#14699) 2020-06-17 15:25:02 +02:00
ast_pattern_matching.nim add tastspec (and ast_pattern_matching) (#10863) 2019-03-19 11:45:29 +01:00
config.nims fix #14320 (tasyncawait.nim is recently very flaky) + avoid hardcoding service ports everywhere + flakyAssert (#14327) 2020-05-13 11:05:47 +02:00
dummy.txt Remove install.txt and readme.txt (#9521) 2018-10-28 13:36:52 +01:00
js.html
js.nim
m14634.nim fix #13166 tioselectors flaky test on freebsd+OSX (#14634) 2020-06-12 21:19:23 -07:00
mmaptest.nim Fix spellings (#12277) [backport] 2019-09-27 07:02:54 +02:00
readme.md Update link to parseSpec proc 2020-06-28 00:13:54 +02:00
rectest.nim
stckovfl.nim
test_nimscript.nims deprecate existsDir; use dirExists instead (#14884) 2020-07-03 23:04:23 +02:00

This directory contains the test cases.

Each test must have a filename of the form: t*.nim

Note: Testament is only aware of tests under a directory (eg tests/foo/) and will ignore top-level tests like tests/tbar.nim.

Specs

Each test can contain a spec in a discard """ ... """ block.

Check out the parseSpec procedure in the specs module for a full and reliable reference

action

Specifies what action this test should take.

Default: run

Options:

  • compile - compiles the module and fails the test if compilations fails.
  • run - compiles and runs the module, fails the test if compilation or execution of test code fails.
  • reject - compiles the module and fails the test if compilation succeeds.

There are certain spec keys that imply run, including output and outputsub.

cmd

Specifies the Nim command to use for compiling the test.

There are a number of variables that are replaced in this spec option:

  • $target - the compilation target, e.g. c.
  • $options - the options for the compiler.
  • $file - the filename of the test.
  • $filedir - the directory of the test file.

Example:

discard """
  cmd: "nim $target --nimblePath:./nimbleDir/simplePkgs $options $file"
"""

Categories

Each folder under this directory represents a test category, which can be tested by running koch tests pcat <category> (or cat to avoid parallel testing, which is slower).

The folder dll contains simple DLL tests.

The folder realtimeGC contains a test for validating that the realtime GC can run properly without linking against the nimrtl.dll/so. It includes a C client and platform specific build files for manual compilation.