* squashed work by Zahary
* squashing a ton of useful history... otherwise rebasing on top of upstream Nim after commit 82c009a2cb would be impossible.
* Code review changes; Working test suite (without code reloading enabled)
* - documentation
- implemented the HCR test - almost works...
- fix the issue on Unix where for executable targets the source file for the main module of a project in nimcache was being overwritten with the binary itself (and thus the actual source code was lost)
- fixing embedded paths to shared objects on unix (the "lib" prefix was being prepended to the entire path instead of just the filename)
- other fixes
- removing unnecessary includes since that file is already included in chcks.nim which is in turn included in system.nim (and previously was getting imported in chcks.nim but then system.nim improts something... and that breaks HCR (perhaps it could be fixed but it would be nice not to import anything in system))
* fix for clang & C++ - explicitly casting a function pointer to void*
more stable mangling of parameter names when HCR is on
the length of the static arrays in the DatInit functions is now part of the name of the variables, so when they get resized they get also recreated
more stable mangling for inline functions - no longer depends on the module which first used them
work on the new complicated HCR test - turned surprisingly complex - WIP
test now successfully passes even when re-running `koch test` (previously when the nimcache wasn't cold that lead to errors)
better documentation
calling setStackBottomWith for PreMain
passes over the HcrInit/DatInit/Init calls of all modules are now in the proper order (first all of one type, then all of the next). Also typeinfo globals are registered (created) in a single pass before the DatInit pass (because of the way generic instantiations are handled)
Fix the test suite execution on macOs
fix for being able to query the program arguments when using HCR on posix!
other fixes
* Bugfix: Fix a compilation error in C++ mode when a function pointer
is converted to a raw pointer
* basic documentation for the new hot code reloading semantics
* Add change log entry
* Don't re-execute the top-level statements while reloading JS code
* fix a number of tests broken in a recent bugfix
* Review changes
* Added {.executeOnReload.} pragma that indicates top-level statements
that should be executed on each reload. To make this work, I've modified
the way the `if (hcr_init_) {...}` guards are produced in the init code.
This still needs more work as the new guards seem to be inserted within
the previously generated guards.
This change also removes the need for `lastRegistedGlobal` in nimhcr.
* Implemented the `signatureHash` magic and the `hasModuleChanged` API
depending on it (the actual logic is not imlemented yet).
* Add the "hcr" prefix to all HCR-related symbols in the system module.
Added a new `hotcodereloading` module exporting the high-level API to
the user.
Besides being more hygienic, this was also required in order to make
it possible to use macros in the high-level API. Without the split,
`system` would have to import `macros`, which was going to produce
the well-known init problems.
* Attempted to solve the "GC markers problem".
Crashes were expected with the previous code, because the GC markers
were compiled as normal procs are registered in the GC. When their
module is unloaded, dangling pointers will remain in the GC tables.
To solve this issue, I don't register any GC markers when HCR is on,
but I add them to the HCR globals metadata and I use a single marker
registed in nimhcr during the initialization of the system module that
will be responsible for marking all globals.
* fix a compilation error
* - implemented the hasModuleChanged functionality
- tuples can be returned and broken into different vars in global scope
- added comments for the closnig scopes of the if statements in the init proc
- the new executeOnReload pragma works now!
- other fixes
* finally! fixing this hack in a proper way - declaring the destructor out of line (out of the class body) - we no longer need to forward-declare popCurrentExceptionEx
* Force full module parsing
This is a temporary hack that breaks some tests. I'll investigate
later how these can be fixed.
* tuples are now properly handled when global!
* these comments mess up the codegen in debug mode when $n is not actually a new line (or something like that) - these labels are intended only for GOTO labels anyway...
* "solved" the issue with the .pdb locks on windows when a binary is being debugged and hot code reloading is used at the same time
* fixes after rebasing...
* small fixes for the test
* better handling of globals! no more compiler crashes for locals with the global pragma, also simplified code around loops in global scope which have local vars (actually globals)
* we can now use the global pragma even for ... globals!
* the right output
* lets try those boehm GC tests
* after the test is ran it will be at its starting state - no git modifications
* clarification in the docs
* removed unnecessary line directives for forward declarations of functions - they were causing trouble with hot code reloading when no semantic change propagates to the main module but a line directive got changed and thus the main module had to be recompiled since the .c code had changed
* fixed bug! was inserting duplicate keys into the table and later was removing only 1 copy of all the duplicates (after a few reloads)
* no longer breaking into DatInit code when not supposed to
* fixes after rebasing
* yet more fixes after rebasing
* Update jssys.nim
* Rework the HCR path-handling logic
After reviewing the code more carefully, I've noticed that the old logic
will be broken when the user overrides the '--out:f' compiler option.
Besides fixing this issues, I took the opportunity to implement the
missing '--outdir:d' option.
Other changes:
* ./koch test won't overwrite any HCR and RTL builds located in nim/lib
* HCR and RTL are compiled with --threads:on by default
* Clean up the globals registration logic
* Handle non-flattened top-level stmtlists in JS as well
* The HCR is not supported with the Boehm GC yet
Also fixes some typos and the expected output of the HCR integration test
* The GC marker procs are now properly used as trampolines
* Fix the HCR integration test in release builds
* Fix ./koch tools
* this forward declaration doesn't seem to be necessary, and in fact breaks HCR because a 2nd function pointer is emitted for this externed/rtl func
* the forward declaration I removed in the last commit was actually necessary
* Attempt to make all tests green
* Fix tgenscript
* BAT file for running the HCR integration test on Windows [skip ci]
* Fix the docgen tests
* A final fix for Travis (hopefully)
1296 lines
51 KiB
Nim
1296 lines
51 KiB
Nim
#
|
|
#
|
|
# The Nim Compiler
|
|
# (c) Copyright 2017 Andreas Rumpf
|
|
#
|
|
# See the file "copying.txt", included in this
|
|
# distribution, for details about the copyright.
|
|
#
|
|
|
|
# included from cgen.nim
|
|
|
|
# ------------------------- Name Mangling --------------------------------
|
|
|
|
import sighashes
|
|
from lowerings import createObj
|
|
|
|
proc genProcHeader(m: BModule, prc: PSym, asPtr: bool = false): Rope
|
|
|
|
proc isKeyword(w: PIdent): bool =
|
|
# Nim and C++ share some keywords
|
|
# it's more efficient to test the whole Nim keywords range
|
|
case w.id
|
|
of ccgKeywordsLow..ccgKeywordsHigh,
|
|
nimKeywordsLow..nimKeywordsHigh,
|
|
ord(wInline): return true
|
|
else: return false
|
|
|
|
proc mangleField(m: BModule; name: PIdent): string =
|
|
result = mangle(name.s)
|
|
# fields are tricky to get right and thanks to generic types producing
|
|
# duplicates we can end up mangling the same field multiple times. However
|
|
# if we do so, the 'cppDefines' table might be modified in the meantime
|
|
# meaning we produce inconsistent field names (see bug #5404).
|
|
# Hence we do not check for ``m.g.config.cppDefines.contains(result)`` here
|
|
# anymore:
|
|
if isKeyword(name):
|
|
result.add "_0"
|
|
|
|
when false:
|
|
proc hashOwner(s: PSym): SigHash =
|
|
var m = s
|
|
while m.kind != skModule: m = m.owner
|
|
let p = m.owner
|
|
assert p.kind == skPackage
|
|
result = gDebugInfo.register(p.name.s, m.name.s)
|
|
|
|
proc mangleName(m: BModule; s: PSym): Rope =
|
|
result = s.loc.r
|
|
if result == nil:
|
|
result = s.name.s.mangle.rope
|
|
add(result, idOrSig(s, m.module.name.s.mangle, m.sigConflicts))
|
|
s.loc.r = result
|
|
writeMangledName(m.ndi, s, m.config)
|
|
|
|
proc mangleParamName(m: BModule; s: PSym): Rope =
|
|
## we cannot use 'sigConflicts' here since we have a BModule, not a BProc.
|
|
## Fortunately C's scoping rules are sane enough so that that doesn't
|
|
## cause any trouble.
|
|
result = s.loc.r
|
|
if result == nil:
|
|
var res = s.name.s.mangle
|
|
# Take into account if HCR is on because of the following scenario:
|
|
# if a module gets imported and it has some more importc symbols in it,
|
|
# some param names might recieve the "_0" suffix to distinguish from what
|
|
# is newly available. That might lead to changes in the C code in nimcache
|
|
# that contain only a parameter name change, but that is enough to mandate
|
|
# recompilation of that source file and thus a new shared object will be
|
|
# relinked. That may lead to a module getting reloaded which wasn't intended
|
|
# and that may be fatal when parts of the current active callstack when
|
|
# performCodeReload() was called are from the module being reloaded
|
|
# unintentionally - example (3 modules which import one another):
|
|
# main => proxy => reloadable
|
|
# we call performCodeReload() in proxy to reload only changes in reloadable
|
|
# but there is a new import which introduces an importc symbol `socket`
|
|
# and a function called in main or proxy uses `socket` as a parameter name.
|
|
# That would lead to either needing to reload `proxy` or to overwrite the
|
|
# executable file for the main module, which is running (or both!) -> error.
|
|
if m.hcrOn or isKeyword(s.name) or m.g.config.cppDefines.contains(res):
|
|
res.add "_0"
|
|
result = res.rope
|
|
s.loc.r = result
|
|
writeMangledName(m.ndi, s, m.config)
|
|
|
|
proc mangleLocalName(p: BProc; s: PSym): Rope =
|
|
assert s.kind in skLocalVars+{skTemp}
|
|
#assert sfGlobal notin s.flags
|
|
result = s.loc.r
|
|
if result == nil:
|
|
var key = s.name.s.mangle
|
|
shallow(key)
|
|
let counter = p.sigConflicts.getOrDefault(key)
|
|
result = key.rope
|
|
if s.kind == skTemp:
|
|
# speed up conflict search for temps (these are quite common):
|
|
if counter != 0: result.add "_" & rope(counter+1)
|
|
elif counter != 0 or isKeyword(s.name) or p.module.g.config.cppDefines.contains(key):
|
|
result.add "_" & rope(counter+1)
|
|
p.sigConflicts.inc(key)
|
|
s.loc.r = result
|
|
if s.kind != skTemp: writeMangledName(p.module.ndi, s, p.config)
|
|
|
|
proc scopeMangledParam(p: BProc; param: PSym) =
|
|
## parameter generation only takes BModule, not a BProc, so we have to
|
|
## remember these parameter names are already in scope to be able to
|
|
## generate unique identifiers reliably (consider that ``var a = a`` is
|
|
## even an idiom in Nim).
|
|
var key = param.name.s.mangle
|
|
shallow(key)
|
|
p.sigConflicts.inc(key)
|
|
|
|
const
|
|
irrelevantForBackend = {tyGenericBody, tyGenericInst, tyGenericInvocation,
|
|
tyDistinct, tyRange, tyStatic, tyAlias, tySink,
|
|
tyInferred, tyOwned}
|
|
|
|
proc typeName(typ: PType): Rope =
|
|
let typ = typ.skipTypes(irrelevantForBackend)
|
|
result =
|
|
if typ.sym != nil and typ.kind in {tyObject, tyEnum}:
|
|
rope($typ.kind & '_' & typ.sym.name.s.mangle)
|
|
else:
|
|
rope($typ.kind)
|
|
|
|
proc getTypeName(m: BModule; typ: PType; sig: SigHash): Rope =
|
|
var t = typ
|
|
while true:
|
|
if t.sym != nil and {sfImportc, sfExportc} * t.sym.flags != {}:
|
|
return t.sym.loc.r
|
|
|
|
if t.kind in irrelevantForBackend:
|
|
t = t.lastSon
|
|
else:
|
|
break
|
|
let typ = if typ.kind in {tyAlias, tySink, tyOwned}: typ.lastSon else: typ
|
|
if typ.loc.r == nil:
|
|
typ.loc.r = typ.typeName & $sig
|
|
else:
|
|
when defined(debugSigHashes):
|
|
# check consistency:
|
|
assert($typ.loc.r == $(typ.typeName & $sig))
|
|
result = typ.loc.r
|
|
if result == nil: internalError(m.config, "getTypeName: " & $typ.kind)
|
|
|
|
proc mapSetType(conf: ConfigRef; typ: PType): TCTypeKind =
|
|
case int(getSize(conf, typ))
|
|
of 1: result = ctInt8
|
|
of 2: result = ctInt16
|
|
of 4: result = ctInt32
|
|
of 8: result = ctInt64
|
|
else: result = ctArray
|
|
|
|
proc mapType(conf: ConfigRef; typ: PType): TCTypeKind =
|
|
## Maps a Nim type to a C type
|
|
case typ.kind
|
|
of tyNone, tyStmt: result = ctVoid
|
|
of tyBool: result = ctBool
|
|
of tyChar: result = ctChar
|
|
of tySet: result = mapSetType(conf, typ)
|
|
of tyOpenArray, tyArray, tyVarargs, tyUncheckedArray: result = ctArray
|
|
of tyObject, tyTuple: result = ctStruct
|
|
of tyUserTypeClasses:
|
|
doAssert typ.isResolvedUserTypeClass
|
|
return mapType(conf, typ.lastSon)
|
|
of tyGenericBody, tyGenericInst, tyGenericParam, tyDistinct, tyOrdinal,
|
|
tyTypeDesc, tyAlias, tySink, tyInferred, tyOwned:
|
|
result = mapType(conf, lastSon(typ))
|
|
of tyEnum:
|
|
if firstOrd(conf, typ) < 0:
|
|
result = ctInt32
|
|
else:
|
|
case int(getSize(conf, typ))
|
|
of 1: result = ctUInt8
|
|
of 2: result = ctUInt16
|
|
of 4: result = ctInt32
|
|
of 8: result = ctInt64
|
|
else: result = ctInt32
|
|
of tyRange: result = mapType(conf, typ.sons[0])
|
|
of tyPtr, tyVar, tyLent, tyRef:
|
|
var base = skipTypes(typ.lastSon, typedescInst)
|
|
case base.kind
|
|
of tyOpenArray, tyArray, tyVarargs, tyUncheckedArray: result = ctPtrToArray
|
|
of tySet:
|
|
if mapSetType(conf, base) == ctArray: result = ctPtrToArray
|
|
else: result = ctPtr
|
|
else: result = ctPtr
|
|
of tyPointer: result = ctPtr
|
|
of tySequence: result = ctNimSeq
|
|
of tyProc: result = if typ.callConv != ccClosure: ctProc else: ctStruct
|
|
of tyString: result = ctNimStr
|
|
of tyCString: result = ctCString
|
|
of tyInt..tyUInt64:
|
|
result = TCTypeKind(ord(typ.kind) - ord(tyInt) + ord(ctInt))
|
|
of tyStatic:
|
|
if typ.n != nil: result = mapType(conf, lastSon typ)
|
|
else: doAssert(false, "mapType")
|
|
else: doAssert(false, "mapType")
|
|
|
|
proc mapReturnType(conf: ConfigRef; typ: PType): TCTypeKind =
|
|
#if skipTypes(typ, typedescInst).kind == tyArray: result = ctPtr
|
|
#else:
|
|
result = mapType(conf, typ)
|
|
|
|
proc isImportedType(t: PType): bool =
|
|
result = t.sym != nil and sfImportc in t.sym.flags
|
|
|
|
proc isImportedCppType(t: PType): bool =
|
|
let x = t.skipTypes(irrelevantForBackend)
|
|
result = (t.sym != nil and sfInfixCall in t.sym.flags) or
|
|
(x.sym != nil and sfInfixCall in x.sym.flags)
|
|
|
|
proc getTypeDescAux(m: BModule, origTyp: PType, check: var IntSet): Rope
|
|
|
|
proc isObjLackingTypeField(typ: PType): bool {.inline.} =
|
|
result = (typ.kind == tyObject) and ((tfFinal in typ.flags) and
|
|
(typ.sons[0] == nil) or isPureObject(typ))
|
|
|
|
proc isInvalidReturnType(conf: ConfigRef; rettype: PType): bool =
|
|
# Arrays and sets cannot be returned by a C procedure, because C is
|
|
# such a poor programming language.
|
|
# We exclude records with refs too. This enhances efficiency and
|
|
# is necessary for proper code generation of assignments.
|
|
if rettype == nil: result = true
|
|
else:
|
|
case mapType(conf, rettype)
|
|
of ctArray:
|
|
result = not (skipTypes(rettype, typedescInst).kind in
|
|
{tyVar, tyLent, tyRef, tyPtr})
|
|
of ctStruct:
|
|
let t = skipTypes(rettype, typedescInst)
|
|
if rettype.isImportedCppType or t.isImportedCppType: return false
|
|
result = containsGarbageCollectedRef(t) or
|
|
(t.kind == tyObject and not isObjLackingTypeField(t))
|
|
else: result = false
|
|
|
|
const
|
|
CallingConvToStr: array[TCallingConvention, string] = ["N_NIMCALL",
|
|
"N_STDCALL", "N_CDECL", "N_SAFECALL",
|
|
"N_SYSCALL", # this is probably not correct for all platforms,
|
|
# but one can #define it to what one wants
|
|
"N_INLINE", "N_NOINLINE", "N_FASTCALL", "N_CLOSURE", "N_NOCONV"]
|
|
|
|
proc cacheGetType(tab: TypeCache; sig: SigHash): Rope =
|
|
# returns nil if we need to declare this type
|
|
# since types are now unique via the ``getUniqueType`` mechanism, this slow
|
|
# linear search is not necessary anymore:
|
|
result = tab.getOrDefault(sig)
|
|
|
|
proc addAbiCheck(m: BModule, t: PType, name: Rope) =
|
|
if isDefined(m.config, "checkabi"):
|
|
addf(m.s[cfsTypeInfo], "NIM_CHECK_SIZE($1, $2);$n", [name, rope(getSize(m.config, t))])
|
|
|
|
proc ccgIntroducedPtr(conf: ConfigRef; s: PSym): bool =
|
|
var pt = skipTypes(s.typ, typedescInst)
|
|
assert skResult != s.kind
|
|
if tfByRef in pt.flags: return true
|
|
elif tfByCopy in pt.flags: return false
|
|
case pt.kind
|
|
of tyObject:
|
|
if s.typ.sym != nil and sfForward in s.typ.sym.flags:
|
|
# forwarded objects are *always* passed by pointers for consistency!
|
|
result = true
|
|
elif (optByRef in s.options) or (getSize(conf, pt) > conf.target.floatSize * 3):
|
|
result = true # requested anyway
|
|
elif (tfFinal in pt.flags) and (pt.sons[0] == nil):
|
|
result = false # no need, because no subtyping possible
|
|
else:
|
|
result = true # ordinary objects are always passed by reference,
|
|
# otherwise casting doesn't work
|
|
of tyTuple:
|
|
result = (getSize(conf, pt) > conf.target.floatSize*3) or (optByRef in s.options)
|
|
else: result = false
|
|
|
|
proc fillResult(conf: ConfigRef; param: PNode) =
|
|
fillLoc(param.sym.loc, locParam, param, ~"Result",
|
|
OnStack)
|
|
let t = param.sym.typ
|
|
if mapReturnType(conf, t) != ctArray and isInvalidReturnType(conf, t):
|
|
incl(param.sym.loc.flags, lfIndirect)
|
|
param.sym.loc.storage = OnUnknown
|
|
|
|
proc typeNameOrLiteral(m: BModule; t: PType, literal: string): Rope =
|
|
if t.sym != nil and sfImportc in t.sym.flags and t.sym.magic == mNone:
|
|
result = t.sym.loc.r
|
|
else:
|
|
result = rope(literal)
|
|
|
|
proc getSimpleTypeDesc(m: BModule, typ: PType): Rope =
|
|
const
|
|
NumericalTypeToStr: array[tyInt..tyUInt64, string] = [
|
|
"NI", "NI8", "NI16", "NI32", "NI64",
|
|
"NF", "NF32", "NF64", "NF128",
|
|
"NU", "NU8", "NU16", "NU32", "NU64"]
|
|
case typ.kind
|
|
of tyPointer:
|
|
result = typeNameOrLiteral(m, typ, "void*")
|
|
of tyString:
|
|
case detectStrVersion(m)
|
|
of 2:
|
|
discard cgsym(m, "NimStrPayload")
|
|
discard cgsym(m, "NimStringV2")
|
|
result = typeNameOrLiteral(m, typ, "NimStringV2")
|
|
else:
|
|
discard cgsym(m, "NimStringDesc")
|
|
result = typeNameOrLiteral(m, typ, "NimStringDesc*")
|
|
of tyCString: result = typeNameOrLiteral(m, typ, "NCSTRING")
|
|
of tyBool: result = typeNameOrLiteral(m, typ, "NIM_BOOL")
|
|
of tyChar: result = typeNameOrLiteral(m, typ, "NIM_CHAR")
|
|
of tyNil: result = typeNameOrLiteral(m, typ, "void*")
|
|
of tyInt..tyUInt64:
|
|
result = typeNameOrLiteral(m, typ, NumericalTypeToStr[typ.kind])
|
|
of tyDistinct, tyRange, tyOrdinal: result = getSimpleTypeDesc(m, typ.sons[0])
|
|
of tyStatic:
|
|
if typ.n != nil: result = getSimpleTypeDesc(m, lastSon typ)
|
|
else: internalError(m.config, "tyStatic for getSimpleTypeDesc")
|
|
of tyGenericInst, tyAlias, tySink, tyOwned:
|
|
result = getSimpleTypeDesc(m, lastSon typ)
|
|
else: result = nil
|
|
|
|
if result != nil and typ.isImportedType():
|
|
let sig = hashType typ
|
|
if cacheGetType(m.typeCache, sig) == nil:
|
|
m.typeCache[sig] = result
|
|
addAbiCheck(m, typ, result)
|
|
|
|
proc pushType(m: BModule, typ: PType) =
|
|
add(m.typeStack, typ)
|
|
|
|
proc getTypePre(m: BModule, typ: PType; sig: SigHash): Rope =
|
|
if typ == nil: result = rope("void")
|
|
else:
|
|
result = getSimpleTypeDesc(m, typ)
|
|
if result == nil: result = cacheGetType(m.typeCache, sig)
|
|
|
|
proc structOrUnion(t: PType): Rope =
|
|
let t = t.skipTypes({tyAlias, tySink})
|
|
(if tfUnion in t.flags: rope("union") else: rope("struct"))
|
|
|
|
proc getForwardStructFormat(m: BModule): string =
|
|
if m.compileToCpp: result = "$1 $2;$n"
|
|
else: result = "typedef $1 $2 $2;$n"
|
|
|
|
proc seqStar(m: BModule): string =
|
|
if m.config.selectedGC == gcDestructors: result = ""
|
|
else: result = "*"
|
|
|
|
proc getTypeForward(m: BModule, typ: PType; sig: SigHash): Rope =
|
|
result = cacheGetType(m.forwTypeCache, sig)
|
|
if result != nil: return
|
|
result = getTypePre(m, typ, sig)
|
|
if result != nil: return
|
|
let concrete = typ.skipTypes(abstractInst + {tyOpt})
|
|
case concrete.kind
|
|
of tySequence, tyTuple, tyObject:
|
|
result = getTypeName(m, typ, sig)
|
|
m.forwTypeCache[sig] = result
|
|
if not isImportedType(concrete):
|
|
addf(m.s[cfsForwardTypes], getForwardStructFormat(m),
|
|
[structOrUnion(typ), result])
|
|
else:
|
|
pushType(m, concrete)
|
|
doAssert m.forwTypeCache[sig] == result
|
|
else: internalError(m.config, "getTypeForward(" & $typ.kind & ')')
|
|
|
|
proc getTypeDescWeak(m: BModule; t: PType; check: var IntSet): Rope =
|
|
## like getTypeDescAux but creates only a *weak* dependency. In other words
|
|
## we know we only need a pointer to it so we only generate a struct forward
|
|
## declaration:
|
|
let etB = t.skipTypes(abstractInst)
|
|
case etB.kind
|
|
of tyObject, tyTuple:
|
|
if isImportedCppType(etB) and t.kind == tyGenericInst:
|
|
result = getTypeDescAux(m, t, check)
|
|
else:
|
|
result = getTypeForward(m, t, hashType(t))
|
|
pushType(m, t)
|
|
of tySequence:
|
|
if m.config.selectedGC == gcDestructors:
|
|
result = getTypeDescAux(m, t, check)
|
|
else:
|
|
result = getTypeForward(m, t, hashType(t)) & seqStar(m)
|
|
pushType(m, t)
|
|
else:
|
|
result = getTypeDescAux(m, t, check)
|
|
|
|
proc paramStorageLoc(param: PSym): TStorageLoc =
|
|
if param.typ.skipTypes({tyVar, tyLent, tyTypeDesc}).kind notin {
|
|
tyArray, tyOpenArray, tyVarargs}:
|
|
result = OnStack
|
|
else:
|
|
result = OnUnknown
|
|
|
|
proc genProcParams(m: BModule, t: PType, rettype, params: var Rope,
|
|
check: var IntSet, declareEnvironment=true;
|
|
weakDep=false) =
|
|
params = nil
|
|
if t.sons[0] == nil or isInvalidReturnType(m.config, t.sons[0]):
|
|
rettype = ~"void"
|
|
else:
|
|
rettype = getTypeDescAux(m, t.sons[0], check)
|
|
for i in countup(1, sonsLen(t.n) - 1):
|
|
if t.n.sons[i].kind != nkSym: internalError(m.config, t.n.info, "genProcParams")
|
|
var param = t.n.sons[i].sym
|
|
if isCompileTimeOnly(param.typ): continue
|
|
if params != nil: add(params, ~", ")
|
|
fillLoc(param.loc, locParam, t.n.sons[i], mangleParamName(m, param),
|
|
param.paramStorageLoc)
|
|
if ccgIntroducedPtr(m.config, param):
|
|
add(params, getTypeDescWeak(m, param.typ, check))
|
|
add(params, ~"*")
|
|
incl(param.loc.flags, lfIndirect)
|
|
param.loc.storage = OnUnknown
|
|
elif weakDep:
|
|
add(params, getTypeDescWeak(m, param.typ, check))
|
|
else:
|
|
add(params, getTypeDescAux(m, param.typ, check))
|
|
add(params, ~" ")
|
|
add(params, param.loc.r)
|
|
# declare the len field for open arrays:
|
|
var arr = param.typ
|
|
if arr.kind in {tyVar, tyLent}: arr = arr.lastSon
|
|
var j = 0
|
|
while arr.kind in {tyOpenArray, tyVarargs}:
|
|
# this fixes the 'sort' bug:
|
|
if param.typ.kind in {tyVar, tyLent}: param.loc.storage = OnUnknown
|
|
# need to pass hidden parameter:
|
|
addf(params, ", NI $1Len_$2", [param.loc.r, j.rope])
|
|
inc(j)
|
|
arr = arr.sons[0]
|
|
if t.sons[0] != nil and isInvalidReturnType(m.config, t.sons[0]):
|
|
var arr = t.sons[0]
|
|
if params != nil: add(params, ", ")
|
|
if mapReturnType(m.config, t.sons[0]) != ctArray:
|
|
add(params, getTypeDescWeak(m, arr, check))
|
|
add(params, "*")
|
|
else:
|
|
add(params, getTypeDescAux(m, arr, check))
|
|
addf(params, " Result", [])
|
|
if t.callConv == ccClosure and declareEnvironment:
|
|
if params != nil: add(params, ", ")
|
|
add(params, "void* ClE_0")
|
|
if tfVarargs in t.flags:
|
|
if params != nil: add(params, ", ")
|
|
add(params, "...")
|
|
if params == nil: add(params, "void)")
|
|
else: add(params, ")")
|
|
params = "(" & params
|
|
|
|
proc mangleRecFieldName(m: BModule; field: PSym): Rope =
|
|
if {sfImportc, sfExportc} * field.flags != {}:
|
|
result = field.loc.r
|
|
else:
|
|
result = rope(mangleField(m, field.name))
|
|
if result == nil: internalError(m.config, field.info, "mangleRecFieldName")
|
|
|
|
proc genRecordFieldsAux(m: BModule, n: PNode,
|
|
rectype: PType,
|
|
check: var IntSet): Rope =
|
|
result = nil
|
|
case n.kind
|
|
of nkRecList:
|
|
for i in countup(0, sonsLen(n) - 1):
|
|
add(result, genRecordFieldsAux(m, n.sons[i], rectype, check))
|
|
of nkRecCase:
|
|
if n.sons[0].kind != nkSym: internalError(m.config, n.info, "genRecordFieldsAux")
|
|
add(result, genRecordFieldsAux(m, n.sons[0], rectype, check))
|
|
# prefix mangled name with "_U" to avoid clashes with other field names,
|
|
# since identifiers are not allowed to start with '_'
|
|
var unionBody: Rope = nil
|
|
for i in countup(1, sonsLen(n) - 1):
|
|
case n.sons[i].kind
|
|
of nkOfBranch, nkElse:
|
|
let k = lastSon(n.sons[i])
|
|
if k.kind != nkSym:
|
|
let a = genRecordFieldsAux(m, k, rectype, check)
|
|
if a != nil:
|
|
if tfPacked notin rectype.flags:
|
|
add(unionBody, "struct {")
|
|
else:
|
|
if hasAttribute in CC[m.config.cCompiler].props:
|
|
add(unionBody, "struct __attribute__((__packed__)){" )
|
|
else:
|
|
addf(unionBody, "#pragma pack(push, 1)$nstruct{", [])
|
|
add(unionBody, a)
|
|
addf(unionBody, "};$n", [])
|
|
if tfPacked in rectype.flags and hasAttribute notin CC[m.config.cCompiler].props:
|
|
addf(unionBody, "#pragma pack(pop)$n", [])
|
|
else:
|
|
add(unionBody, genRecordFieldsAux(m, k, rectype, check))
|
|
else: internalError(m.config, "genRecordFieldsAux(record case branch)")
|
|
if unionBody != nil:
|
|
addf(result, "union{$n$1};$n", [unionBody])
|
|
of nkSym:
|
|
let field = n.sym
|
|
if field.typ.kind == tyVoid: return
|
|
#assert(field.ast == nil)
|
|
let sname = mangleRecFieldName(m, field)
|
|
fillLoc(field.loc, locField, n, sname, OnUnknown)
|
|
# for importcpp'ed objects, we only need to set field.loc, but don't
|
|
# have to recurse via 'getTypeDescAux'. And not doing so prevents problems
|
|
# with heavily templatized C++ code:
|
|
if not isImportedCppType(rectype):
|
|
let fieldType = field.loc.lode.typ.skipTypes(abstractInst)
|
|
if fieldType.kind == tyUncheckedArray:
|
|
addf(result, "$1 $2[SEQ_DECL_SIZE];$n",
|
|
[getTypeDescAux(m, fieldType.elemType, check), sname])
|
|
elif fieldType.kind == tySequence and m.config.selectedGC != gcDestructors:
|
|
# we need to use a weak dependency here for trecursive_table.
|
|
addf(result, "$1 $2;$n", [getTypeDescWeak(m, field.loc.t, check), sname])
|
|
elif field.bitsize != 0:
|
|
addf(result, "$1 $2:$3;$n", [getTypeDescAux(m, field.loc.t, check), sname, rope($field.bitsize)])
|
|
else:
|
|
# don't use fieldType here because we need the
|
|
# tyGenericInst for C++ template support
|
|
addf(result, "$1 $2;$n", [getTypeDescAux(m, field.loc.t, check), sname])
|
|
else: internalError(m.config, n.info, "genRecordFieldsAux()")
|
|
|
|
proc getRecordFields(m: BModule, typ: PType, check: var IntSet): Rope =
|
|
result = genRecordFieldsAux(m, typ.n, typ, check)
|
|
|
|
proc fillObjectFields*(m: BModule; typ: PType) =
|
|
# sometimes generic objects are not consistently merged. We patch over
|
|
# this fact here.
|
|
var check = initIntSet()
|
|
discard getRecordFields(m, typ, check)
|
|
|
|
proc mangleDynLibProc(sym: PSym): Rope
|
|
|
|
proc getRecordDesc(m: BModule, typ: PType, name: Rope,
|
|
check: var IntSet): Rope =
|
|
# declare the record:
|
|
var hasField = false
|
|
|
|
if tfPacked in typ.flags:
|
|
if hasAttribute in CC[m.config.cCompiler].props:
|
|
result = structOrUnion(typ) & " __attribute__((__packed__))"
|
|
else:
|
|
result = "#pragma pack(push, 1)\L" & structOrUnion(typ)
|
|
else:
|
|
result = structOrUnion(typ)
|
|
|
|
result.add " "
|
|
result.add name
|
|
|
|
if typ.kind == tyObject:
|
|
|
|
if typ.sons[0] == nil:
|
|
if (typ.sym != nil and sfPure in typ.sym.flags) or tfFinal in typ.flags:
|
|
appcg(m, result, " {$n", [])
|
|
else:
|
|
appcg(m, result, " {$n#TNimType* m_type;$n", [])
|
|
hasField = true
|
|
elif m.compileToCpp:
|
|
appcg(m, result, " : public $1 {$n",
|
|
[getTypeDescAux(m, typ.sons[0].skipTypes(skipPtrs), check)])
|
|
if typ.isException:
|
|
appcg(m, result, "virtual void raise() { throw *this; }$n") # required for polymorphic exceptions
|
|
if typ.sym.magic == mException:
|
|
# Add cleanup destructor to Exception base class
|
|
appcg(m, result, "~$1();$n", [name])
|
|
# define it out of the class body and into the procs section so we don't have to
|
|
# artificially forward-declare popCurrentExceptionEx (very VERY troublesome for HCR)
|
|
appcg(m, cfsProcs, "inline $1::~$1() {if(this->raiseId) #popCurrentExceptionEx(this->raiseId);}$n", [name])
|
|
hasField = true
|
|
else:
|
|
appcg(m, result, " {$n $1 Sup;$n",
|
|
[getTypeDescAux(m, typ.sons[0].skipTypes(skipPtrs), check)])
|
|
hasField = true
|
|
else:
|
|
addf(result, " {$n", [name])
|
|
|
|
let desc = getRecordFields(m, typ, check)
|
|
if desc == nil and not hasField:
|
|
addf(result, "char dummy;$n", [])
|
|
else:
|
|
add(result, desc)
|
|
add(result, "};\L")
|
|
if tfPacked in typ.flags and hasAttribute notin CC[m.config.cCompiler].props:
|
|
result.add "#pragma pack(pop)\L"
|
|
|
|
proc getTupleDesc(m: BModule, typ: PType, name: Rope,
|
|
check: var IntSet): Rope =
|
|
result = "$1 $2 {$n" % [structOrUnion(typ), name]
|
|
var desc: Rope = nil
|
|
for i in countup(0, sonsLen(typ) - 1):
|
|
addf(desc, "$1 Field$2;$n",
|
|
[getTypeDescAux(m, typ.sons[i], check), rope(i)])
|
|
if desc == nil: add(result, "char dummy;\L")
|
|
else: add(result, desc)
|
|
add(result, "};\L")
|
|
|
|
proc scanCppGenericSlot(pat: string, cursor, outIdx, outStars: var int): bool =
|
|
# A helper proc for handling cppimport patterns, involving numeric
|
|
# placeholders for generic types (e.g. '0, '**2, etc).
|
|
# pre: the cursor must be placed at the ' symbol
|
|
# post: the cursor will be placed after the final digit
|
|
# false will returned if the input is not recognized as a placeholder
|
|
inc cursor
|
|
let begin = cursor
|
|
while pat[cursor] == '*': inc cursor
|
|
if pat[cursor] in Digits:
|
|
outIdx = pat[cursor].ord - '0'.ord
|
|
outStars = cursor - begin
|
|
inc cursor
|
|
return true
|
|
else:
|
|
return false
|
|
|
|
proc resolveStarsInCppType(typ: PType, idx, stars: int): PType =
|
|
# Make sure the index refers to one of the generic params of the type.
|
|
# XXX: we should catch this earlier and report it as a semantic error.
|
|
if idx >= typ.len:
|
|
doAssert false, "invalid apostrophe type parameter index"
|
|
|
|
result = typ.sons[idx]
|
|
for i in 1..stars:
|
|
if result != nil and result.len > 0:
|
|
result = if result.kind == tyGenericInst: result.sons[1]
|
|
else: result.elemType
|
|
|
|
proc getSeqPayloadType(m: BModule; t: PType): Rope =
|
|
result = getTypeForward(m, t, hashType(t)) & "_Content"
|
|
when false:
|
|
var check = initIntSet()
|
|
# XXX remove this duplication:
|
|
appcg(m, m.s[cfsSeqTypes],
|
|
"struct $2_Content { NI cap; void* allocator; $1 data[SEQ_DECL_SIZE]; };$n",
|
|
[getTypeDescAux(m, t.sons[0], check), result])
|
|
|
|
proc getTypeDescAux(m: BModule, origTyp: PType, check: var IntSet): Rope =
|
|
# returns only the type's name
|
|
var t = origTyp.skipTypes(irrelevantForBackend-{tyOwned})
|
|
if containsOrIncl(check, t.id):
|
|
if not (isImportedCppType(origTyp) or isImportedCppType(t)):
|
|
internalError(m.config, "cannot generate C type for: " & typeToString(origTyp))
|
|
# XXX: this BUG is hard to fix -> we need to introduce helper structs,
|
|
# but determining when this needs to be done is hard. We should split
|
|
# C type generation into an analysis and a code generation phase somehow.
|
|
if t.sym != nil: useHeader(m, t.sym)
|
|
if t != origTyp and origTyp.sym != nil: useHeader(m, origTyp.sym)
|
|
let sig = hashType(origTyp)
|
|
result = getTypePre(m, t, sig)
|
|
if result != nil:
|
|
excl(check, t.id)
|
|
return
|
|
case t.kind
|
|
of tyRef, tyPtr, tyVar, tyLent:
|
|
var star = if t.kind == tyVar and tfVarIsPtr notin origTyp.flags and
|
|
compileToCpp(m): "&" else: "*"
|
|
var et = origTyp.skipTypes(abstractInst).lastSon
|
|
var etB = et.skipTypes(abstractInst)
|
|
if mapType(m.config, t) == ctPtrToArray:
|
|
if etB.kind == tySet:
|
|
et = getSysType(m.g.graph, unknownLineInfo(), tyUInt8)
|
|
else:
|
|
et = elemType(etB)
|
|
etB = et.skipTypes(abstractInst)
|
|
star[0] = '*'
|
|
case etB.kind
|
|
of tyObject, tyTuple:
|
|
if isImportedCppType(etB) and et.kind == tyGenericInst:
|
|
result = getTypeDescAux(m, et, check) & star
|
|
else:
|
|
# no restriction! We have a forward declaration for structs
|
|
let name = getTypeForward(m, et, hashType et)
|
|
result = name & star
|
|
m.typeCache[sig] = result
|
|
of tySequence:
|
|
# no restriction! We have a forward declaration for structs
|
|
let name = getTypeForward(m, et, hashType et)
|
|
result = name & seqStar(m) & star
|
|
m.typeCache[sig] = result
|
|
pushType(m, et)
|
|
else:
|
|
# else we have a strong dependency :-(
|
|
result = getTypeDescAux(m, et, check) & star
|
|
m.typeCache[sig] = result
|
|
of tyOpenArray, tyVarargs:
|
|
result = getTypeDescWeak(m, t.sons[0], check) & "*"
|
|
m.typeCache[sig] = result
|
|
of tyEnum:
|
|
result = cacheGetType(m.typeCache, sig)
|
|
if result == nil:
|
|
result = getTypeName(m, origTyp, sig)
|
|
if not (isImportedCppType(t) or
|
|
(sfImportc in t.sym.flags and t.sym.magic == mNone)):
|
|
m.typeCache[sig] = result
|
|
var size: int
|
|
if firstOrd(m.config, t) < 0:
|
|
addf(m.s[cfsTypes], "typedef NI32 $1;$n", [result])
|
|
size = 4
|
|
else:
|
|
size = int(getSize(m.config, t))
|
|
case size
|
|
of 1: addf(m.s[cfsTypes], "typedef NU8 $1;$n", [result])
|
|
of 2: addf(m.s[cfsTypes], "typedef NU16 $1;$n", [result])
|
|
of 4: addf(m.s[cfsTypes], "typedef NI32 $1;$n", [result])
|
|
of 8: addf(m.s[cfsTypes], "typedef NI64 $1;$n", [result])
|
|
else: internalError(m.config, t.sym.info, "getTypeDescAux: enum")
|
|
when false:
|
|
let owner = hashOwner(t.sym)
|
|
if not gDebugInfo.hasEnum(t.sym.name.s, t.sym.info.line, owner):
|
|
var vals: seq[(string, int)] = @[]
|
|
for i in countup(0, t.n.len - 1):
|
|
assert(t.n.sons[i].kind == nkSym)
|
|
let field = t.n.sons[i].sym
|
|
vals.add((field.name.s, field.position.int))
|
|
gDebugInfo.registerEnum(EnumDesc(size: size, owner: owner, id: t.sym.id,
|
|
name: t.sym.name.s, values: vals))
|
|
of tyProc:
|
|
result = getTypeName(m, origTyp, sig)
|
|
m.typeCache[sig] = result
|
|
var rettype, desc: Rope
|
|
genProcParams(m, t, rettype, desc, check, true, true)
|
|
if not isImportedType(t):
|
|
if t.callConv != ccClosure: # procedure vars may need a closure!
|
|
addf(m.s[cfsTypes], "typedef $1_PTR($2, $3) $4;$n",
|
|
[rope(CallingConvToStr[t.callConv]), rettype, result, desc])
|
|
else:
|
|
addf(m.s[cfsTypes], "typedef struct {$n" &
|
|
"N_NIMCALL_PTR($2, ClP_0) $3;$n" &
|
|
"void* ClE_0;$n} $1;$n",
|
|
[result, rettype, desc])
|
|
of tySequence:
|
|
# we cannot use getTypeForward here because then t would be associated
|
|
# with the name of the struct, not with the pointer to the struct:
|
|
result = cacheGetType(m.forwTypeCache, sig)
|
|
if result == nil:
|
|
result = getTypeName(m, origTyp, sig)
|
|
if not isImportedType(t):
|
|
addf(m.s[cfsForwardTypes], getForwardStructFormat(m),
|
|
[structOrUnion(t), result])
|
|
m.forwTypeCache[sig] = result
|
|
assert(cacheGetType(m.typeCache, sig) == nil)
|
|
m.typeCache[sig] = result & seqStar(m)
|
|
if not isImportedType(t):
|
|
if skipTypes(t.sons[0], typedescInst).kind != tyEmpty:
|
|
const
|
|
cppSeq = "struct $2 : #TGenericSeq {$n"
|
|
cSeq = "struct $2 {$n" &
|
|
" #TGenericSeq Sup;$n"
|
|
if m.config.selectedGC == gcDestructors:
|
|
appcg(m, m.s[cfsTypes],
|
|
"typedef struct{ NI cap;void* allocator;$1 data[SEQ_DECL_SIZE];}$2_Content;$n" &
|
|
"struct $2 {$n" &
|
|
" NI len; $2_Content* p;$n" &
|
|
"};$n", [getTypeDescAux(m, t.sons[0], check), result])
|
|
else:
|
|
appcg(m, m.s[cfsSeqTypes],
|
|
(if m.compileToCpp: cppSeq else: cSeq) &
|
|
" $1 data[SEQ_DECL_SIZE];$n" &
|
|
"};$n", [getTypeDescAux(m, t.sons[0], check), result])
|
|
elif m.config.selectedGC == gcDestructors:
|
|
internalError(m.config, "cannot map the empty seq type to a C type")
|
|
else:
|
|
result = rope("TGenericSeq")
|
|
add(result, seqStar(m))
|
|
of tyUncheckedArray:
|
|
result = getTypeName(m, origTyp, sig)
|
|
m.typeCache[sig] = result
|
|
if not isImportedType(t):
|
|
let foo = getTypeDescAux(m, t.sons[0], check)
|
|
addf(m.s[cfsTypes], "typedef $1 $2[1];$n", [foo, result])
|
|
of tyArray:
|
|
var n: BiggestInt = lengthOrd(m.config, t)
|
|
if n <= 0: n = 1 # make an array of at least one element
|
|
result = getTypeName(m, origTyp, sig)
|
|
m.typeCache[sig] = result
|
|
if not isImportedType(t):
|
|
let foo = getTypeDescAux(m, t.sons[1], check)
|
|
addf(m.s[cfsTypes], "typedef $1 $2[$3];$n",
|
|
[foo, result, rope(n)])
|
|
else: addAbiCheck(m, t, result)
|
|
of tyObject, tyTuple:
|
|
if isImportedCppType(t) and origTyp.kind == tyGenericInst:
|
|
let cppName = getTypeName(m, t, sig)
|
|
var i = 0
|
|
var chunkStart = 0
|
|
|
|
template addResultType(ty: untyped) =
|
|
if ty == nil or ty.kind == tyVoid:
|
|
result.add(~"void")
|
|
elif ty.kind == tyStatic:
|
|
internalAssert m.config, ty.n != nil
|
|
result.add ty.n.renderTree
|
|
else:
|
|
result.add getTypeDescAux(m, ty, check)
|
|
|
|
while i < cppName.data.len:
|
|
if cppName.data[i] == '\'':
|
|
var chunkEnd = i-1
|
|
var idx, stars: int
|
|
if scanCppGenericSlot(cppName.data, i, idx, stars):
|
|
result.add cppName.data.substr(chunkStart, chunkEnd)
|
|
chunkStart = i
|
|
|
|
let typeInSlot = resolveStarsInCppType(origTyp, idx + 1, stars)
|
|
addResultType(typeInSlot)
|
|
else:
|
|
inc i
|
|
|
|
if chunkStart != 0:
|
|
result.add cppName.data.substr(chunkStart)
|
|
else:
|
|
result = cppName & "<"
|
|
for i in 1 .. origTyp.len-2:
|
|
if i > 1: result.add(" COMMA ")
|
|
addResultType(origTyp.sons[i])
|
|
result.add("> ")
|
|
# always call for sideeffects:
|
|
assert t.kind != tyTuple
|
|
discard getRecordDesc(m, t, result, check)
|
|
# The resulting type will include commas and these won't play well
|
|
# with the C macros for defining procs such as N_NIMCALL. We must
|
|
# create a typedef for the type and use it in the proc signature:
|
|
let typedefName = ~"TY" & $sig
|
|
addf(m.s[cfsTypes], "typedef $1 $2;$n", [result, typedefName])
|
|
m.typeCache[sig] = typedefName
|
|
result = typedefName
|
|
else:
|
|
when false:
|
|
if t.sym != nil and t.sym.name.s == "KeyValuePair":
|
|
if t == origTyp:
|
|
echo "wtf: came here"
|
|
writeStackTrace()
|
|
quit 1
|
|
result = cacheGetType(m.forwTypeCache, sig)
|
|
if result == nil:
|
|
when false:
|
|
if t.sym != nil and t.sym.name.s == "KeyValuePair":
|
|
# or {sfImportc, sfExportc} * t.sym.flags == {}:
|
|
if t.loc.r != nil:
|
|
echo t.kind, " ", hashType t
|
|
echo origTyp.kind, " ", sig
|
|
assert t.loc.r == nil
|
|
result = getTypeName(m, origTyp, sig)
|
|
m.forwTypeCache[sig] = result
|
|
if not isImportedType(t):
|
|
addf(m.s[cfsForwardTypes], getForwardStructFormat(m),
|
|
[structOrUnion(t), result])
|
|
assert m.forwTypeCache[sig] == result
|
|
m.typeCache[sig] = result # always call for sideeffects:
|
|
if not incompleteType(t):
|
|
let recdesc = if t.kind != tyTuple: getRecordDesc(m, t, result, check)
|
|
else: getTupleDesc(m, t, result, check)
|
|
if not isImportedType(t):
|
|
add(m.s[cfsTypes], recdesc)
|
|
elif tfIncompleteStruct notin t.flags: addAbiCheck(m, t, result)
|
|
of tySet:
|
|
result = $t.kind & '_' & getTypeName(m, t.lastSon, hashType t.lastSon)
|
|
m.typeCache[sig] = result
|
|
if not isImportedType(t):
|
|
let s = int(getSize(m.config, t))
|
|
case s
|
|
of 1, 2, 4, 8: addf(m.s[cfsTypes], "typedef NU$2 $1;$n", [result, rope(s*8)])
|
|
else: addf(m.s[cfsTypes], "typedef NU8 $1[$2];$n",
|
|
[result, rope(getSize(m.config, t))])
|
|
of tyGenericInst, tyDistinct, tyOrdinal, tyTypeDesc, tyAlias, tySink, tyOwned,
|
|
tyUserTypeClass, tyUserTypeClassInst, tyInferred:
|
|
result = getTypeDescAux(m, lastSon(t), check)
|
|
else:
|
|
internalError(m.config, "getTypeDescAux(" & $t.kind & ')')
|
|
result = nil
|
|
# fixes bug #145:
|
|
excl(check, t.id)
|
|
|
|
proc getTypeDesc(m: BModule, typ: PType): Rope =
|
|
var check = initIntSet()
|
|
result = getTypeDescAux(m, typ, check)
|
|
|
|
type
|
|
TClosureTypeKind = enum ## In C closures are mapped to 3 different things.
|
|
clHalf, ## fn(args) type without the trailing 'void* env' parameter
|
|
clHalfWithEnv, ## fn(args, void* env) type with trailing 'void* env' parameter
|
|
clFull ## struct {fn(args, void* env), env}
|
|
|
|
proc getClosureType(m: BModule, t: PType, kind: TClosureTypeKind): Rope =
|
|
assert t.kind == tyProc
|
|
var check = initIntSet()
|
|
result = getTempName(m)
|
|
var rettype, desc: Rope
|
|
genProcParams(m, t, rettype, desc, check, declareEnvironment=kind != clHalf)
|
|
if not isImportedType(t):
|
|
if t.callConv != ccClosure or kind != clFull:
|
|
addf(m.s[cfsTypes], "typedef $1_PTR($2, $3) $4;$n",
|
|
[rope(CallingConvToStr[t.callConv]), rettype, result, desc])
|
|
else:
|
|
addf(m.s[cfsTypes], "typedef struct {$n" &
|
|
"N_NIMCALL_PTR($2, ClP_0) $3;$n" &
|
|
"void* ClE_0;$n} $1;$n",
|
|
[result, rettype, desc])
|
|
|
|
proc finishTypeDescriptions(m: BModule) =
|
|
var i = 0
|
|
while i < len(m.typeStack):
|
|
discard getTypeDesc(m, m.typeStack[i])
|
|
inc(i)
|
|
|
|
template cgDeclFrmt*(s: PSym): string = s.constraint.strVal
|
|
|
|
proc isReloadable(m: BModule, prc: PSym): bool =
|
|
return m.hcrOn and sfNonReloadable notin prc.flags
|
|
|
|
proc isNonReloadable(m: BModule, prc: PSym): bool =
|
|
return m.hcrOn and sfNonReloadable in prc.flags
|
|
|
|
proc genProcHeader(m: BModule, prc: PSym, asPtr: bool = false): Rope =
|
|
var
|
|
rettype, params: Rope
|
|
# using static is needed for inline procs
|
|
if lfExportLib in prc.loc.flags:
|
|
if isHeaderFile in m.flags:
|
|
result.add "N_LIB_IMPORT "
|
|
else:
|
|
result.add "N_LIB_EXPORT "
|
|
elif prc.typ.callConv == ccInline or asPtr or isNonReloadable(m, prc):
|
|
result.add "static "
|
|
elif {sfImportc, sfExportc} * prc.flags == {}:
|
|
result.add "N_LIB_PRIVATE "
|
|
var check = initIntSet()
|
|
fillLoc(prc.loc, locProc, prc.ast[namePos], mangleName(m, prc), OnUnknown)
|
|
genProcParams(m, prc.typ, rettype, params, check)
|
|
# handle the 2 options for hotcodereloading codegen - function pointer
|
|
# (instead of forward declaration) or header for function budy with "_actual" postfix
|
|
let asPtrStr = rope(if asPtr: "_PTR" else: "")
|
|
var name = prc.loc.r
|
|
if isReloadable(m, prc) and not asPtr:
|
|
add(name, "_actual")
|
|
# careful here! don't access ``prc.ast`` as that could reload large parts of
|
|
# the object graph!
|
|
if prc.constraint.isNil:
|
|
addf(result, "$1$2($3, $4)$5",
|
|
[rope(CallingConvToStr[prc.typ.callConv]), asPtrStr, rettype, name,
|
|
params])
|
|
else:
|
|
let asPtrStr = if asPtr: (rope("(*") & name & ")") else: name
|
|
result = prc.cgDeclFrmt % [rettype, asPtrStr, params]
|
|
|
|
# ------------------ type info generation -------------------------------------
|
|
|
|
proc genTypeInfo(m: BModule, t: PType; info: TLineInfo): Rope
|
|
proc getNimNode(m: BModule): Rope =
|
|
result = "$1[$2]" % [m.typeNodesName, rope(m.typeNodes)]
|
|
inc(m.typeNodes)
|
|
|
|
proc TINameForHcr(m: BModule, name: Rope): Rope =
|
|
return if m.hcrOn: "(*".rope & name & ")" else: name
|
|
|
|
proc genTypeInfoAuxBase(m: BModule; typ, origType: PType;
|
|
name, base: Rope; info: TLineInfo) =
|
|
var nimtypeKind: int
|
|
#allocMemTI(m, typ, name)
|
|
if isObjLackingTypeField(typ):
|
|
nimtypeKind = ord(tyPureObject)
|
|
else:
|
|
nimtypeKind = ord(typ.kind)
|
|
|
|
let nameHcr = TINameForHcr(m, name)
|
|
|
|
var size: Rope
|
|
if tfIncompleteStruct in typ.flags: size = rope"void*"
|
|
else: size = getTypeDesc(m, origType)
|
|
addf(m.s[cfsTypeInit3],
|
|
"$1.size = sizeof($2);$n" & "$1.kind = $3;$n" & "$1.base = $4;$n",
|
|
[nameHcr, size, rope(nimtypeKind), base])
|
|
# compute type flags for GC optimization
|
|
var flags = 0
|
|
if not containsGarbageCollectedRef(typ): flags = flags or 1
|
|
if not canFormAcycle(typ): flags = flags or 2
|
|
#else MessageOut("can contain a cycle: " & typeToString(typ))
|
|
if flags != 0:
|
|
addf(m.s[cfsTypeInit3], "$1.flags = $2;$n", [nameHcr, rope(flags)])
|
|
discard cgsym(m, "TNimType")
|
|
if isDefined(m.config, "nimTypeNames"):
|
|
var typename = typeToString(if origType.typeInst != nil: origType.typeInst
|
|
else: origType, preferName)
|
|
if typename == "ref object" and origType.skipTypes(skipPtrs).sym != nil:
|
|
typename = "anon ref object from " & m.config$origType.skipTypes(skipPtrs).sym.info
|
|
addf(m.s[cfsTypeInit3], "$1.name = $2;$n",
|
|
[nameHcr, makeCstring typename])
|
|
discard cgsym(m, "nimTypeRoot")
|
|
addf(m.s[cfsTypeInit3], "$1.nextType = nimTypeRoot; nimTypeRoot=&$1;$n",
|
|
[nameHcr])
|
|
|
|
if m.hcrOn:
|
|
addf(m.s[cfsVars], "static TNimType* $1;$n", [name])
|
|
addf(m.hcrCreateTypeInfosProc, "\thcrRegisterGlobal($2, \"$1\", sizeof(TNimType), NULL, (void**)&$1);$n",
|
|
[name, getModuleDllPath(m, m.module)])
|
|
else:
|
|
addf(m.s[cfsVars], "TNimType $1;$n", [name])
|
|
|
|
proc genTypeInfoAux(m: BModule, typ, origType: PType, name: Rope;
|
|
info: TLineInfo) =
|
|
var base: Rope
|
|
if sonsLen(typ) > 0 and typ.lastSon != nil:
|
|
var x = typ.lastSon
|
|
if typ.kind == tyObject: x = x.skipTypes(skipPtrs)
|
|
if typ.kind == tyPtr and x.kind == tyObject and incompleteType(x):
|
|
base = rope("0")
|
|
else:
|
|
base = genTypeInfo(m, x, info)
|
|
else:
|
|
base = rope("0")
|
|
genTypeInfoAuxBase(m, typ, origType, name, base, info)
|
|
|
|
proc discriminatorTableName(m: BModule, objtype: PType, d: PSym): Rope =
|
|
# bugfix: we need to search the type that contains the discriminator:
|
|
var objtype = objtype.skipTypes(abstractPtrs)
|
|
while lookupInRecord(objtype.n, d.name) == nil:
|
|
objtype = objtype.sons[0].skipTypes(abstractPtrs)
|
|
if objtype.sym == nil:
|
|
internalError(m.config, d.info, "anonymous obj with discriminator")
|
|
result = "NimDT_$1_$2" % [rope($hashType(objtype)), rope(d.name.s.mangle)]
|
|
|
|
proc discriminatorTableDecl(m: BModule, objtype: PType, d: PSym): Rope =
|
|
discard cgsym(m, "TNimNode")
|
|
var tmp = discriminatorTableName(m, objtype, d)
|
|
result = "TNimNode* $1[$2];$n" % [tmp, rope(lengthOrd(m.config, d.typ)+1)]
|
|
|
|
proc genTNimNodeArray(m: BModule, name: Rope, size: Rope) =
|
|
if m.hcrOn:
|
|
addf(m.s[cfsVars], "static TNimNode** $1;$n", [name])
|
|
addf(m.hcrCreateTypeInfosProc, "\thcrRegisterGlobal($3, \"$1\", sizeof(TNimNode*) * $2, NULL, (void**)&$1);$n",
|
|
[name, size, getModuleDllPath(m, m.module)])
|
|
else:
|
|
addf(m.s[cfsTypeInit1], "static TNimNode* $1[$2];$n", [name, size])
|
|
|
|
proc genObjectFields(m: BModule, typ, origType: PType, n: PNode, expr: Rope;
|
|
info: TLineInfo) =
|
|
case n.kind
|
|
of nkRecList:
|
|
var L = sonsLen(n)
|
|
if L == 1:
|
|
genObjectFields(m, typ, origType, n.sons[0], expr, info)
|
|
elif L > 0:
|
|
var tmp = getTempName(m) & "_" & $L
|
|
genTNimNodeArray(m, tmp, rope(L))
|
|
for i in countup(0, L-1):
|
|
var tmp2 = getNimNode(m)
|
|
addf(m.s[cfsTypeInit3], "$1[$2] = &$3;$n", [tmp, rope(i), tmp2])
|
|
genObjectFields(m, typ, origType, n.sons[i], tmp2, info)
|
|
addf(m.s[cfsTypeInit3], "$1.len = $2; $1.kind = 2; $1.sons = &$3[0];$n",
|
|
[expr, rope(L), tmp])
|
|
else:
|
|
addf(m.s[cfsTypeInit3], "$1.len = $2; $1.kind = 2;$n", [expr, rope(L)])
|
|
of nkRecCase:
|
|
assert(n.sons[0].kind == nkSym)
|
|
var field = n.sons[0].sym
|
|
var tmp = discriminatorTableName(m, typ, field)
|
|
var L = lengthOrd(m.config, field.typ)
|
|
assert L > 0
|
|
if field.loc.r == nil: fillObjectFields(m, typ)
|
|
if field.loc.t == nil:
|
|
internalError(m.config, n.info, "genObjectFields")
|
|
addf(m.s[cfsTypeInit3], "$1.kind = 3;$n" &
|
|
"$1.offset = offsetof($2, $3);$n" & "$1.typ = $4;$n" &
|
|
"$1.name = $5;$n" & "$1.sons = &$6[0];$n" &
|
|
"$1.len = $7;$n", [expr, getTypeDesc(m, origType), field.loc.r,
|
|
genTypeInfo(m, field.typ, info),
|
|
makeCString(field.name.s),
|
|
tmp, rope(L)])
|
|
addf(m.s[cfsData], "TNimNode* $1[$2];$n", [tmp, rope(L+1)])
|
|
for i in countup(1, sonsLen(n)-1):
|
|
var b = n.sons[i] # branch
|
|
var tmp2 = getNimNode(m)
|
|
genObjectFields(m, typ, origType, lastSon(b), tmp2, info)
|
|
case b.kind
|
|
of nkOfBranch:
|
|
if sonsLen(b) < 2:
|
|
internalError(m.config, b.info, "genObjectFields; nkOfBranch broken")
|
|
for j in countup(0, sonsLen(b) - 2):
|
|
if b.sons[j].kind == nkRange:
|
|
var x = int(getOrdValue(b.sons[j].sons[0]))
|
|
var y = int(getOrdValue(b.sons[j].sons[1]))
|
|
while x <= y:
|
|
addf(m.s[cfsTypeInit3], "$1[$2] = &$3;$n", [tmp, rope(x), tmp2])
|
|
inc(x)
|
|
else:
|
|
addf(m.s[cfsTypeInit3], "$1[$2] = &$3;$n",
|
|
[tmp, rope(getOrdValue(b.sons[j])), tmp2])
|
|
of nkElse:
|
|
addf(m.s[cfsTypeInit3], "$1[$2] = &$3;$n",
|
|
[tmp, rope(L), tmp2])
|
|
else: internalError(m.config, n.info, "genObjectFields(nkRecCase)")
|
|
of nkSym:
|
|
var field = n.sym
|
|
# Do not produce code for void types
|
|
if isEmptyType(field.typ): return
|
|
if field.bitsize == 0:
|
|
if field.loc.r == nil: fillObjectFields(m, typ)
|
|
if field.loc.t == nil:
|
|
internalError(m.config, n.info, "genObjectFields")
|
|
addf(m.s[cfsTypeInit3], "$1.kind = 1;$n" &
|
|
"$1.offset = offsetof($2, $3);$n" & "$1.typ = $4;$n" &
|
|
"$1.name = $5;$n", [expr, getTypeDesc(m, origType),
|
|
field.loc.r, genTypeInfo(m, field.typ, info), makeCString(field.name.s)])
|
|
else: internalError(m.config, n.info, "genObjectFields")
|
|
|
|
proc genObjectInfo(m: BModule, typ, origType: PType, name: Rope; info: TLineInfo) =
|
|
if typ.kind == tyObject:
|
|
if incompleteType(typ):
|
|
localError(m.config, info, "request for RTTI generation for incomplete object: " &
|
|
typeToString(typ))
|
|
genTypeInfoAux(m, typ, origType, name, info)
|
|
else:
|
|
genTypeInfoAuxBase(m, typ, origType, name, rope("0"), info)
|
|
var tmp = getNimNode(m)
|
|
if not isImportedType(typ):
|
|
genObjectFields(m, typ, origType, typ.n, tmp, info)
|
|
addf(m.s[cfsTypeInit3], "$1.node = &$2;$n", [TINameForHcr(m, name), tmp])
|
|
var t = typ.sons[0]
|
|
while t != nil:
|
|
t = t.skipTypes(skipPtrs)
|
|
t.flags.incl tfObjHasKids
|
|
t = t.sons[0]
|
|
|
|
proc genTupleInfo(m: BModule, typ, origType: PType, name: Rope; info: TLineInfo) =
|
|
genTypeInfoAuxBase(m, typ, typ, name, rope("0"), info)
|
|
var expr = getNimNode(m)
|
|
var length = sonsLen(typ)
|
|
if length > 0:
|
|
var tmp = getTempName(m) & "_" & $length
|
|
genTNimNodeArray(m, tmp, rope(length))
|
|
for i in countup(0, length - 1):
|
|
var a = typ.sons[i]
|
|
var tmp2 = getNimNode(m)
|
|
addf(m.s[cfsTypeInit3], "$1[$2] = &$3;$n", [tmp, rope(i), tmp2])
|
|
addf(m.s[cfsTypeInit3], "$1.kind = 1;$n" &
|
|
"$1.offset = offsetof($2, Field$3);$n" &
|
|
"$1.typ = $4;$n" &
|
|
"$1.name = \"Field$3\";$n",
|
|
[tmp2, getTypeDesc(m, origType), rope(i), genTypeInfo(m, a, info)])
|
|
addf(m.s[cfsTypeInit3], "$1.len = $2; $1.kind = 2; $1.sons = &$3[0];$n",
|
|
[expr, rope(length), tmp])
|
|
else:
|
|
addf(m.s[cfsTypeInit3], "$1.len = $2; $1.kind = 2;$n",
|
|
[expr, rope(length)])
|
|
addf(m.s[cfsTypeInit3], "$1.node = &$2;$n", [TINameForHcr(m, name), expr])
|
|
|
|
proc genEnumInfo(m: BModule, typ: PType, name: Rope; info: TLineInfo) =
|
|
# Type information for enumerations is quite heavy, so we do some
|
|
# optimizations here: The ``typ`` field is never set, as it is redundant
|
|
# anyway. We generate a cstring array and a loop over it. Exceptional
|
|
# positions will be reset after the loop.
|
|
genTypeInfoAux(m, typ, typ, name, info)
|
|
var length = sonsLen(typ.n)
|
|
var nodePtrs = getTempName(m) & "_" & $length
|
|
genTNimNodeArray(m, nodePtrs, rope(length))
|
|
var enumNames, specialCases: Rope
|
|
var firstNimNode = m.typeNodes
|
|
var hasHoles = false
|
|
for i in countup(0, length - 1):
|
|
assert(typ.n.sons[i].kind == nkSym)
|
|
var field = typ.n.sons[i].sym
|
|
var elemNode = getNimNode(m)
|
|
if field.ast == nil:
|
|
# no explicit string literal for the enum field, so use field.name:
|
|
add(enumNames, makeCString(field.name.s))
|
|
else:
|
|
add(enumNames, makeCString(field.ast.strVal))
|
|
if i < length - 1: add(enumNames, ", \L")
|
|
if field.position != i or tfEnumHasHoles in typ.flags:
|
|
addf(specialCases, "$1.offset = $2;$n", [elemNode, rope(field.position)])
|
|
hasHoles = true
|
|
var enumArray = getTempName(m)
|
|
var counter = getTempName(m)
|
|
addf(m.s[cfsTypeInit1], "NI $1;$n", [counter])
|
|
addf(m.s[cfsTypeInit1], "static char* NIM_CONST $1[$2] = {$n$3};$n",
|
|
[enumArray, rope(length), enumNames])
|
|
addf(m.s[cfsTypeInit3], "for ($1 = 0; $1 < $2; $1++) {$n" &
|
|
"$3[$1+$4].kind = 1;$n" & "$3[$1+$4].offset = $1;$n" &
|
|
"$3[$1+$4].name = $5[$1];$n" & "$6[$1] = &$3[$1+$4];$n" & "}$n", [counter,
|
|
rope(length), m.typeNodesName, rope(firstNimNode), enumArray, nodePtrs])
|
|
add(m.s[cfsTypeInit3], specialCases)
|
|
addf(m.s[cfsTypeInit3],
|
|
"$1.len = $2; $1.kind = 2; $1.sons = &$3[0];$n$4.node = &$1;$n",
|
|
[getNimNode(m), rope(length), nodePtrs, TINameForHcr(m, name)])
|
|
if hasHoles:
|
|
# 1 << 2 is {ntfEnumHole}
|
|
addf(m.s[cfsTypeInit3], "$1.flags = 1<<2;$n", [TINameForHcr(m, name)])
|
|
|
|
proc genSetInfo(m: BModule, typ: PType, name: Rope; info: TLineInfo) =
|
|
assert(typ.sons[0] != nil)
|
|
genTypeInfoAux(m, typ, typ, name, info)
|
|
var tmp = getNimNode(m)
|
|
addf(m.s[cfsTypeInit3], "$1.len = $2; $1.kind = 0;$n" & "$3.node = &$1;$n",
|
|
[tmp, rope(firstOrd(m.config, typ)), TINameForHcr(m, name)])
|
|
|
|
proc genArrayInfo(m: BModule, typ: PType, name: Rope; info: TLineInfo) =
|
|
genTypeInfoAuxBase(m, typ, typ, name, genTypeInfo(m, typ.sons[1], info), info)
|
|
|
|
proc fakeClosureType(m: BModule; owner: PSym): PType =
|
|
# we generate the same RTTI as for a tuple[pointer, ref tuple[]]
|
|
result = newType(tyTuple, owner)
|
|
result.rawAddSon(newType(tyPointer, owner))
|
|
var r = newType(tyRef, owner)
|
|
let obj = createObj(m.g.graph, owner, owner.info, final=false)
|
|
r.rawAddSon(obj)
|
|
result.rawAddSon(r)
|
|
|
|
include ccgtrav
|
|
|
|
proc genDeepCopyProc(m: BModule; s: PSym; result: Rope) =
|
|
genProc(m, s)
|
|
addf(m.s[cfsTypeInit3], "$1.deepcopy =(void* (N_RAW_NIMCALL*)(void*))$2;$n",
|
|
[result, s.loc.r])
|
|
|
|
proc genTypeInfo(m: BModule, t: PType; info: TLineInfo): Rope =
|
|
let origType = t
|
|
var t = skipTypes(origType, irrelevantForBackend + tyUserTypeClasses)
|
|
|
|
let prefixTI = if m.hcrOn: "(" else: "(&"
|
|
|
|
let sig = hashType(origType)
|
|
result = m.typeInfoMarker.getOrDefault(sig)
|
|
if result != nil:
|
|
return prefixTI.rope & result & ")".rope
|
|
|
|
proc declareNimType(m: BModule, str: Rope, ownerModule: PSym) =
|
|
if m.hcrOn:
|
|
addf(m.s[cfsVars], "static TNimType* $1;$n", [str])
|
|
addf(m.s[cfsTypeInit1], "\t$1 = (TNimType*)hcrGetGlobal($2, \"$1\");$n",
|
|
[str, getModuleDllPath(m, ownerModule)])
|
|
else:
|
|
addf(m.s[cfsVars], "extern TNimType $1;$n", [str])
|
|
|
|
let marker = m.g.typeInfoMarker.getOrDefault(sig)
|
|
if marker.str != nil:
|
|
discard cgsym(m, "TNimType")
|
|
discard cgsym(m, "TNimNode")
|
|
declareNimType(m, marker.str, marker.owner)
|
|
# also store in local type section:
|
|
m.typeInfoMarker[sig] = marker.str
|
|
return prefixTI.rope & marker.str & ")".rope
|
|
|
|
result = "NTI$1_" % [rope($sig)]
|
|
m.typeInfoMarker[sig] = result
|
|
|
|
let owner = t.skipTypes(typedescPtrs).owner.getModule
|
|
if owner != m.module:
|
|
# make sure the type info is created in the owner module
|
|
assert m.g.modules[owner.position] != nil
|
|
discard genTypeInfo(m.g.modules[owner.position], origType, info)
|
|
# reference the type info as extern here
|
|
discard cgsym(m, "TNimType")
|
|
discard cgsym(m, "TNimNode")
|
|
declareNimType(m, result, owner)
|
|
return prefixTI.rope & result & ")".rope
|
|
|
|
m.g.typeInfoMarker[sig] = (str: result, owner: owner)
|
|
case t.kind
|
|
of tyEmpty, tyVoid: result = rope"0"
|
|
of tyPointer, tyBool, tyChar, tyCString, tyString, tyInt..tyUInt64, tyVar, tyLent:
|
|
genTypeInfoAuxBase(m, t, t, result, rope"0", info)
|
|
of tyStatic:
|
|
if t.n != nil: result = genTypeInfo(m, lastSon t, info)
|
|
else: internalError(m.config, "genTypeInfo(" & $t.kind & ')')
|
|
of tyUserTypeClasses:
|
|
internalAssert m.config, t.isResolvedUserTypeClass
|
|
return genTypeInfo(m, t.lastSon, info)
|
|
of tyProc:
|
|
if t.callConv != ccClosure:
|
|
genTypeInfoAuxBase(m, t, t, result, rope"0", info)
|
|
else:
|
|
let x = fakeClosureType(m, t.owner)
|
|
genTupleInfo(m, x, x, result, info)
|
|
of tySequence:
|
|
genTypeInfoAux(m, t, t, result, info)
|
|
if m.config.selectedGC != gcDestructors:
|
|
if m.config.selectedGC >= gcMarkAndSweep:
|
|
let markerProc = genTraverseProc(m, origType, sig)
|
|
addf(m.s[cfsTypeInit3], "$1.marker = $2;$n", [TINameForHcr(m, result), markerProc])
|
|
of tyRef:
|
|
genTypeInfoAux(m, t, t, result, info)
|
|
if m.config.selectedGC >= gcMarkAndSweep:
|
|
let markerProc = genTraverseProc(m, origType, sig)
|
|
addf(m.s[cfsTypeInit3], "$1.marker = $2;$n", [TINameForHcr(m, result), markerProc])
|
|
of tyPtr, tyRange, tyUncheckedArray: genTypeInfoAux(m, t, t, result, info)
|
|
of tyArray: genArrayInfo(m, t, result, info)
|
|
of tySet: genSetInfo(m, t, result, info)
|
|
of tyEnum: genEnumInfo(m, t, result, info)
|
|
of tyObject: genObjectInfo(m, t, origType, result, info)
|
|
of tyTuple:
|
|
# if t.n != nil: genObjectInfo(m, t, result)
|
|
# else:
|
|
# BUGFIX: use consistently RTTI without proper field names; otherwise
|
|
# results are not deterministic!
|
|
genTupleInfo(m, t, origType, result, info)
|
|
else: internalError(m.config, "genTypeInfo(" & $t.kind & ')')
|
|
if t.deepCopy != nil:
|
|
genDeepCopyProc(m, t.deepCopy, result)
|
|
elif origType.deepCopy != nil:
|
|
genDeepCopyProc(m, origType.deepCopy, result)
|
|
result = prefixTI.rope & result & ")".rope
|
|
|
|
proc genTypeSection(m: BModule, n: PNode) =
|
|
discard
|