www.digitalmars.com         C & C++   DMDScript  

digitalmars.D - My codebase have reached the critical size

reply "deadalnix" <deadalnix gmail.com> writes:
And that critical size isn't very large.

I cannot compile anymore :
Unable to fork: Cannot allocate memory

I cannot use separate compilation to mitigate the problem as some 
symbol are not emitted properly (so I get linker errors).

Hopefully, dmd is fast because it doesn't use any GC.
Feb 16 2013
next sibling parent reply Walter Bright <newshound2 digitalmars.com> writes:
On 2/16/2013 1:37 AM, deadalnix wrote:
 I cannot use separate compilation to mitigate the problem as some symbol are
not
 emitted properly (so I get linker errors).

Are there bugzilla entries for these?
Feb 16 2013
next sibling parent "deadalnix" <deadalnix gmail.com> writes:
On Saturday, 16 February 2013 at 09:54:10 UTC, Walter Bright 
wrote:
 On 2/16/2013 1:37 AM, deadalnix wrote:
 I cannot use separate compilation to mitigate the problem as 
 some symbol are not
 emitted properly (so I get linker errors).

Are there bugzilla entries for these?

They are for released version of dmd. For the new beta, things have changed, but it didn't reduced them to a simple test case yet.
Feb 16 2013
prev sibling parent reply "deadalnix" <deadalnix gmail.com> writes:
On Saturday, 16 February 2013 at 09:54:10 UTC, Walter Bright 
wrote:
 On 2/16/2013 1:37 AM, deadalnix wrote:
 I cannot use separate compilation to mitigate the problem as 
 some symbol are not
 emitted properly (so I get linker errors).

Are there bugzilla entries for these?

So reduced thing with dmd from git, and this still boils down to that : http://d.puremagic.com/issues/show_bug.cgi?id=8997
Feb 16 2013
next sibling parent reply kenji hara <k.hara.pg gmail.com> writes:
2013/2/17 deadalnix <deadalnix gmail.com>

 On Saturday, 16 February 2013 at 09:54:10 UTC, Walter Bright wrote:

 On 2/16/2013 1:37 AM, deadalnix wrote:

 I cannot use separate compilation to mitigate the problem as some symbol
 are not
 emitted properly (so I get linker errors).

Are there bugzilla entries for these?

So reduced thing with dmd from git, and this still boils down to that : http://d.puremagic.com/issues/**show_bug.cgi?id=8997<http://d.puremagic.com/issues/show_bug.cgi?id=8997>

Just now, I posted another fix for bug 8997. https://github.com/D-Programming-Language/dmd/pull/1667 Kenji Hara
Feb 16 2013
next sibling parent "deadalnix" <deadalnix gmail.com> writes:
On Sunday, 17 February 2013 at 05:25:28 UTC, kenji hara wrote:
 Just now, I posted another fix for bug 8997.
 https://github.com/D-Programming-Language/dmd/pull/1667

I have to go now, but will test it this evening. Thank a lot for your hard work !
Feb 16 2013
prev sibling parent reply "deadalnix" <deadalnix gmail.com> writes:
On Sunday, 17 February 2013 at 05:25:28 UTC, kenji hara wrote:
 2013/2/17 deadalnix <deadalnix gmail.com>

 On Saturday, 16 February 2013 at 09:54:10 UTC, Walter Bright 
 wrote:

 On 2/16/2013 1:37 AM, deadalnix wrote:

 I cannot use separate compilation to mitigate the problem as 
 some symbol
 are not
 emitted properly (so I get linker errors).

Are there bugzilla entries for these?

So reduced thing with dmd from git, and this still boils down to that : http://d.puremagic.com/issues/**show_bug.cgi?id=8997<http://d.puremagic.com/issues/show_bug.cgi?id=8997>

Just now, I posted another fix for bug 8997. https://github.com/D-Programming-Language/dmd/pull/1667

OK, tested and it does work ! otsukare sama ! But . . . This issue was hidding another one. I still have linking issue. I'm dustmiting it right now, but this will take a while !
Feb 17 2013
parent "deadalnix" <deadalnix gmail.com> writes:
On Sunday, 17 February 2013 at 12:20:15 UTC, deadalnix wrote:
 On Sunday, 17 February 2013 at 05:25:28 UTC, kenji hara wrote:
 2013/2/17 deadalnix <deadalnix gmail.com>

 On Saturday, 16 February 2013 at 09:54:10 UTC, Walter Bright 
 wrote:

 On 2/16/2013 1:37 AM, deadalnix wrote:

 I cannot use separate compilation to mitigate the problem 
 as some symbol
 are not
 emitted properly (so I get linker errors).

Are there bugzilla entries for these?

So reduced thing with dmd from git, and this still boils down to that : http://d.puremagic.com/issues/**show_bug.cgi?id=8997<http://d.puremagic.com/issues/show_bug.cgi?id=8997>

Just now, I posted another fix for bug 8997. https://github.com/D-Programming-Language/dmd/pull/1667

OK, tested and it does work ! otsukare sama ! But . . . This issue was hidding another one. I still have linking issue. I'm dustmiting it right now, but this will take a while !

http://d.puremagic.com/issues/show_bug.cgi?id=9571
Feb 22 2013
prev sibling parent Alexander Tankeev <atankeev gmail.com> writes:
On 17.02.2013 8:27, deadalnix wrote:
 On Saturday, 16 February 2013 at 09:54:10 UTC, Walter Bright wrote:
 On 2/16/2013 1:37 AM, deadalnix wrote:
 I cannot use separate compilation to mitigate the problem as some
 symbol are not
 emitted properly (so I get linker errors).

Are there bugzilla entries for these?

So reduced thing with dmd from git, and this still boils down to that : http://d.puremagic.com/issues/show_bug.cgi?id=8997

I think http://d.puremagic.com/issues/show_bug.cgi?id=9485 is about this bug too.
Feb 17 2013
prev sibling next sibling parent reply "Maxim Fomin" <maxim maxim-fomin.ru> writes:
On Saturday, 16 February 2013 at 09:37:12 UTC, deadalnix wrote:
 And that critical size isn't very large.

 I cannot compile anymore :
 Unable to fork: Cannot allocate memory

 I cannot use separate compilation to mitigate the problem as 
 some symbol are not emitted properly (so I get linker errors).

 Hopefully, dmd is fast because it doesn't use any GC.

Wasn't this a problem long before? My D environment on linux fails to unittest Phobos code with exactly same error message and I remember this was discussed in newsgroups.
Feb 16 2013
parent "H. S. Teoh" <hsteoh quickfur.ath.cx> writes:
On Sat, Feb 16, 2013 at 12:12:38PM +0100, Maxim Fomin wrote:
 On Saturday, 16 February 2013 at 09:37:12 UTC, deadalnix wrote:
And that critical size isn't very large.

I cannot compile anymore :
Unable to fork: Cannot allocate memory

I cannot use separate compilation to mitigate the problem as some
symbol are not emitted properly (so I get linker errors).

Hopefully, dmd is fast because it doesn't use any GC.

Wasn't this a problem long before? My D environment on linux fails to unittest Phobos code with exactly same error message and I remember this was discussed in newsgroups.

This is still the situation, depending on how much memory your machine has. I used to run the Phobos unittests with make -j6 to speed things up, but recently I can't do it anymore without getting the above error message, because std.algorithm will consume all the memory, leaving no room for the others. I remember having DMD do that on me as well, when one time I used std.regex.ctRegex a bit too eagerly. I think (part of?) the problem is that CTFE allocates memory but never frees it, so too much CTFE will cause DMD to run out of memory. T -- Spaghetti code may be tangly, but lasagna code is just cheesy.
Feb 16 2013
prev sibling parent Arlen <arlen.ng gmx.com> writes:
I have the same issue with my Boost.units port:
https://github.com/Arlen/phobos/blob/std_units/std/units.d

DMD runs out of memory and that's why I've had to comment out most of the
definitions.  I haven't tried separate compilation, yet.

Arlen

On Sat, Feb 16, 2013 at 3:37 AM, deadalnix <deadalnix gmail.com> wrote:

 And that critical size isn't very large.

 I cannot compile anymore :
 Unable to fork: Cannot allocate memory

 I cannot use separate compilation to mitigate the problem as some symbol
 are not emitted properly (so I get linker errors).

 Hopefully, dmd is fast because it doesn't use any GC.

Feb 22 2013