www.digitalmars.com         C & C++   DMDScript  

digitalmars.D - My codebase have reached the critical size

reply "deadalnix" <deadalnix gmail.com> writes:
And that critical size isn't very large.

I cannot compile anymore :
Unable to fork: Cannot allocate memory

I cannot use separate compilation to mitigate the problem as some 
symbol are not emitted properly (so I get linker errors).

Hopefully, dmd is fast because it doesn't use any GC.
Feb 16 2013
next sibling parent reply Walter Bright <newshound2 digitalmars.com> writes:
On 2/16/2013 1:37 AM, deadalnix wrote:
 I cannot use separate compilation to mitigate the problem as some symbol are
not
 emitted properly (so I get linker errors).

Are there bugzilla entries for these?
Feb 16 2013
parent Alexander Tankeev <atankeev gmail.com> writes:
On 17.02.2013 8:27, deadalnix wrote:
 On Saturday, 16 February 2013 at 09:54:10 UTC, Walter Bright wrote:
 On 2/16/2013 1:37 AM, deadalnix wrote:
 I cannot use separate compilation to mitigate the problem as some
 symbol are not
 emitted properly (so I get linker errors).

Are there bugzilla entries for these?

So reduced thing with dmd from git, and this still boils down to that : http://d.puremagic.com/issues/show_bug.cgi?id=8997

bug too.
Feb 17 2013
prev sibling next sibling parent "deadalnix" <deadalnix gmail.com> writes:
On Saturday, 16 February 2013 at 09:54:10 UTC, Walter Bright 
wrote:
 On 2/16/2013 1:37 AM, deadalnix wrote:
 I cannot use separate compilation to mitigate the problem as 
 some symbol are not
 emitted properly (so I get linker errors).

Are there bugzilla entries for these?

They are for released version of dmd. For the new beta, things have changed, but it didn't reduced them to a simple test case yet.
Feb 16 2013
prev sibling next sibling parent "Maxim Fomin" <maxim maxim-fomin.ru> writes:
On Saturday, 16 February 2013 at 09:37:12 UTC, deadalnix wrote:
 And that critical size isn't very large.

 I cannot compile anymore :
 Unable to fork: Cannot allocate memory

 I cannot use separate compilation to mitigate the problem as 
 some symbol are not emitted properly (so I get linker errors).

 Hopefully, dmd is fast because it doesn't use any GC.

Wasn't this a problem long before? My D environment on linux fails to unittest Phobos code with exactly same error message and I remember this was discussed in newsgroups.
Feb 16 2013
prev sibling next sibling parent "H. S. Teoh" <hsteoh quickfur.ath.cx> writes:
On Sat, Feb 16, 2013 at 12:12:38PM +0100, Maxim Fomin wrote:
 On Saturday, 16 February 2013 at 09:37:12 UTC, deadalnix wrote:
And that critical size isn't very large.

I cannot compile anymore :
Unable to fork: Cannot allocate memory

I cannot use separate compilation to mitigate the problem as some
symbol are not emitted properly (so I get linker errors).

Hopefully, dmd is fast because it doesn't use any GC.

Wasn't this a problem long before? My D environment on linux fails to unittest Phobos code with exactly same error message and I remember this was discussed in newsgroups.

This is still the situation, depending on how much memory your machine has. I used to run the Phobos unittests with make -j6 to speed things up, but recently I can't do it anymore without getting the above error message, because std.algorithm will consume all the memory, leaving no room for the others. I remember having DMD do that on me as well, when one time I used std.regex.ctRegex a bit too eagerly. I think (part of?) the problem is that CTFE allocates memory but never frees it, so too much CTFE will cause DMD to run out of memory. T -- Spaghetti code may be tangly, but lasagna code is just cheesy.
Feb 16 2013
prev sibling next sibling parent "deadalnix" <deadalnix gmail.com> writes:
On Saturday, 16 February 2013 at 09:54:10 UTC, Walter Bright 
wrote:
 On 2/16/2013 1:37 AM, deadalnix wrote:
 I cannot use separate compilation to mitigate the problem as 
 some symbol are not
 emitted properly (so I get linker errors).

Are there bugzilla entries for these?

So reduced thing with dmd from git, and this still boils down to that : http://d.puremagic.com/issues/show_bug.cgi?id=8997
Feb 16 2013
prev sibling next sibling parent kenji hara <k.hara.pg gmail.com> writes:
--f46d043893bd4a75a904d5e4d5fb
Content-Type: text/plain; charset=UTF-8

2013/2/17 deadalnix <deadalnix gmail.com>

 On Saturday, 16 February 2013 at 09:54:10 UTC, Walter Bright wrote:

 On 2/16/2013 1:37 AM, deadalnix wrote:

 I cannot use separate compilation to mitigate the problem as some symbol
 are not
 emitted properly (so I get linker errors).

Are there bugzilla entries for these?

So reduced thing with dmd from git, and this still boils down to that : http://d.puremagic.com/issues/**show_bug.cgi?id=8997<http://d.puremagic.com/issues/show_bug.cgi?id=8997>

Just now, I posted another fix for bug 8997. https://github.com/D-Programming-Language/dmd/pull/1667 Kenji Hara --f46d043893bd4a75a904d5e4d5fb Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable <div dir=3D"ltr"><div class=3D"gmail_extra">2013/2/17 deadalnix <span dir= =3D"ltr">&lt;<a href=3D"mailto:deadalnix gmail.com" target=3D"_blank">deada= lnix gmail.com</a>&gt;</span><br><div class=3D"gmail_quote"><blockquote cla= ss=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;border-left-width:1px;= border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex= "> <div class=3D"im">On Saturday, 16 February 2013 at 09:54:10 UTC, Walter Bri= ght wrote:<br> </div><div><div class=3D"h5"><blockquote class=3D"gmail_quote" style=3D"mar= gin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,2= 04);border-left-style:solid;padding-left:1ex"> On 2/16/2013 1:37 AM, deadalnix wrote:<br> <blockquote class=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;border-= left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;p= adding-left:1ex"> I cannot use separate compilation to mitigate the problem as some symbol ar= e not<br> emitted properly (so I get linker errors).<br> </blockquote> <br> Are there bugzilla entries for these?<br> </blockquote> <br></div></div> So reduced thing with dmd from git, and this still boils down to that : <a = href=3D"http://d.puremagic.com/issues/show_bug.cgi?id=3D8997" target=3D"_bl= ank">http://d.puremagic.com/issues/<u></u>show_bug.cgi?id=3D8997</a><br> </blockquote></div><br></div><div class=3D"gmail_extra">Just now, I posted = another fix for bug 8997.<div><a href=3D"https://github.com/D-Programming-L= anguage/dmd/pull/1667">https://github.com/D-Programming-Language/dmd/pull/1= 667</a><br> </div><div><br></div><div style>Kenji Hara</div></div></div> --f46d043893bd4a75a904d5e4d5fb--
Feb 16 2013
prev sibling next sibling parent "deadalnix" <deadalnix gmail.com> writes:
On Sunday, 17 February 2013 at 05:25:28 UTC, kenji hara wrote:
 Just now, I posted another fix for bug 8997.
 https://github.com/D-Programming-Language/dmd/pull/1667

I have to go now, but will test it this evening. Thank a lot for your hard work !
Feb 16 2013
prev sibling next sibling parent "deadalnix" <deadalnix gmail.com> writes:
On Sunday, 17 February 2013 at 05:25:28 UTC, kenji hara wrote:
 2013/2/17 deadalnix <deadalnix gmail.com>

 On Saturday, 16 February 2013 at 09:54:10 UTC, Walter Bright 
 wrote:

 On 2/16/2013 1:37 AM, deadalnix wrote:

 I cannot use separate compilation to mitigate the problem as 
 some symbol
 are not
 emitted properly (so I get linker errors).

Are there bugzilla entries for these?

So reduced thing with dmd from git, and this still boils down to that : http://d.puremagic.com/issues/**show_bug.cgi?id=8997<http://d.puremagic.com/issues/show_bug.cgi?id=8997>

Just now, I posted another fix for bug 8997. https://github.com/D-Programming-Language/dmd/pull/1667

OK, tested and it does work ! otsukare sama ! But . . . This issue was hidding another one. I still have linking issue. I'm dustmiting it right now, but this will take a while !
Feb 17 2013
prev sibling next sibling parent "deadalnix" <deadalnix gmail.com> writes:
On Sunday, 17 February 2013 at 12:20:15 UTC, deadalnix wrote:
 On Sunday, 17 February 2013 at 05:25:28 UTC, kenji hara wrote:
 2013/2/17 deadalnix <deadalnix gmail.com>

 On Saturday, 16 February 2013 at 09:54:10 UTC, Walter Bright 
 wrote:

 On 2/16/2013 1:37 AM, deadalnix wrote:

 I cannot use separate compilation to mitigate the problem 
 as some symbol
 are not
 emitted properly (so I get linker errors).

Are there bugzilla entries for these?

So reduced thing with dmd from git, and this still boils down to that : http://d.puremagic.com/issues/**show_bug.cgi?id=8997<http://d.puremagic.com/issues/show_bug.cgi?id=8997>

Just now, I posted another fix for bug 8997. https://github.com/D-Programming-Language/dmd/pull/1667

OK, tested and it does work ! otsukare sama ! But . . . This issue was hidding another one. I still have linking issue. I'm dustmiting it right now, but this will take a while !

http://d.puremagic.com/issues/show_bug.cgi?id=9571
Feb 22 2013
prev sibling parent Arlen <arlen.ng gmx.com> writes:
--20cf300fb027d63ef504d65efa83
Content-Type: text/plain; charset=ISO-8859-1

I have the same issue with my Boost.units port:
https://github.com/Arlen/phobos/blob/std_units/std/units.d

DMD runs out of memory and that's why I've had to comment out most of the
definitions.  I haven't tried separate compilation, yet.

Arlen

On Sat, Feb 16, 2013 at 3:37 AM, deadalnix <deadalnix gmail.com> wrote:

 And that critical size isn't very large.

 I cannot compile anymore :
 Unable to fork: Cannot allocate memory

 I cannot use separate compilation to mitigate the problem as some symbol
 are not emitted properly (so I get linker errors).

 Hopefully, dmd is fast because it doesn't use any GC.

--20cf300fb027d63ef504d65efa83 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable I have the same issue with my Boost.units port:=A0 <a href=3D"https://githu= b.com/Arlen/phobos/blob/std_units/std/units.d">https://github.com/Arlen/pho= bos/blob/std_units/std/units.d</a><br><br>DMD runs out of memory and that&#= 39;s why I&#39;ve had to comment out most of the definitions.=A0 I haven&#3= 9;t tried separate compilation, yet.<br> <br>Arlen<br><br><div class=3D"gmail_quote">On Sat, Feb 16, 2013 at 3:37 AM= , deadalnix <span dir=3D"ltr">&lt;<a href=3D"mailto:deadalnix gmail.com" ta= rget=3D"_blank">deadalnix gmail.com</a>&gt;</span> wrote:<br><blockquote cl= ass=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;p= adding-left:1ex"> And that critical size isn&#39;t very large.<br> <br> I cannot compile anymore :<br> Unable to fork: Cannot allocate memory<br> <br> I cannot use separate compilation to mitigate the problem as some symbol ar= e not emitted properly (so I get linker errors).<br> <br> Hopefully, dmd is fast because it doesn&#39;t use any GC.<br> </blockquote></div><br> --20cf300fb027d63ef504d65efa83--
Feb 22 2013