www.digitalmars.com         C & C++   DMDScript  

digitalmars.D.bugs - [Issue 8156] New: Very slow compilation with string-imported file ~100 MiB

reply d-bugmail puremagic.com writes:
http://d.puremagic.com/issues/show_bug.cgi?id=8156

           Summary: Very slow compilation with string-imported file ~100
                    MiB
           Product: D
           Version: D2
          Platform: All
        OS/Version: All
            Status: NEW
          Keywords: performance
          Severity: enhancement
          Priority: P2
         Component: DMD
        AssignedTo: nobody puremagic.com
        ReportedBy: verylonglogin.reg gmail.com


--- Comment #0 from Denis Shelomovskij <verylonglogin.reg gmail.com> 2012-05-28
09:43:05 MSD ---
dmd takes 14 s with full load of one CPU core to include 40 MiB file
as a string import on my PC. During this dmd process slowly increases its
memory using by 2-3 MiB/s.

-- 
Configure issuemail: http://d.puremagic.com/issues/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
May 27 2012
next sibling parent d-bugmail puremagic.com writes:
http://d.puremagic.com/issues/show_bug.cgi?id=8156


dawg dawgfoto.de changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |dawg dawgfoto.de


--- Comment #1 from dawg dawgfoto.de 2012-05-29 06:35:25 PDT ---
I run into longer compilation times at about 300MB but at that
point it's mainly due to paging in consecutive runs.

Are you processing/casting the string?
What OS are you on?
Are you seeing O(N^2) behavior?

-- 
Configure issuemail: http://d.puremagic.com/issues/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
May 29 2012
prev sibling parent d-bugmail puremagic.com writes:
http://d.puremagic.com/issues/show_bug.cgi?id=8156



--- Comment #2 from Denis Shelomovskij <verylonglogin.reg gmail.com> 2012-05-29
19:26:35 MSD ---
(In reply to comment #1)

 I run into longer compilation times at about 300MB but at that
 point it's mainly due to paging in consecutive runs.
 
 Are you processing/casting the string?


No CT processing, casting doesn't matter.


 What OS are you on?


Windows XP SP3


 Are you seeing O(N^2) behavior?


Yes. My timings in CSV format:
---
Size, MiB;Time, s
1;0
13.4;2
28.3;7
40.5;17
96.7;111
215;582
---

y = a * x^b approximation:
time(size) = 6.79E-00003 x^2.117 with R^2 = 0.9999

-- 
Configure issuemail: http://d.puremagic.com/issues/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
May 29 2012