Memory requirements
log in

Advanced search

Message boards : Number crunching : Memory requirements

1 · 2 · Next
Author Message
vaughan
Send message
Joined: 11 Mar 15
Posts: 16
Credit: 2,541,195
RAC: 0
Message 118 - Posted: 29 Mar 2015, 9:39:22 UTC

So how much memory does this project require? I keep getting messages about low memory on my Windows 7 systems?

zombie67 [MM]
Avatar
Send message
Joined: 9 Mar 15
Posts: 15
Credit: 1,283,842
RAC: 0
Message 119 - Posted: 29 Mar 2015, 13:47:37 UTC

BOINCtasks is showing 1100-1200 mb per task. And maybe it is my imagination, but I think the usage has been growing. It's larger than it was a week ago.
____________
Dublin, California
Team: SETI.USA

Profile Daniel
Project administrator
Send message
Joined: 5 Mar 15
Posts: 73
Credit: 162,134
RAC: 0
Message 120 - Posted: 30 Mar 2015, 11:12:26 UTC - in response to Message 119.

It has been growing, the sequence size has been growing, and it needs more memory to check these longer sequences. If it starts getting out of hand, I can switch to using a different program, one that doesn't involve so much memory.

Profile DoctorNow
Avatar
Send message
Joined: 9 Mar 15
Posts: 4
Credit: 17,425
RAC: 0
Message 122 - Posted: 31 Mar 2015, 15:42:29 UTC

1,3 GB per wu...
That's surely something and a bit too much for both of my systems, can't let all cores run on this project anymore. :-(
____________
Life is Science, and Science rules. To the universe and beyond
Member of BOINC Confederation
My BOINC-Stats

vaughan
Send message
Joined: 11 Mar 15
Posts: 16
Credit: 2,541,195
RAC: 0
Message 123 - Posted: 1 Apr 2015, 4:54:27 UTC

I'm reaching the point where my 4GB systems cannot compete.

Daniel can you do something to lower the RAM requirements like limiting the number of concurrently running tasks on a system?

Profile Daniel
Project administrator
Send message
Joined: 5 Mar 15
Posts: 73
Credit: 162,134
RAC: 0
Message 129 - Posted: 2 Apr 2015, 3:50:01 UTC - in response to Message 123.

We released a version before that cut the memory requirement in half (using a long array rather than long long), but it generated errors on many computers. We will work on it but our current (long long) version still generates errors.

lionelc
Send message
Joined: 10 Mar 15
Posts: 4
Credit: 105,870
RAC: 0
Message 134 - Posted: 2 Apr 2015, 18:41:40 UTC - in response to Message 123.

hi vaughan


To limit the number of concurrently running task at 2 for instance, you can create a "app_config.xml" file to be placed under the project folder.

The "app_config.xml" file will contain :

<app_config>
<app>
<name>example_app</name>
<max_concurrent>2</max_concurrent>
</app>
</app_config>


Don't forget to relaunch reading of the configuration file in order for Boinc to find this app_config.xml file.

This solution allows users to limit the number of tasks according the available memory of their computers.

vaughan
Send message
Joined: 11 Mar 15
Posts: 16
Credit: 2,541,195
RAC: 0
Message 135 - Posted: 3 Apr 2015, 2:53:20 UTC - in response to Message 134.

Thanks lionelc, I will try that.

vaughan
Send message
Joined: 11 Mar 15
Posts: 16
Credit: 2,541,195
RAC: 0
Message 141 - Posted: 7 Apr 2015, 1:23:43 UTC
Last modified: 7 Apr 2015, 1:24:35 UTC

It would be nice to propose this project in the scheduled BOINC Pentathlon but I note one of the conditions for inclusion is that the project NOT have a buggy application.

Daniel you need to fix the memory requirements ASAP and also the issues relating to Windows versus Linux.

http://www.seti-germany.de/boinc_pentathlon/27_en_FAQ.html

Nikodemus
Send message
Joined: 27 Mar 15
Posts: 2
Credit: 289,669
RAC: 0
Message 143 - Posted: 12 Apr 2015, 20:32:11 UTC

It's continuing to grow and getting a little out of hand, mine are up to 1.6-1.7gb a task now

Fardringle
Send message
Joined: 22 Mar 15
Posts: 1
Credit: 4,950
RAC: 0
Message 145 - Posted: 14 Apr 2015, 14:08:44 UTC

I have 12GB RAM in my main system and BOINC is still only able to run three 123numbers work units simultaneously because there isn't enough memory to open any more than that...

Bruce Kennedy
Send message
Joined: 14 Apr 15
Posts: 3
Credit: 113,261
RAC: 0
Message 150 - Posted: 21 Apr 2015, 23:29:02 UTC - in response to Message 134.

I can't figure out what goes in the name line of the app_config.xml file. Any help would be great! Thanks.

lionelc
Send message
Joined: 10 Mar 15
Posts: 4
Credit: 105,870
RAC: 0
Message 151 - Posted: 22 Apr 2015, 4:17:37 UTC - in response to Message 150.

I can't figure out what goes in the name line of the app_config.xml file. Any help would be great! Thanks.



<name>example_app</name>

Bruce Kennedy
Send message
Joined: 14 Apr 15
Posts: 3
Credit: 113,261
RAC: 0
Message 152 - Posted: 22 Apr 2015, 8:46:55 UTC - in response to Message 151.
Last modified: 22 Apr 2015, 9:02:07 UTC

example_app seems to be the correct answer. I thought it was just an example!
Thanks!

Profile Daniel
Project administrator
Send message
Joined: 5 Mar 15
Posts: 73
Credit: 162,134
RAC: 0
Message 218 - Posted: 7 Sep 2015, 14:42:30 UTC

Version 31 uses half as much memory as the old program. Now each copy takes up 1 gigabyte. To check a prime near 250 million, the program has to create an array with 250 million entries. Therefore, the larger the prime, the more RAM it takes.
____________
Daniel Monroe
vdwnumbers.org Project Administrator

vaughan
Send message
Joined: 11 Mar 15
Posts: 16
Credit: 2,541,195
RAC: 0
Message 302 - Posted: 17 Mar 2016, 3:18:02 UTC

Daniel - as the project has been running a bit longer now have the memory requirements increased further? I noticed the waiting for memory message appears on a PC running 4 tasks, this PC has 8GB RAM.

vaughan
Send message
Joined: 11 Mar 15
Posts: 16
Credit: 2,541,195
RAC: 0
Message 303 - Posted: 20 Mar 2016, 23:48:27 UTC - in response to Message 302.

Daniel - as the project has been running a bit longer now have the memory requirements increased further? I noticed the waiting for memory message appears on a PC running 4 tasks, this PC has 8GB RAM.

Daniel I'm not sure if you have overlooked my question but are the memory requirements increasing as the tasks get larger?
____________

Profile Coleslaw
Avatar
Send message
Joined: 10 Mar 15
Posts: 9
Credit: 1,005,950
RAC: 0
Message 304 - Posted: 21 Mar 2016, 2:04:28 UTC - in response to Message 303.

Mine are using 1.195GB each. At least the 3 I'm looking at now that have reached ~50% completion. If I get a chance to view one in an earlier and a later state, I will post back.
____________

Captiosus
Send message
Joined: 18 May 16
Posts: 1
Credit: 82
RAC: 0
Message 312 - Posted: 18 May 2016, 19:55:35 UTC

Well, guess that explains the surprise 4GB of memory sucked up and a dozen nearly simultaneously failed workunits.

Also, hai Coleslaw.

Profile Coleslaw
Avatar
Send message
Joined: 10 Mar 15
Posts: 9
Credit: 1,005,950
RAC: 0
Message 313 - Posted: 20 May 2016, 3:08:11 UTC - in response to Message 312.

And hello to you. At this point in time each work unit is using roughly 1.33GB per work unit for me.
____________

1 · 2 · Next
Post to thread

Message boards : Number crunching : Memory requirements


Main page · Your account · Message boards


Code and content created by Daniel Monroe © 2018.