how long can "long tasks" be?

Message boards : Number crunching : how long can "long tasks" be?
Message board moderation

To post messages, you must log in.

Previous · 1 · 2

AuthorMessage
arcturus

Send message
Joined: 27 Nov 22
Posts: 20
Credit: 3,704,635
RAC: 8,500
Message 1906 - Posted: 20 Jan 2023, 19:13:00 UTC

Has no determination why certain units are hanging been made yet? Or is this going to morph into a 'please give me extra time' thread?
ID: 1906 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
BellyNitpicker

Send message
Joined: 7 Mar 21
Posts: 3
Credit: 299,972
RAC: 1
Message 1912 - Posted: 21 Jan 2023, 14:51:19 UTC

I've suspended SiDock for the time being. I run BOINC in Ubuntu virtual machines on Mac hardware and VirtualBox. The last few long SiDock tasks (running in different machines) showed more time remaining after three day's execution than they had before they started. The CPU was trivial, but watching them run, I could see the remaining time increase more rapidly than the elapsed. I don't know at which point they failed, but I'm not really interested. I don't have time to babysit. If tasks are unreliable, the project gets shut down, and the capacity handed to another project.

Nick
ID: 1912 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
marmot

Send message
Joined: 10 Dec 20
Posts: 24
Credit: 10,767,590
RAC: 10,470
Message 1915 - Posted: 21 Jan 2023, 17:34:28 UTC - in response to Message 1905.  
Last modified: 21 Jan 2023, 18:26:42 UTC

But if you see tasks with estimation like "days" you can check it properties in BOINC Manager: "CPU time at last checkpoint" and "CPU time". If it values very differs (for 1 hour, for example) - task is hung and need a restart.


My one task is 4 days and 5 hours run time, at 99.4% complete, and stalled.
If I follow your direction then it will get credit for the last 30 minutes, according to Mad_Max.

Actually, all of the newer WU's (Feb 3rd deadline) that are progressing have:
CPU time at last checkpoint: of under 30 minutes.
The WU above, at 99.4% complete shows 1d 5 hours since last checkpoint.

So it seems that if the checkpoints are over 60 minutes ago then the task is hung.
Or is that because these new WU are checkpointing and the old ones weren't and so the run time should equal the checkpoint time?

.
ID: 1915 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
gemini8

Send message
Joined: 23 Oct 20
Posts: 12
Credit: 2,666,147
RAC: 975
Message 1916 - Posted: 21 Jan 2023, 17:43:39 UTC

I'm running another project that has tasks that are quite allergic to restarts, and I'm running SiDock on a Ubuntu 22 machine on which the Boinc Manager keeps crashing a second after being started, so I can't use it and instead rely on boinccmd which makes aborting tasks a PITA.
Because of that I told my machine to stop asking for more SiDock long tasks. If I don't get anything else in the meantime I will have to wait until the SiDock long tasks are working properly.
Thanks for reading.
- - - - - - - - - -
Greetings, Jens
ID: 1916 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
arcturus

Send message
Joined: 27 Nov 22
Posts: 20
Credit: 3,704,635
RAC: 8,500
Message 1917 - Posted: 21 Jan 2023, 18:01:37 UTC - in response to Message 1916.  
Last modified: 21 Jan 2023, 18:46:58 UTC

I'm running another project that has tasks that are quite allergic to restarts, and I'm running SiDock on a Ubuntu 22 machine on which the Boinc Manager keeps crashing a second after being started, so I can't use it and instead rely on boinccmd which makes aborting tasks a PITA.
Because of that I told my machine to stop asking for more SiDock long tasks. If I don't get anything else in the meantime I will have to wait until the SiDock long tasks are working properly.
Thanks for reading.


Try this: https://gene.disi.unitn.it/test/
ID: 1917 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
hoarfrost
Volunteer moderator
Project administrator
Project developer

Send message
Joined: 11 Oct 20
Posts: 323
Credit: 23,121,299
RAC: 11,426
Message 1918 - Posted: 21 Jan 2023, 18:20:10 UTC - in response to Message 1915.  
Last modified: 21 Jan 2023, 18:27:45 UTC

Actually, all of the WU's that are progressing have:
CPU time at last checkpoint: of under 30 minutes.
The WU above, at 99.4% complete shows 1d 5 hours since last checkpoint.

Post name of this task and restart BOINC. If this result does not get appropriate credit, I simply add it. :)
ID: 1918 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
marmot

Send message
Joined: 10 Dec 20
Posts: 24
Credit: 10,767,590
RAC: 10,470
Message 1919 - Posted: 21 Jan 2023, 18:29:13 UTC - in response to Message 1918.  
Last modified: 21 Jan 2023, 18:42:14 UTC


Post name of this task and restart BOINC. If this results does not get appropriate credit, I simply add it. :)


I reset BOINC.exe controlling that last, above, WU and it completed in minutes and here is the result:
77561932	44887	15 Jan 2023, 18:36:22 UTC	21 Jan 2023, 1:48:59 UTC	Completed and validated	309,214.12	298,826.10	1,129.15	CurieMarieDock 0.2.0 long tasks v2.00
windows_x86_64


At least it's not 10 credit; not what you'd expect for 309k sec but over 1k.

Thanks for the above strategy to investigate run time and checkpoint in properties
I'm going to restart all the remaining BONC clients with 2d+ CPU time WUs and see what happens.
ID: 1919 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
hoarfrost
Volunteer moderator
Project administrator
Project developer

Send message
Joined: 11 Oct 20
Posts: 323
Credit: 23,121,299
RAC: 11,426
Message 1923 - Posted: 21 Jan 2023, 22:49:09 UTC - in response to Message 1919.  
Last modified: 21 Jan 2023, 22:49:36 UTC

At least it's not 10 credit; not what you'd expect for 309k sec but over 1k.

Ryzen 3900X @ 4.0 GHz got 1004.96 CS for 85211.20 seconds of computations or 1004.95 CS / 23.67 hours / 4.0 GHz = 10.61 CS/(hour*GHz).
i5-8250U @ 1.60GHz got 1129.15 CS for 298826.10 seconds of computations or 1129.15 CS / 83.01 hours / 1.60 GHz = 8.50 CS/(hour*GHz).

But SMT of Ryzens much more efficient than Hyper-Threading of Intel.
ID: 1923 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
mikey
Avatar

Send message
Joined: 24 Oct 20
Posts: 19
Credit: 9,886,715
RAC: 4,237
Message 1925 - Posted: 22 Jan 2023, 1:58:16 UTC - in response to Message 1889.  

Is multithreaded planned here?


Multithreaded tasks would be wonderful for the long WUs. I only ever crunch one project at a time so between multithreading and keeping a smaller cache, deadline issues would quickly become a thing of the past.


Are we getting lazy in our old days there ol buddy? LOL!!!

To me crunching is crunching and my pc's crunch 24/7 whether it's 1 cpu core per task or multiple cpu cores per task, the only problem for me is the deadlines with my older 2.?ghz machines.

mikey
ID: 1925 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
mikey
Avatar

Send message
Joined: 24 Oct 20
Posts: 19
Credit: 9,886,715
RAC: 4,237
Message 1926 - Posted: 22 Jan 2023, 2:02:19 UTC - in response to Message 1923.  

At least it's not 10 credit; not what you'd expect for 309k sec but over 1k.

Ryzen 3900X @ 4.0 GHz got 1004.96 CS for 85211.20 seconds of computations or 1004.95 CS / 23.67 hours / 4.0 GHz = 10.61 CS/(hour*GHz).
i5-8250U @ 1.60GHz got 1129.15 CS for 298826.10 seconds of computations or 1129.15 CS / 83.01 hours / 1.60 GHz = 8.50 CS/(hour*GHz).

But SMT of Ryzens much more efficient than Hyper-Threading of Intel.


Probably true but not very cost efficient to replace half a dozen or more pc's just to run tasks here. I realize that there are 'issues' with just saying 'add multi-threaded tasks' but if you find the time it really would help those of us with the Intel cpu's that could use it.
ID: 1926 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Alyosha

Send message
Joined: 3 Mar 22
Posts: 1
Credit: 8,198,212
RAC: 2,113
Message 1928 - Posted: 23 Jan 2023, 4:55:38 UTC

If you can, please add some time, maybe 5 days to my wu's User ID 7207

Thanks
They are still running!
ID: 1928 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
hoarfrost
Volunteer moderator
Project administrator
Project developer

Send message
Joined: 11 Oct 20
Posts: 323
Credit: 23,121,299
RAC: 11,426
Message 1934 - Posted: 23 Jan 2023, 21:58:47 UTC - in response to Message 1928.  

If you can, please add some time, maybe 5 days to my wu's User ID 7207

Thanks
They are still running!

Hi! :) Added! You can check tasks on hanging. Also you can stop and start BOINC again, simply.
ID: 1934 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
hoarfrost
Volunteer moderator
Project administrator
Project developer

Send message
Joined: 11 Oct 20
Posts: 323
Credit: 23,121,299
RAC: 11,426
Message 1936 - Posted: 23 Jan 2023, 23:29:36 UTC - in response to Message 1925.  
Last modified: 27 Jan 2023, 7:22:36 UTC

Are we getting lazy in our old days there ol buddy? LOL!!!
To me crunching is crunching and my pc's crunch 24/7 whether it's 1 cpu core per task or multiple cpu cores per task, the only problem for me is the deadlines with my older 2.?ghz machines.

You're right, Mikey! Hope, than some of us remember what is really long tasks - CPDN at ~ 2006. More than one year of most advanced Pentium 4 @ 3.06 GHz HT per pair of tasks!

P.S. New tasks was supplied with two weeks deadline. Nature is amazing that expectations, as usual. :D
ID: 1936 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Short Final

Send message
Joined: 9 Sep 21
Posts: 2
Credit: 1,576,561
RAC: 0
Message 1949 - Posted: 25 Jan 2023, 22:43:25 UTC

Please add 3 days for all tasks for user id: 4871

I have a mix of fast and slow PCs and laptops am having difficulty in finishing some on time.

thank you
ID: 1949 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
hoarfrost
Volunteer moderator
Project administrator
Project developer

Send message
Joined: 11 Oct 20
Posts: 323
Credit: 23,121,299
RAC: 11,426
Message 1952 - Posted: 26 Jan 2023, 17:37:09 UTC - in response to Message 1949.  

Please add 3 days for all tasks for user id: 4871

2 tasks found, added. :)
ID: 1952 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
doug

Send message
Joined: 9 May 22
Posts: 2
Credit: 1,178,316
RAC: 1,296
Message 1958 - Posted: 29 Jan 2023, 4:14:18 UTC

Could you please add at least a day or two for user ID 8110? It's been running for days, was due the 24th and still says it has around 8.5 hours left. I just restarted BOINC for the second time since it's been running.

Thanks.

Doug
ID: 1958 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
hoarfrost
Volunteer moderator
Project administrator
Project developer

Send message
Joined: 11 Oct 20
Posts: 323
Credit: 23,121,299
RAC: 11,426
Message 1962 - Posted: 29 Jan 2023, 20:25:56 UTC - in response to Message 1958.  

Could you please add at least a day or two for user ID 8110? It's been running for days, was due the 24th and still says it has around 8.5 hours left. I just restarted BOINC for the second time since it's been running.

I added 4 days. :)
ID: 1962 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
PMH_UK

Send message
Joined: 23 Dec 20
Posts: 20
Credit: 1,360,768
RAC: 0
Message 1982 - Posted: 5 Feb 2023, 21:01:23 UTC - in response to Message 1936.  

Note that re-sends are issued with 6 days, which is not enough on slow PCs.

Paul.
ID: 1982 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
hoarfrost
Volunteer moderator
Project administrator
Project developer

Send message
Joined: 11 Oct 20
Posts: 323
Credit: 23,121,299
RAC: 11,426
Message 1983 - Posted: 6 Feb 2023, 2:16:30 UTC - in response to Message 1982.  

Note that re-sends are issued with 6 days, which is not enough on slow PCs.

Deadline is 2 weeks at now. :)
ID: 1983 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Previous · 1 · 2

Message boards : Number crunching : how long can "long tasks" be?

©2024 SiDock@home Team