Timeline for Using python, how can I update a text object in a blender animation, every 10 frames, using data from a csv file containing 8million data points?
Current License: CC BY-SA 4.0
16 events
| when toggle format | what | by | license | comment | |
|---|---|---|---|---|---|
| Apr 2, 2022 at 11:39 | comment | added | Amicus Crypto | @Chris good idea... I better search the other questions first or get creative with how I ask it. | |
| Apr 2, 2022 at 11:34 | comment | added | Amicus Crypto | @alambre, Id like to explain to you precisely what I'm trying to do, but I cant do that in a public forum as it will always attract the kind of attention I don't want. | |
| Apr 2, 2022 at 2:36 | comment | added | alambre | I imagined that 2 millions lines could be a problem, vertices on the other side is native data for Blender, and you had 3 data columns, that's all... but python handlers worked for me too, even with that volume of data: check this file, paste your own data and run script to activate the handler, don't know how stable it would be on render... btw I still don't think a video is the best solution here but you know better | |
| Apr 2, 2022 at 2:24 | comment | added | Chris | Ask a new question how to do it with animation nodes and I will show you | |
| Apr 2, 2022 at 0:53 | comment | added | Amicus Crypto | @chris I'm kind of curious how you would have addressed this in animation nodes. I'd like to experiment a little with that to inform my own understanding of what's possible. Perhaps you have seen a good example here that I could pick apart. If you know of any example, that would be great. Thanks. | |
| Apr 1, 2022 at 22:10 | comment | added | Amicus Crypto | @alambre your solution is quite ingenious, creating a point cloud in order to borrow the xyz location co-ordinates and use that to store the csv data. I really laughed when I saw the point cloud. What strikes me about that is, it is a kind of work around solution to achieve an outcome that Blender doesn't really facilitate. I mean would you say thats the standard way to pull large data from a csv file and iterate through it row by row? | |
| Mar 29, 2022 at 23:01 | comment | added | alambre | great, feel free to ask for any doubts you have with the blend... just checked my 2M lines text file together with batfinger's code on that answer I linked, it worked fine here... but you would need to modify the script to read a line and update different text objects in scene | |
| Mar 29, 2022 at 7:38 | vote | accept | Amicus Crypto | ||
| Mar 29, 2022 at 7:38 | comment | added | Amicus Crypto | ok will do. thanks guys. The original data is online graphed but it has a linear structure. With 2 million rows of data, It's very slow and tedious to navigate through, so hopefully when I finish this it will give wider access to the data. | |
| Mar 29, 2022 at 7:24 | comment | added | Chris | no, you should (is my opinion) accept alambres answer but after accepting you can still add your own answer if you want to. | |
| Mar 29, 2022 at 7:22 | comment | added | Amicus Crypto | @chris thanks for your support in this thread. If I accept the answer will it close this thread off from updates. I may want to post my final solution. | |
| Mar 29, 2022 at 7:19 | comment | added | Amicus Crypto | @alambre thanks very much for your help, particularly leaving me with enough room to tinker and discover. | |
| Mar 29, 2022 at 5:42 | comment | added | Chris | @alambre: very nice! +1 for providing a great solution with blend file and even providing building the csv file! | |
| Mar 29, 2022 at 5:17 | comment | added | alambre | ok then just coordinates may not be enough... just added a second script to blend to generate some fake data, then tried loading a 2 million rows file with no problem... fixed index offset too... about seeds, that could be a simple list of values, no need to store into vertices | |
| Mar 29, 2022 at 4:54 | comment | added | Amicus Crypto | Thanks very much Alambre, I will give this a shot. The first column does look like an index but it's used in part to generate a pseudo random result, the seed is changed at various points in the data and the nonce then resets to 0. Maybe I should break the data up by seed. I think the first seed ran to just half million rows. I wonder how blender will handle big data projects and infinite data streams. | |
| Mar 29, 2022 at 4:31 | history | answered | alambre | CC BY-SA 4.0 |