Posts: 129
Threads: 7
Joined: Feb 2024
Jan 13, 2025, 09:56 AM
(This post was last modified: Jan 13, 2025, 10:15 AM by alph4byt33.)
For those who work with huge databases and datasets on the average PC at home, what advice do you have for software that can handle all the rows of data and out of curiosity, what CPU are you on to handle the load. I've always used the Linux CLI with basic tools like cat and grep but I'm trying out Row Zero for a 50GB CSV file, let's see how it does.
Posts: 11,479
Threads: 226
Joined: Jun 2023
(Jan 13, 2025, 09:56 AM)alph4byt33 Wrote: For those who work with huge databases and datasets on the average PC at home, what advice do you have for software that can handle all the rows of data and out of curiosity, what CPU are you on to handle the load. I've always used the Linux CLI with basic tools like cat and grep but I'm trying out Row Zero for a 50GB CSV file, let's see how it does.
EmEditor, the best thing that makes Windows viable for data handling, as it's the BEST large dataset software going, as for processing, move into Intel CPUs, give your RAM an upgrade too
"Universal appeal is poison masquerading as medicine. Horror is not meant to be universal. It's meant to be personal, private, animal"
Posts: 105
Threads: 3
Joined: Oct 2024
Sweetscape 010 Editor works too
Posts: 1,484
Threads: 64
Joined: Jun 2023
Use Linux GNU tools (grep/sed/a etc.) on a recent AMD CPU on a PC with NVME PCIE 4.0!!
Posts: 11,479
Threads: 226
Joined: Jun 2023
(Jan 14, 2025, 11:13 AM)joepa Wrote: Use Linux GNU tools (grep/sed/a etc.) on a recent AMD CPU on a PC with NVME PCIE 4.0!!
Are the latest AMD CPU's best for Linux at the moment?
"Universal appeal is poison masquerading as medicine. Horror is not meant to be universal. It's meant to be personal, private, animal"
Posts: 3
Threads: 1
Joined: Nov 2023
(Jan 13, 2025, 12:13 PM)DredgenSun Wrote: (Jan 13, 2025, 09:56 AM)alph4byt33 Wrote: For those who work with huge databases and datasets on the average PC at home, what advice do you have for software that can handle all the rows of data and out of curiosity, what CPU are you on to handle the load. I've always used the Linux CLI with basic tools like cat and grep but I'm trying out Row Zero for a 50GB CSV file, let's see how it does.
EmEditor, the best thing that makes Windows viable for data handling, as it's the BEST large dataset software going, as for processing, move into Intel CPUs, give your RAM an upgrade too
Can confirm, as of Windows I found EmEditor the only viable solution, was running on a pretty decent Ryzen 7 3700X and it went smooth
Posts: 11,479
Threads: 226
Joined: Jun 2023
(Jan 14, 2025, 02:10 PM)MrAnderson Wrote: (Jan 13, 2025, 12:13 PM)DredgenSun Wrote: (Jan 13, 2025, 09:56 AM)alph4byt33 Wrote: For those who work with huge databases and datasets on the average PC at home, what advice do you have for software that can handle all the rows of data and out of curiosity, what CPU are you on to handle the load. I've always used the Linux CLI with basic tools like cat and grep but I'm trying out Row Zero for a 50GB CSV file, let's see how it does.
EmEditor, the best thing that makes Windows viable for data handling, as it's the BEST large dataset software going, as for processing, move into Intel CPUs, give your RAM an upgrade too
Can confirm, as of Windows I found EmEditor the only viable solution, was running on a pretty decent Ryzen 7 3700X and it went smooth
Nice! Glad it worked out sir!
"Universal appeal is poison masquerading as medicine. Horror is not meant to be universal. It's meant to be personal, private, animal"
Posts: 1,484
Threads: 64
Joined: Jun 2023
Quote:Are the latest AMD CPU's best for Linux at the moment?
AMD is now the best for all OSs.
Posts: 11,479
Threads: 226
Joined: Jun 2023
(Jan 16, 2025, 11:27 AM)joepa Wrote: Quote:Are the latest AMD CPU's best for Linux at the moment?
AMD is now the best for all OSs.
Nice! Looks like im getting an AMD
"Universal appeal is poison masquerading as medicine. Horror is not meant to be universal. It's meant to be personal, private, animal"
Posts: 129
Threads: 7
Joined: Feb 2024
(Jan 13, 2025, 12:13 PM)DredgenSun Wrote: (Jan 13, 2025, 09:56 AM)alph4byt33 Wrote: For those who work with huge databases and datasets on the average PC at home, what advice do you have for software that can handle all the rows of data and out of curiosity, what CPU are you on to handle the load. I've always used the Linux CLI with basic tools like cat and grep but I'm trying out Row Zero for a 50GB CSV file, let's see how it does.
EmEditor, the best thing that makes Windows viable for data handling, as it's the BEST large dataset software going, as for processing, move into Intel CPUs, give your RAM an upgrade too
Thanks a lot, idk how I didn't know about it before honestly. And yeah I'm thinking on upping my RAM, 16GB nowadays seems not enough.
|