Hardware and software for handling large datasets like breaches
by alph4byt33 - Monday January 13, 2025 at 09:56 AM
#1
For those who work with huge databases and datasets on the average PC at home, what advice do you have for software that can handle all the rows of data and out of curiosity, what CPU are you on to handle the load. I've always used the Linux CLI with basic tools like cat and grep but I'm trying out Row Zero for a 50GB CSV file, let's see how it does.
Reply
#2
(Jan 13, 2025, 09:56 AM)alph4byt33 Wrote: For those who work with huge databases and datasets on the average PC at home, what advice do you have for software that can handle all the rows of data and out of curiosity, what CPU are you on to handle the load. I've always used the Linux CLI with basic tools like cat and grep but I'm trying out Row Zero for a 50GB CSV file, let's see how it does.

EmEditor, the best thing that makes Windows viable for data handling, as it's the BEST large dataset software going, as for processing, move into Intel CPUs, give your RAM an upgrade too
"Universal appeal is poison masquerading as medicine. Horror is not meant to be universal. It's meant to be personal, private, animal"
Reply
#3
Sweetscape 010 Editor works too
Reply
#4
Use Linux GNU tools (grep/sed/a etc.) on a recent AMD CPU on a PC with NVME PCIE 4.0!!
Reply
#5
(Jan 14, 2025, 11:13 AM)joepa Wrote: Use Linux GNU tools (grep/sed/a etc.) on a recent AMD CPU on a PC with NVME PCIE 4.0!!

Are the latest AMD CPU's best for Linux at the moment?
"Universal appeal is poison masquerading as medicine. Horror is not meant to be universal. It's meant to be personal, private, animal"
Reply
#6
(Jan 13, 2025, 12:13 PM)DredgenSun Wrote:
(Jan 13, 2025, 09:56 AM)alph4byt33 Wrote: For those who work with huge databases and datasets on the average PC at home, what advice do you have for software that can handle all the rows of data and out of curiosity, what CPU are you on to handle the load. I've always used the Linux CLI with basic tools like cat and grep but I'm trying out Row Zero for a 50GB CSV file, let's see how it does.

EmEditor, the best thing that makes Windows viable for data handling, as it's the BEST large dataset software going, as for processing, move into Intel CPUs, give your RAM an upgrade too

Can confirm, as of Windows I found EmEditor the only viable solution, was running on a pretty decent Ryzen 7 3700X and it went smooth
Reply
#7
(Jan 14, 2025, 02:10 PM)MrAnderson Wrote:
(Jan 13, 2025, 12:13 PM)DredgenSun Wrote:
(Jan 13, 2025, 09:56 AM)alph4byt33 Wrote: For those who work with huge databases and datasets on the average PC at home, what advice do you have for software that can handle all the rows of data and out of curiosity, what CPU are you on to handle the load. I've always used the Linux CLI with basic tools like cat and grep but I'm trying out Row Zero for a 50GB CSV file, let's see how it does.

EmEditor, the best thing that makes Windows viable for data handling, as it's the BEST large dataset software going, as for processing, move into Intel CPUs, give your RAM an upgrade too

Can confirm, as of Windows I found EmEditor the only viable solution, was running on a pretty decent Ryzen 7 3700X and it went smooth

Nice! Glad it worked out sir!
"Universal appeal is poison masquerading as medicine. Horror is not meant to be universal. It's meant to be personal, private, animal"
Reply
#8
Quote:Are the latest AMD CPU's best for Linux at the moment?
AMD is now the best for all OSs.
Reply
#9
(Jan 16, 2025, 11:27 AM)joepa Wrote:
Quote:Are the latest AMD CPU's best for Linux at the moment?
AMD is now the best for all OSs.

Nice! Looks like im getting an AMD
"Universal appeal is poison masquerading as medicine. Horror is not meant to be universal. It's meant to be personal, private, animal"
Reply
#10
(Jan 13, 2025, 12:13 PM)DredgenSun Wrote:
(Jan 13, 2025, 09:56 AM)alph4byt33 Wrote: For those who work with huge databases and datasets on the average PC at home, what advice do you have for software that can handle all the rows of data and out of curiosity, what CPU are you on to handle the load. I've always used the Linux CLI with basic tools like cat and grep but I'm trying out Row Zero for a 50GB CSV file, let's see how it does.

EmEditor, the best thing that makes Windows viable for data handling, as it's the BEST large dataset software going, as for processing, move into Intel CPUs, give your RAM an upgrade too

Thanks a lot, idk how I didn't know about it before honestly. And yeah I'm thinking on upping my RAM, 16GB nowadays seems not enough.
Reply


Possibly Related Threads…
Thread Author Replies Views Last Post
  NEW USERS READ - how to avoid malware on the forum Sukob 104 12,857 6 hours ago
Last Post: Elowyn
  A collection of deepweb sites [2025] dg7ka 112 3,429 Yesterday, 07:57 PM
Last Post: IsItReal
  Hacking forums and their links 2026 onionlinks 1 274 Yesterday, 05:01 PM
Last Post: phas3lock
  What is your most efficent way to gain initial access? likju 1 202 Yesterday, 04:47 PM
Last Post: phas3lock
  FREE 3 UNCENSORED HACKING LLM QaboosbinSaidAlSaid 69 2,015 Yesterday, 04:37 PM
Last Post: phas3lock

Forum Jump:


 Users browsing this forum: 1 Guest(s)