Posts: 37
Threads: 2
Joined: Apr 2026
Which programs do you guys use? I've tried a handful and DB Browser seems to be the most compatible. If I try to open something massively, like 100gb+, I get not enough memory error. I have 64gb and it seems like I genuinely need 128gb of ram? Is it possible to open massive files like these without buying 128gb of ram? Any file splitting programs seem to either not work or are paywalled, so I would prefer to stick to just opening the normal file. This forum account is currently banned. Ban Length: Permanent (N/A Remaining) Ban Reason: Contact Administration.
Posts: 183
Threads: 28
Joined: Jun 2023
(Jan 11, 2026, 12:31 AM)Mankey8291 Wrote: Which programs do you guys use? I've tried a handful and DB Browser seems to be the most compatible. If I try to open something massively, like 100gb+, I get not enough memory error. I have 64gb and it seems like I genuinely need 128gb of ram? Is it possible to open massive files like these without buying 128gb of ram? Any file splitting programs seem to either not work or are paywalled, so I would prefer to stick to just opening the normal file.
EmEditor
Posts: 37
Threads: 2
Joined: Apr 2026
(Jan 11, 2026, 12:50 AM)aaa Wrote: (Jan 11, 2026, 12:31 AM)Mankey8291 Wrote: Which programs do you guys use? I've tried a handful and DB Browser seems to be the most compatible. If I try to open something massively, like 100gb+, I get not enough memory error. I have 64gb and it seems like I genuinely need 128gb of ram? Is it possible to open massive files like these without buying 128gb of ram? Any file splitting programs seem to either not work or are paywalled, so I would prefer to stick to just opening the normal file.
EmEditor
Wow, thank you! That program worked wonderfully! It barely uses any memory and no lag when scrolling This forum account is currently banned. Ban Length: Permanent (N/A Remaining) Ban Reason: Contact Administration.
Posts: 10
Threads: 0
Joined: Apr 2026
You don't need as much RAM as the file is large. A good program should read/process it in chunks or memory map it.
I write a python script with pandas and a reasonable `chunksize` This forum account is currently banned. Ban Length: Permanent (N/A Remaining) Ban Reason: Contact Administration.
Posts: 17
Threads: 0
Joined: Apr 2026
if its windows go for emeditor, for linux and so on use `less` program or `ripgrep` if you are looking for specific line This forum account is currently banned. Ban Length: Permanent (N/A Remaining) Ban Reason: Contact Administration.
Posts: 217
Threads: 10
Joined: Apr 2026
I use KLOGG, it's a good one This forum account is currently banned. Ban Length: Permanent (N/A Remaining) Ban Reason: Contact Administration.
Posts: 32
Threads: 3
Joined: Apr 2026
Nevers try to use db browser, juste try emeditor if u are on Windows or if u are on linux u can try grep This forum account is currently banned. Ban Length: Permanent (N/A Remaining) Ban Reason: Contact Administration.
Posts: 14
Threads: 3
Joined: Apr 2026
(Jan 11, 2026, 12:31 AM)Mankey8291 Wrote: Which programs do you guys use? I've tried a handful and DB Browser seems to be the most compatible. If I try to open something massively, like 100gb+, I get not enough memory error. I have 64gb and it seems like I genuinely need 128gb of ram? Is it possible to open massive files like these without buying 128gb of ram? Any file splitting programs seem to either not work or are paywalled, so I would prefer to stick to just opening the normal file.
If you are on linux and want to use say Vim, then try opening Vim in a GPU-accelerated terminal emulator, example: Kitty, Ghostty This forum account is currently banned. Ban Length: Permanent (N/A Remaining) Ban Reason: Contact Administration.
Posts: 1,484
Threads: 64
Joined: Jun 2023
use linux with the gnu tools (sed awk grep tr etc.).
Posts: 217
Threads: 10
Joined: Apr 2026
(Jan 21, 2026, 09:00 PM)joepa Wrote: use linux with the gnu tools (sed awk grep tr etc.).
Yes , GREP is the must, KLOGG for preview is cool also This forum account is currently banned. Ban Length: Permanent (N/A Remaining) Ban Reason: Contact Administration.
|