Best way to collect big database
by 1337fangang - Tuesday March 26, 2024 at 11:50 PM
#1
Hello everyone as title says im looking to create a large data base of leaks/breaches and then search through them(mainly looking for reused passwords) what would be the best way to collect a large amount of high quality breaches then index through them?
Reply
#2
As far as I know, to build your breach database and find reused passwords, try LeakLooker, PwnDB and WhatBreach to collect data. Then, use BaseQuery and h8mail to index and search through it all
I still recommend you to continue researching about it
Good luck!

This forum account is currently banned. Ban Length: Permanent (N/A Remaining)
Ban Reason: Scraping | Contact us via https://breachforums.ai/contact if you feel this is incorrect.
Reply
#3
The investment is really not small
Reply
#4
create a data base and import all the data you found.
Reply
#5
I use Elasticsearch for my database. It seems to work fairly well. As for getting large databases, look in the official databases on this site and pick the databases that best suit your needs and get the,.
Reply
#6
I think elasticsearch is way to go if you want to index larger databases

This forum account is currently banned. Ban Length: Permanent (N/A Remaining)
Ban Reason: Leeching | http://c66go4clkqodr7tdjfu76jztjs7w7d3fajdeypxn73v4ju3dt7g5yyyd.onion/Forum-Ban-Appeals if you feel this is incorrect.
Reply
#7
(Apr 15, 2024, 06:00 AM)robertcollins445 Wrote: I use Elasticsearch for my database. It seems to work fairly well. As for getting large databases, look in the official databases on this site and pick the databases that best suit your needs and get the,.

For someone knew to elasticsearch, Is this the front-end component or a database?
Reply
#8
I use elasticsearch for my dbs, try it out
Reply
#9
If we are talking specifically about passwords, then such a database exists here, even several
Reply
#10
(Dec 26, 2024, 06:01 PM)memleak Wrote:
(Apr 15, 2024, 06:00 AM)robertcollins445 Wrote: I use Elasticsearch for my database. It seems to work fairly well. As for getting large databases, look in the official databases on this site and pick the databases that best suit your needs and get the,.

For someone knew to elasticsearch, Is this the front-end component or a database?

Elastic Search is a "database" (backend). You can use Kibana as a front end or just build a web interface that connects to it.
Reply


Possibly Related Threads…
Thread Author Replies Views Last Post
  REQUEST FREE.FR & AMELI DATABASE orkidd 1 115 Yesterday, 03:51 PM
Last Post: orkidd
  request Rappi Database 2024 (old office databases) phack 0 53 Apr 24, 2026, 10:13 AM
Last Post: phack
  Looking for SANS Certificates hermitelectronic 1 487 Apr 22, 2026, 01:32 AM
Last Post: Jonwi
  Help needed shailaafros97 2 150 Apr 20, 2026, 12:49 PM
Last Post: handrail1698
  Nissan North America Source Code Dump zvezdanwastakenagain 0 106 Apr 19, 2026, 12:33 PM
Last Post: zvezdanwastakenagain

Forum Jump:


 Users browsing this forum: 1 Guest(s)