Best way to collect big database
by 1337fangang - Tuesday March 26, 2024 at 11:50 PM
#1
Hello everyone as title says im looking to create a large data base of leaks/breaches and then search through them(mainly looking for reused passwords) what would be the best way to collect a large amount of high quality breaches then index through them?
Reply
#2
As far as I know, to build your breach database and find reused passwords, try LeakLooker, PwnDB and WhatBreach to collect data. Then, use BaseQuery and h8mail to index and search through it all
I still recommend you to continue researching about it
Good luck!

This forum account is currently banned. Ban Length: Permanent (N/A Remaining)
Ban Reason: Scraping | Contact us via https://breachforums.rs/misc.php?action=help&hid=27 if you feel this is incorrect.
Reply
#3
The investment is really not small
Reply
#4
create a data base and import all the data you found.
Reply
#5
I use Elasticsearch for my database. It seems to work fairly well. As for getting large databases, look in the official databases on this site and pick the databases that best suit your needs and get the,.
Reply
#6
I think elasticsearch is way to go if you want to index larger databases

This forum account is currently banned. Ban Length: Permanent (N/A Remaining)
Ban Reason: Leeching | http://c66go4clkqodr7tdjfu76jztjs7w7d3fajdeypxn73v4ju3dt7g5yyyd.onion/Forum-Ban-Appeals if you feel this is incorrect.
Reply
#7
(Apr 15, 2024, 06:00 AM)robertcollins445 Wrote: I use Elasticsearch for my database. It seems to work fairly well. As for getting large databases, look in the official databases on this site and pick the databases that best suit your needs and get the,.

For someone knew to elasticsearch, Is this the front-end component or a database?
Reply
#8
I use elasticsearch for my dbs, try it out
Reply
#9
If we are talking specifically about passwords, then such a database exists here, even several
Reply
#10
(Dec 26, 2024, 06:01 PM)memleak Wrote:
(Apr 15, 2024, 06:00 AM)robertcollins445 Wrote: I use Elasticsearch for my database. It seems to work fairly well. As for getting large databases, look in the official databases on this site and pick the databases that best suit your needs and get the,.

For someone knew to elasticsearch, Is this the front-end component or a database?

Elastic Search is a "database" (backend). You can use Kibana as a front end or just build a web interface that connects to it.
Reply


Possibly Related Threads…
Thread Author Replies Views Last Post
  Request for South Korea databases. AmazonsGoat 1 258 2 hours ago
Last Post: minituktuk
  REQUEST South Africa JD Group database phas3lock 2 132 10 hours ago
Last Post: phas3lock
  I search admin page of 5 web sites selluk 4 214 Yesterday, 03:33 PM
Last Post: selluk
  ANY SPAIN MOBILE DATABASE? IBERIA AIRLINES? darkbigfoot 3 169 Yesterday, 12:58 PM
Last Post: Theblueanonymouse
  REQUEST Full NationalPublicData with SSNs Instinct 6 756 May 05, 2026, 09:04 PM
Last Post: Rollinbk60

Forum Jump:


 Users browsing this forum: 1 Guest(s)