Skip to main content
Share Your Experience: Take the 2024 Developer Survey

Questions tagged [database]

A database is a store of information (data) about a specific subject area. Specific software to facilitate the storage indexing and retrieval of a database is known as a database management system DBMS. For example, The Bitcoin-Core wallet uses several DBMS' to maintain several databases about wallet contents and about the list of transactions known as the blockchain.

Filter by
Sorted by
Tagged with
2 votes
1 answer
113 views

What is the data format layout for txindex LevelDB values?

The keys I understand, t + 32-byte hash. But my problem are the values. I understand from sources such as What are the keys used in the blockchain levelDB (ie what are the key:value pairs)? that the ...
Ciro Santilli OurBigBook.com's user avatar
0 votes
0 answers
150 views

how to get the private key in Bitcoin Core 26.0.0 and how to create a legacy wallet

i had tried many methods but nothing help me , by using bitcoind -deprecatedrpc=create_bdb i think i had installed the Berkeley DB please help me to solve the problem
N.dhanush raj's user avatar
0 votes
1 answer
38 views

Bitcoin API for getting an input script?

I wanted to try talking to my bitcoin node to get the input scripts and put them into a database. Does anyone have good resources on where I can look to get started?
mark's user avatar
  • 35
4 votes
3 answers
323 views

What data does the Bitcoin Core wallet search for during a blockchain rescan?

When the wallet examines a transaction for relevance what does it do exactly with that transaction's output scripts and what is that data compared to? Does the wallet database store a table of all the ...
pinhead's user avatar
  • 5,154
1 vote
0 answers
40 views

Indexing Spent UTXOs

I want to do analytics on bitcoin data and for this I would need to be able to check in what tx a spent UTXO is spent. For this Im going to index all spent UTXOs in a database and I need help with ...
bittzz's user avatar
  • 11
1 vote
1 answer
101 views

Understanding Bitcoin - Usage of Merkle Trees

I'm currently learning about the Bitcoin blockchain. I've come across the concept of Merkle trees in the context of Bitcoin. I understand that Merkle trees are used to verify the integrity of the data,...
mlibre's user avatar
  • 133
0 votes
0 answers
234 views

Full explanation of what Electrum Server / Electrs does for data availability?

I am working on an on-chain data model in a corporate data warehouse setting. All data must live on an internal system where it can be easily joined to other datasources, and support a variety of ...
sha2fiddy's user avatar
1 vote
1 answer
2k views

How can one examine the contents of the wallet.dat file using sqlite3?

These two questions (1, 2) discuss what is in wallet.dat. Andrew Chow states in 2017 (when the database was still BDB and not sqlite): The wallet.dat file contains your private keys, public keys, ...
Michael Folkson's user avatar
5 votes
1 answer
157 views

Efficiency of storing/querying transactions in a relational database

I have a full node, and have written some limited python programs with bitcoinrpc. I want to start doing slightly more ambitious things now, e.g. visualisations across the entire blockchain (possibly ...
d3wannabe's user avatar
  • 275
3 votes
1 answer
58 views

Why isn't the backed up sqlite3 exactly same as the lightningd.sqlite3?

In the backing up page of C-Lightning, it says: The main and backup files will not be identical at every byte, but they will still contain the same data. Is there any specific reason this happens? ...
Angelo's user avatar
  • 423
1 vote
1 answer
301 views

Error installing on Mac - Build does not support Berkeley DB database format

Im following the guide here (https://github.com/bitcoin/bitcoin/blob/master/doc/build-osx.md) to install Bitcoin on my Mac. I want to be able to run bitcoind with and without the GUI. The first time I ...
Mark's user avatar
  • 137
3 votes
1 answer
94 views

What is involved in the "database compaction" of a LND node?

As lightning network channels route payments, channel updates require the 2 channel peers (Alice & Bob) to do a round of signing and trade commitment transactions for the most up-to-date channel ...
oz21m's user avatar
  • 107
0 votes
1 answer
74 views

Database of altcoins?

Is there a database of all the major altcoins and their address types? Bitcoin Wiki doesn't have very many, nor does it describe their address formats.
Geremia's user avatar
  • 4,640
3 votes
1 answer
183 views

explore sqlite wallet

I created an sqlite wallet, tried to browse it from the sqlite3 program, but had to reset (tset) the terminal after querying the main table garbled the console characters. How to query the main table ...
Mercedes's user avatar
  • 802
3 votes
2 answers
127 views

Getting "Unable to find DB driver for sqlite3" when trying to start c-lightning node

Hey I just started receiving this message for my c-lightning node when try to start it. Unable to find DB driver for sqlite3:///root/.lightning/bitcoin/lightningd.sqlite3 It started happening after I ...
Gimberg's user avatar
  • 79
1 vote
1 answer
2k views

How to fix “Error opening block database”?

How to fix this? My computer shut down without closing the program and now I try to help the network but cannot open the app... I'm a newbie, excuse myself please!
Naiad Arenque's user avatar
0 votes
1 answer
141 views

Are the block headers kept in memory?

Bitcoin Core keeps block data as files in the file system and blocks indexes in a LevelDB database to make the search process of transactions and blocks faster. But Bitcoin Core also stores block ...
MHT's user avatar
  • 13
4 votes
1 answer
360 views

Layout of new SQLite descriptor wallets in v0.21 and v22.0?

I'm trying to explore the database format of the new descriptor wallets in Bitcoin Core v0.21 and v22.0, but I can't quite figure it out. I've created a new descriptor wallet and dumped it's contents ...
Dan's user avatar
  • 461
2 votes
1 answer
172 views

How to identify Taproot transaction using big query?

From bitcoin magazine, I saw that When Taproot/Schnorr goes live soon, they will use the new witness version one to distinguish them from older Segregated Witness transactions. But when I check the ...
Camila Burne's user avatar
1 vote
0 answers
136 views

Use wallet db for locked UTXOs in Bitcoin Core

Related question: Why are UTXO locks stored in memory only? Sorry this maybe a dumb question for people good with using database in C++ however I am not able to understand what exactly is going wrong ...
user avatar
0 votes
1 answer
152 views

Bitcoin data by country?

I am a political science graduate student looking to do research on bitcoin and cryptocurrency. To do so, however, I need data. While many datasets provide wonderful histories of bitcoin price and ...
HeadlessHeadscratcher's user avatar
1 vote
0 answers
65 views

DB Structure for bitcoin blocks

https://github.com/blockchain-etl/bitcoin-etl#schema I found a library to parse the block data in json format. I want to parse that json and put it into a db to then use that for calculating balances. ...
UnknownHex64's user avatar
1 vote
2 answers
2k views

How to extract all info for a public address from a local full node's db?

I recently started running bitcoind on a local Debian host, and I am still learning how to use the information in the local copy of the bitcoin blockchain. I would like to extract all the information ...
kjo's user avatar
  • 145
0 votes
1 answer
128 views

how is blockchain data stored and accessed?

Can blockchain data be stored in a relational database? If so what would the schema be? I know blockchain itself is a data structure, but how is the data stored? In JSON files? In a RDBMS? in CSV file?...
gcr's user avatar
  • 103
3 votes
2 answers
279 views

Is there any reason for an alternative Bitcoin implementation to use Berkeley DB?

The primary reason Bitcoin's C++ reference implementation uses Berkeley DB 4.8 seems to be backwards compatibility. It doesn't appear that BDB4.8 (or BDB at all for that matter) has any superior ...
Kittywhiskers Van Gogh's user avatar
1 vote
1 answer
475 views

Can I use my "chainstate" folder for anything?

I've recently found an old folder called "chainstate" in my PC. Can't remember why I saved it but inside it there's the following files: "000003.log" "CURRENT" "LOCK&...
HWELL3's user avatar
  • 11
10 votes
1 answer
3k views

Why is the Bitcoin Core wallet database moving from Berkeley DB to SQLite?

Why is the Bitcoin Core wallet moving from Berkeley DB to SQLite for its database backend?
Michael Folkson's user avatar
3 votes
1 answer
919 views

What is in the Bitcoin Core LevelDB dbcache? Is it full records or metadata?

What is in the Bitcoin Core LevelDB dbcache? Is it full records or metadata? This question was asked on IRC by Anonymous.
Michael Folkson's user avatar
0 votes
1 answer
85 views

Tiny 1-block forks in blk.dat files

I just completed parsing the Testnet3 Bitcoin blockchain stored in the blk.dat files into a database. Since I was using multi-processing to parse several files at the same time, I didn't add the ...
Oscar Serna's user avatar
3 votes
1 answer
523 views

API for large number of queries to different addresses every few minutes

I have an application that needs to makes queries to get address balances and transaction data from Bitcoin. What are some possible solutions to this? It would be great if I didn't have to manage a ...
Patoshi パトシ's user avatar
0 votes
1 answer
337 views

Why does Bitcoin store keys in a database?

According to this Bitcoin stores the user's keys and some additional data in a file called wallet.dat, which is a Berkley DB. Let's suppose the wallet.dat contained only the user's keys. Let's also ...
Aschente's user avatar
1 vote
1 answer
53 views

Is the index db downloaded from peers or generated locally?

When the user start the Bitcoin client for the first time, it will download the whole blockchain. But what about the block index (blkindex.dat in older versions) ? Is it downloaded from peers just ...
nametone's user avatar
-1 votes
1 answer
60 views

Are Core's blockchain reads parallelized?

Does Core have a mutex allowing one read at a time from the blockchain, or can reads be parallelized? If multiple reads from different threads is possible and there's no single mutex, it is advised to ...
MCCCS's user avatar
  • 10.2k
1 vote
1 answer
469 views

Raspberry Pi 3 / Bitcoin Node / No space left on device / Link Database to External Hard drive / [duplicate]

I was following @meeDamian Bitcoin node guide on a Raspberry Pi 3 and could get almost everything to work except that it stores the Blockchain on my USB Harddrive. Its mounted and I have disk space ...
imbafisk4tw's user avatar
4 votes
4 answers
871 views

What is the currently most efficient and reliable method to store the Bitcoin blockchain in a local database?

I have seen several posts on this before, and have tried all the suggested solutions, but I can't get any of them to work. I am interested in analysing transactions with the OP_RETURN opcode for a ...
Johannes Mols's user avatar
3 votes
0 answers
340 views

Is it safe to skip the initial block verification at startup?

The longest step in bitcoin core initialization is "Verifying last 6 blocks at level 3". The number of blocks checked at startup went down from 288 in 2014 to 6 now. Therefore, in order to speedup ...
Pedro's user avatar
  • 753
0 votes
0 answers
271 views

Creating a "listunspent" API call using MongoDB

I used a tutorial online to create my own block explorer (https://www.youtube.com/watch?v=laeV2slJgc8). In this tutorial, I used "Iquidus" to create the block explorer, which uses MongoDB and Node....
IGOR's user avatar
  • 1
-2 votes
1 answer
169 views

How do I upload a file to a testnet blockchain?

I want to upload files to the testnet blockchain, specifically the Bitcoin testnet. I am looking for help on how to add a file to the Bitcoin testnet blockchain. I know that these coins are super easy ...
Number File's user avatar
2 votes
1 answer
4k views

Bitcoind Node crashes after using -dbcache option

I've been trying to speed up my node sync by increasing the dbcache. However my node tends to crash overnight. My system is running ubuntu 18.04, 4GM of ram bitcoin core v0.18. I've tried bitcoind -...
nakamoto_connection's user avatar
5 votes
1 answer
4k views

Recovery of a corrupted wallet

I have a very old wallet.dat that I've put into my .bitcoin folder. When trying to run bitcoind, the service stops giving the following error 2019-06-11T18:14:02Z Using wallet directory /home/nom/....
Jernej's user avatar
  • 97
0 votes
1 answer
66 views

What database tables structure do bitcoin uses?

What databases do bitcoin core (nodes) uses? And how looks tables structure? I can't find it anywhere...
Michal's user avatar
  • 609
1 vote
1 answer
128 views

Is blockchain really secure to store sensitive data?

Plenty of developers these days trying to decentralise everything. I noticed some developers claim that they are gonna replace email with blockchain technology. johnmcafeeswiftmail, CryptaMail, ...
PrivateUser's user avatar
3 votes
2 answers
2k views

How to store private key in MySQL database?

I want to receive payments from Bitcoin on my web app, but I do not want to use corporate gateways (coinpayments, bitpay, etc), I'm wanting to make my own gateway. I do not know how best to do this ...
Vinicius Aquino's user avatar
-1 votes
1 answer
92 views

"Centralized Relational Databases" vs. "Decentralized Blockchain " : Which one is really more scalable?

There are many research papers on problem of scalability of blockchains: Just as an example : An Overview of Blockchain Technology: Architecture, Consensus, and Future Trends However, (usually by ...
Questioner's user avatar
  • 1,151
3 votes
2 answers
419 views

Why was Bitcoin Core in need of a fork of LevelDB?

Why did Bitcoin Core fork LevelDB? What special needs does Bitcoin Core have, which require a specialized version of LevelDB?
MCCCS's user avatar
  • 10.2k
1 vote
1 answer
80 views

how a system based on a blockchain would deal with exponential growth of informations carried in it?

I was reading this article about the difference between a blockchain and centralized servers and a question came up to my mind: if I understand well the difference stands in the fact that in a ...
agneau's user avatar
  • 113
0 votes
1 answer
451 views

How to explore ripple ledger? [closed]

I'm running a ripple node on my own server, and try to conduct some analysis to the balance of all ripple accounts. Thus I need to synchronize the ledgers and analyse them. Currently, my server has ...
X. Xie's user avatar
  • 1
2 votes
1 answer
650 views

What's raw undo data for?

I see block chain is stored basically four pieces of data that are maintained: blocks/blk*.dat: the actual Bitcoin blocks, in network format, dumped in raw on disk. They are only needed for ...
memorybox's user avatar
  • 141
0 votes
1 answer
827 views

Bitcoin blockchain in mongodb

How bad would it be to use MongoDB as a Bitcoin database instead of LevelDB? I know that LevelDB is faster but I've also read that MongoDB is better for doing queries. It seems cleaner to store the ...
Vladislav Zhdanov's user avatar
1 vote
2 answers
66 views

what's CCoinsViewDB::GetHeadBlocks for?

I have google a lot, there exists little information, confused with the code comments Retrieve the range of blocks that may have been only partially written. If the database is in a consistent state,...
xiedeacc's user avatar
  • 121