Questions tagged [leveldb]

LevelDB is an embedded key-value storage developed by Google that is used in Bitcoin Core for block index storage and quick access to the UTXO set (unspent transaction outputs).

Filter by
Sorted by
Tagged with
0 votes
1 answer
44 views

Regarding the chainstate level db (UXTO)

Already found many useful information regarding the chainstats db. such as: What are the keys used in the blockchain levelDB (ie what are the key:value pairs)? But what is the meanning of the last ...
user avatar
  • 171
0 votes
1 answer
26 views

Getting wrong version number of block from block index of Bitcoin Core

I am reading block index using plyvel python package. Following is the location of block indexes: export BLOCK_INDEX_DB=$BITCOIN_HOME/blocks/index Following is the method to decode b128 varint: def ...
user avatar
0 votes
1 answer
97 views

Are the block headers kept in memory?

Bitcoin Core keeps block data as files in the file system and blocks indexes in a LevelDB database to make the search process of transactions and blocks faster. But Bitcoin Core also stores block ...
user avatar
  • 13
0 votes
0 answers
87 views

LevelDB checksum mismatch. How to start reindex from corrupted .ldb again?

I faced the problem twice in 2020 and the reindexing takes 2-3 weeks without stopping. I got the same error on another hard drive when it reindexed about 50% and got an error in the last .ldb file. ...
user avatar
0 votes
0 answers
43 views

Cannot unserialize chainstate transaction outputs after de-obfuscation

I was able to read chainstate database. Getting the key and de-obfuscating to get a valid last block. However, when it comes to transactions that follow after that, I cannot de-serialize them no ...
user avatar
  • 101
0 votes
1 answer
51 views

Bitcoin - Level DB - Block Index - Parsing value for block hash

I am trying to read the value against block hash in level DB of Bitcoin node database - Block/index. For Genesis block, I get 88 bytes which I want to parse. I tried to follow instructions in https://...
user avatar
  • 29
0 votes
1 answer
57 views

Bitcoin - Read transaction details from LevelDB

I am new to LevelDB and the way BTC keeps everything in the database. I went through article How does Bitcoin read from/write to LevelDB but was not able to get to the first step - Transaction ...
user avatar
  • 29
1 vote
0 answers
22 views

What is the relationship between LevelDB's cache (default 8MB) and Bitcoin's UTXO cache?

Please correct me if I am wrong. Bitcoin uses levelDB to store UTXO set. LevelDB has a default 8MB block cache, and the Bitcoin also has a dbcache(default 450MB). What is the relationship between the ...
user avatar
  • 135
5 votes
1 answer
217 views

When the UTXO in the cache is full, what strategy is used to replace one UTXO with another in the cache?

The UTXO set is stored on the disk, but some UTXOs are also stored in the cache. When validating a transaction, you need to query the UTXO pointed to by the input of the transaction. First, you go to ...
user avatar
  • 135
0 votes
1 answer
74 views

How does bitcoin find the block locator hashes in the leveldb database?

I am trying to understand how bitcoin core builds the list of block locator hashes needed for sendheaders and getheaders messages. I have looked on the wiki and I have seen that after the 10 most ...
user avatar
2 votes
1 answer
219 views

What is in the Bitcoin Core LevelDB dbcache? Is it full records or metadata?

What is in the Bitcoin Core LevelDB dbcache? Is it full records or metadata? This question was asked on IRC by Anonymous.
user avatar
0 votes
0 answers
1k views

Error opening block database Full node

For some reason my node shutdown and now I get when restart it Error opening block database here my bitcoin.conf txindex=1 reindex=1 reindex-chainstate=1 # Accept command line and JSON-RPC ...
user avatar
0 votes
0 answers
136 views

What can cause the chainstate database to become corrupted?

I have written a tool that accesses the chainstate LevelDB database to get a list of UTXOs. https://github.com/in3rsha/bitcoin-utxo-dump/blob/master/utxodump.go The tool would originally corrupt the ...
user avatar
  • 2,788
1 vote
0 answers
76 views

why is bitcoind daemon occasionally stuck at `Opening LevelDB in .../.bitcoin/chainstate`despite clean shutdown

My bitcoind daemon sometimes takes an hour to go past Opening LevelDB in .../.bitcoin/chainstate After googling a bit, i thought it was simply an unclean daemon stop causing a leveldb corruption. But ...
user avatar
2 votes
1 answer
113 views

How Does Bitcoin Core Client Keep Track of Longest Chain/Strongest PoW Chains?

Bitcoin Core stores blocks in files in local disk. And it uses LevelDb to form an index on top of block storage to make it faster to retrieve a block (basically a simple key-value pair db). See this ...
user avatar
2 votes
1 answer
3k views

Bitcoind Node crashes after using -dbcache option

I've been trying to speed up my node sync by increasing the dbcache. However my node tends to crash overnight. My system is running ubuntu 18.04, 4GM of ram bitcoin core v0.18. I've tried bitcoind -...
user avatar
0 votes
1 answer
21 views

CDiskBlockIndex: NFile and NDataPos not defined

This is the source code snippet that is used for the serialization of block indexes (found in leveldb). Block 478573 index is (as of my node's leveldb) ...
user avatar
  • 59
0 votes
2 answers
321 views

How to get the block hash in the chainstate leveldb?

From this link What are the keys used in the blockchain levelDB (ie what are the key:value pairs)?, to get the block hash I use the obfuscation key and xor it with the result I get from the db. So I ...
user avatar
1 vote
1 answer
640 views

How exactly do I decode the block file info in leveldb?

Base on the links https://github.com/bitcoin/bitcoin/blob/fcbc8bfa6d10cac4f16699d6e6e68fb6eb98acd0/src/main.h#L392 and What are the keys used in the blockchain levelDB (ie what are the key:value ...
user avatar
2 votes
1 answer
255 views

How to parse values in block index leveldb?

So I'm trying to read the block files with Python. From this link, What are the keys used in the blockchain levelDB (ie what are the key:value pairs)?, it tells you how to access the files with ...
user avatar
3 votes
1 answer
256 views

Does the chainstate leveldb only contain "addresses" for P2PKH and P2SH?

I'm writing a small script that will dump the utxo database to a text file. As far as I'm aware, these are the most common script patterns indicated by the type field inside each value: e.g. value: ...
user avatar
  • 2,788
0 votes
1 answer
176 views

How does Bitcoin use its communication protocol and its database model?

In terms of Bitcoin's communication protocol, how does Bitcoin allow nodes to communicate between each other? Is Bitcoin's communication protocol the same as IPFS(InterPlanetary File System) and if ...
user avatar
  • 135
1 vote
2 answers
419 views

Python - Querying bitcoin's block header using leveldb

I am facing a stupid problem. I am trying to read bitcoin/blocks/index leveldb using plyvel. I've set up a regtest and i know there is a block with the hash : ...
user avatar
  • 11
2 votes
1 answer
454 views

EXCEPTION: 15dbwrapper_error

I'm running Bitcoind 0.17 on a raspberry Pi 3. Everything ran smoothly until I did something wrong (I guess) but can't figure out what happened. Now I got this error. Has someone experience with this ...
user avatar
  • 41
1 vote
1 answer
100 views

why is bitcoin leveldb separated in so many small pieces?

Currently I could see 1418 ldb files on my box, from 210040.ldb to 215423.ldb (some missing). Why are they separated in this way? I want to read the leveldb using golang, but I don't know which one ...
user avatar
0 votes
1 answer
142 views

How can I get the key of blockindex

According to this post: What are the keys used in the blockchain levelDB (ie what are the key:value pairs)? One type of the keys in leveldb of bitcoin is formed in the following way 'b' + 32-byte ...
user avatar
0 votes
0 answers
283 views

Get value from leveldb bitcoin using node.js?

I request information about the block 100001 using leveldb and node js. Below is my code example. var level = require('level'); var db = level('E:/download/blockchain/block'); var str = '...
user avatar
3 votes
2 answers
369 views

Why was Bitcoin Core in need of a fork of LevelDB?

Why did Bitcoin Core fork LevelDB? What special needs does Bitcoin Core have, which require a specialized version of LevelDB?
user avatar
  • 9,789
2 votes
1 answer
409 views

Why is wallet.dat BerkeleyDB instead of LevelDB?

Why wasn't wallet.dat migrated to LevelDB? Is it because BerkeleyDB is better at [something] Backwards compatibility
user avatar
  • 9,789
2 votes
1 answer
372 views

bitcoin chainstate database parsing in python giving wrong value

I am trying to decode chainstate db for a specific out index for a transaction in python just for learning. Transaction ID: 4d4a4c6ca4f3c91e69563199943336d3279fad71c9e8d9c1708ef9dc6ac16000 out index = ...
user avatar
1 vote
2 answers
230 views

Very hard to sync Core Client from scratch

Recently I started running a Core 15.1 node with the blockchain on an external hard drive, and found it very hard to fully sync the blockchain. The problem I keep running into is that (in about 90% of ...
user avatar
0 votes
1 answer
96 views

Trojans detected in ldb bitcoin database?

I started regular scan and clamscan found lots of trojans in bitcon.lfb blocks. What is it? A mistake? sudo clamscan --infected --recursive --exclude-dir="^/sys" / /root/.bitcoin/data/blocks/index/...
user avatar
0 votes
1 answer
724 views

Bitcoin blockchain in mongodb

How bad would it be to use MongoDB as a Bitcoin database instead of LevelDB? I know that LevelDB is faster but I've also read that MongoDB is better for doing queries. It seems cleaner to store the ...
user avatar
4 votes
3 answers
1k views

Format of a block key's contents in bitcoind's LevelDB?

I am trying to use bitcoind's LevelDB block index files (that are stored in blocks/index) to find the file (e.g. blk00029.dat) and byte position of specfic blocks. Thanks to questions What is the ...
user avatar
  • 143
2 votes
0 answers
439 views

How to delete last n blocks / roll back to specific block number in Bitcoin Core? (Like `monero-blockchain-import --pop-blocks n`)

I have Bitcoin Core's bitcoind running and synced in a VM. Now I want to clone the VM and run one of the various hard forks (such as Bitcoin Cash) in the clone. The plan is to roll back my copy of the ...
user avatar
  • 21
0 votes
2 answers
381 views

How does bitcoind store blocks?

I want to parse blockchain manually and extract the UTXO set (for various reasons). Is there any way to understand how the blocks are stored without going through the C++ code? Some specs will be ...
user avatar
  • 1,313
1 vote
2 answers
244 views

Non-obfuscated chainstate data

I'm wondering if there is a flag that allows running bitcoind without using an obfuscation key for the chainstate. I haven't been able to find it.
user avatar
  • 2,692
2 votes
1 answer
272 views

Chainstate Bitcoin Core 0.15

Recently updated my LevelDB parser to work with the new LevelDB 0.15 internal structure. However, I'm wondering about two small changes I found: The prefix for transactions was changed from b'c' to b'...
user avatar
  • 2,692
-2 votes
1 answer
618 views

how to build altcoin in mingw?

OS : Windows 10 Installed Dependencies: -qt4.8.6 gcc 6.3.0 boost 1_55_0 berkeleyDB 4.8.30NC openssl 1.0.2l I tried compiling with the following commands: qmake "USE_UPNP=1" coin-pt.pro mingw32-...
user avatar
2 votes
1 answer
281 views

What will happen when the blockchain size will reach 1 Tb? Or 10 Tb?

My question is more about bitcoin client (bitcoind). Will it still be working fine or maybe something will go wrong? I mean, maybe LevelDB can't handle this amount of data correctly?
user avatar
2 votes
1 answer
216 views

Bcoin - Database backend not found

/root/BCoin/node_modules/bcoin/lib/db/backends.js:16 throw new Error('Database backend "' + name + '" not found.'); ^ Error: Database backend "leveldown" not found. at Object.get (/root/...
user avatar
  • 70
2 votes
1 answer
176 views

Resyncing bcoin brings up database version error

I was resyncing my bcoin node and got the following error: Error: Warning: Your database does not match the current database version. This is likely because the database layout or serialization ...
user avatar
  • 173
4 votes
1 answer
1k views

In which order does the leveldb iterator iterate over utxos?

I would like to know in which order the leveldb iterator iterates over the chainstate entries. I aim to serialize the chainstate and have to make sure that every node can calculate exactly the same ...
user avatar
3 votes
1 answer
1k views

Chainstate LevelDB corruption after reading from the database

I've been working with the LevelDB for a few weeks, coding some tools to access the database and parse the data to be human readable. However, every single time I read from the chainstate the data ...
user avatar
  • 2,692
3 votes
2 answers
654 views

CVarint serialization format

Recently I started analyzing the UTXO set data that every full node stores in chainstate folder (a LevelDB database). By looking into the code you can learn more or less how the data entries are ...
user avatar
  • 2,692
21 votes
1 answer
5k views

Migration from Berkeley DB to LevelDB

In 2013 a new bitcoin core was released and one of the supposed improvement was migrating from Berkeley DB to LevelDB. According to the release notes at bitcoin.org: LevelDB, a fast, open-source, ...
user avatar
1 vote
1 answer
257 views

How does the wallet know which outputs are available with LevelDB

So, I found that in the original Bitcoin client there was a member variable vSpent in the class CWalletTX, however it appears that this is no longer the case in the new version. I know that the new ...
user avatar
  • 607
21 votes
1 answer
10k views

How does Bitcoin read from/write to LevelDB

I know that Bitcoin Core uses LevelDB since 0.8 version. However, I couldn't find detailed explanation about how Bitcoin stores and retrieves from LevelDB. E.g. If B transaction uses an output from ...
user avatar
  • 607
10 votes
1 answer
5k views

Why is Bitcoin Core using LevelDB instead of Redis or SQLite?

Why did Core move from BDB to LevelDB? Why don't they use SQLite or move to Redis now? Is there a technical reason for this choice?
user avatar
3 votes
1 answer
420 views

Bitcoin Chainstate Leveldb sst

I'm trying to read the chainstate, and wrote a small Leveldb client to do so. When I run leveldb, it tells me Corruption: 960 missing files; e.g.: /opt/bitcoin/chainstate/890787.sst. Googling shows ...
user avatar
  • 31