Questions tagged [leveldb]
LevelDB is an embedded key-value storage developed by Google that is used in Bitcoin Core for block index storage and quick access to the UTXO set (unspent transaction outputs).
62
questions
2
votes
1
answer
71
views
When does chainstate get updated?
What i'm trying to do now is reading LevelDB at chainstate folder to save all utxos at my own DB, and keep tracking the changes of utxos by looking at chainstate folder frequently.
However, what i ...
- 61
2
votes
1
answer
62
views
LevelDB error after power outage
After a power outage, starting bitcoind I recieved this errors (circled in the image). Reading online some users suggest to do a reindex and i did it but after 11 hours my node isn't reindex yet... ...
- 23
2
votes
1
answer
247
views
Number of transactions per blk.dat files
I am working on a parser for the blk.dat files being returned by the Bitcoin Core node. It seems to slow down considerably after a point and I am pretty sure it's because the number of transactions is ...
0
votes
1
answer
67
views
Regarding the chainstate level db (UXTO)
Already found many useful information regarding the chainstats db.
such as:
What are the keys used in the blockchain levelDB (ie what are the key:value pairs)?
But what is the meanning of the last ...
- 301
0
votes
1
answer
52
views
Getting wrong version number of block from block index of Bitcoin Core
I am reading block index using plyvel python package.
Following is the location of block indexes:
export BLOCK_INDEX_DB=$BITCOIN_HOME/blocks/index
Following is the method to decode b128 varint:
def ...
0
votes
1
answer
130
views
Are the block headers kept in memory?
Bitcoin Core keeps block data as files in the file system and blocks indexes in a LevelDB database to make the search process of transactions and blocks faster. But Bitcoin Core also stores block ...
- 13
0
votes
0
answers
75
views
Cannot unserialize chainstate transaction outputs after de-obfuscation
I was able to read chainstate database.
Getting the key and de-obfuscating to get a valid last block.
However, when it comes to transactions that follow after that,
I cannot de-serialize them no ...
- 101
0
votes
1
answer
189
views
Bitcoin - Level DB - Block Index - Parsing value for block hash
I am trying to read the value against block hash in level DB of Bitcoin node database - Block/index. For Genesis block, I get 88 bytes which I want to parse. I tried to follow instructions in https://...
- 29
0
votes
1
answer
181
views
Bitcoin - Read transaction details from LevelDB
I am new to LevelDB and the way BTC keeps everything in the database. I went through article How does Bitcoin read from/write to LevelDB but was not able to get to the first step -
Transaction
...
- 29
1
vote
0
answers
44
views
What is the relationship between LevelDB's cache (default 8MB) and Bitcoin's UTXO cache?
Please correct me if I am wrong.
Bitcoin uses levelDB to store UTXO set. LevelDB has a default 8MB block cache, and the Bitcoin also has a dbcache(default 450MB).
What is the relationship between the ...
- 175
6
votes
1
answer
346
views
When the UTXO in the cache is full, what strategy is used to replace one UTXO with another in the cache?
The UTXO set is stored on the disk, but some UTXOs are also stored in the cache. When validating a transaction, you need to query the UTXO pointed to by the input of the transaction. First, you go to ...
- 175
0
votes
1
answer
100
views
How does bitcoin find the block locator hashes in the leveldb database?
I am trying to understand how bitcoin core builds the list of block locator hashes needed for sendheaders and getheaders messages. I have looked on the wiki and I have seen that after the 10 most ...
3
votes
1
answer
694
views
What is in the Bitcoin Core LevelDB dbcache? Is it full records or metadata?
What is in the Bitcoin Core LevelDB dbcache? Is it full records or metadata?
This question was asked on IRC by Anonymous.
- 14.7k
0
votes
0
answers
2k
views
Error opening block database Full node
For some reason my node shutdown and now I get when restart it
Error opening block database
here my bitcoin.conf
txindex=1
reindex=1
reindex-chainstate=1
# Accept command line and JSON-RPC ...
- 960
1
vote
0
answers
215
views
What can cause the chainstate database to become corrupted?
I have written a tool that accesses the chainstate LevelDB database to get a list of UTXOs.
https://github.com/in3rsha/bitcoin-utxo-dump/blob/master/utxodump.go
The tool would originally corrupt the ...
- 2,968
1
vote
0
answers
106
views
why is bitcoind daemon occasionally stuck at `Opening LevelDB in .../.bitcoin/chainstate`despite clean shutdown
My bitcoind daemon sometimes takes an hour to go past Opening LevelDB in .../.bitcoin/chainstate
After googling a bit, i thought it was simply an unclean daemon stop causing a leveldb corruption. But ...
- 11
2
votes
1
answer
148
views
How Does Bitcoin Core Client Keep Track of Longest Chain/Strongest PoW Chains?
Bitcoin Core stores blocks in files in local disk. And it uses LevelDb to form an index on top of block storage to make it faster to retrieve a block (basically a simple key-value pair db). See this ...
- 31
2
votes
1
answer
4k
views
Bitcoind Node crashes after using -dbcache option
I've been trying to speed up my node sync by increasing the dbcache. However my node tends to crash overnight. My system is running ubuntu 18.04, 4GM of ram bitcoin core v0.18.
I've tried bitcoind -...
0
votes
1
answer
26
views
CDiskBlockIndex: NFile and NDataPos not defined
This is the source code snippet that is used for the serialization of block indexes (found in leveldb).
Block 478573 index is (as of my node's leveldb) ...
- 69
0
votes
2
answers
422
views
How to get the block hash in the chainstate leveldb?
From this link What are the keys used in the blockchain levelDB (ie what are the key:value pairs)?,
to get the block hash I use the obfuscation key and xor it with the result I get from the db. So I ...
- 50
1
vote
1
answer
892
views
How exactly do I decode the block file info in leveldb?
Base on the links
https://github.com/bitcoin/bitcoin/blob/fcbc8bfa6d10cac4f16699d6e6e68fb6eb98acd0/src/main.h#L392 and
What are the keys used in the blockchain levelDB (ie what are the key:value ...
- 50
2
votes
1
answer
345
views
How to parse values in block index leveldb?
So I'm trying to read the block files with Python.
From this link,
What are the keys used in the blockchain levelDB (ie what are the key:value pairs)?, it tells you how to access the files with ...
- 50
4
votes
1
answer
308
views
Does the chainstate leveldb only contain "addresses" for P2PKH and P2SH?
I'm writing a small script that will dump the utxo database to a text file. As far as I'm aware, these are the most common script patterns indicated by the type field inside each value:
e.g. value: ...
- 2,968
0
votes
1
answer
208
views
How does Bitcoin use its communication protocol and its database model?
In terms of Bitcoin's communication protocol, how does Bitcoin allow nodes to communicate between each other?
Is Bitcoin's communication protocol the same as IPFS(InterPlanetary File System) and if ...
- 135
1
vote
2
answers
603
views
Python - Querying bitcoin's block header using leveldb
I am facing a stupid problem. I am trying to read bitcoin/blocks/index leveldb using plyvel. I've set up a regtest and i know there is a block with the hash :
...
- 11
2
votes
1
answer
606
views
EXCEPTION: 15dbwrapper_error
I'm running Bitcoind 0.17 on a raspberry Pi 3. Everything ran smoothly until I did something wrong (I guess) but can't figure out what happened. Now I got this error. Has someone experience with this ...
- 41
1
vote
1
answer
127
views
why is bitcoin leveldb separated in so many small pieces?
Currently I could see 1418 ldb files on my box, from 210040.ldb to 215423.ldb (some missing).
Why are they separated in this way?
I want to read the leveldb using golang, but I don't know which one ...
- 121
0
votes
1
answer
154
views
How can I get the key of blockindex
According to this post: What are the keys used in the blockchain levelDB (ie what are the key:value pairs)?
One type of the keys in leveldb of bitcoin is formed in the following way
'b' + 32-byte ...
- 121
0
votes
0
answers
332
views
Get value from leveldb bitcoin using node.js?
I request information about the block 100001 using leveldb and node js.
Below is my code example.
var level = require('level');
var db = level('E:/download/blockchain/block');
var str = '...
- 314
3
votes
2
answers
413
views
Why was Bitcoin Core in need of a fork of LevelDB?
Why did Bitcoin Core fork LevelDB? What special needs does Bitcoin Core have, which require a specialized version of LevelDB?
- 10.1k
2
votes
1
answer
427
views
Why is wallet.dat BerkeleyDB instead of LevelDB?
Why wasn't wallet.dat migrated to LevelDB?
Is it because
BerkeleyDB is better at [something]
Backwards compatibility
- 10.1k
2
votes
1
answer
463
views
bitcoin chainstate database parsing in python giving wrong value
I am trying to decode chainstate db for a specific out index for a transaction in python just for learning.
Transaction ID: 4d4a4c6ca4f3c91e69563199943336d3279fad71c9e8d9c1708ef9dc6ac16000
out index = ...
1
vote
2
answers
279
views
Very hard to sync Core Client from scratch
Recently I started running a Core 15.1 node with the blockchain on an external hard drive, and found it very hard to fully sync the blockchain.
The problem I keep running into is that (in about 90% of ...
0
votes
1
answer
108
views
Trojans detected in ldb bitcoin database?
I started regular scan and clamscan found lots of trojans in bitcon.lfb blocks.
What is it? A mistake?
sudo clamscan --infected --recursive --exclude-dir="^/sys" /
/root/.bitcoin/data/blocks/index/...
- 153
0
votes
1
answer
810
views
Bitcoin blockchain in mongodb
How bad would it be to use MongoDB as a Bitcoin database instead of LevelDB? I know that LevelDB is faster but I've also read that MongoDB is better for doing queries.
It seems cleaner to store the ...
4
votes
3
answers
1k
views
Format of a block key's contents in bitcoind's LevelDB?
I am trying to use bitcoind's LevelDB block index files (that are stored in blocks/index) to find the file (e.g. blk00029.dat) and byte position of specfic blocks.
Thanks to questions What is the ...
- 143
2
votes
0
answers
520
views
How to delete last n blocks / roll back to specific block number in Bitcoin Core? (Like `monero-blockchain-import --pop-blocks n`)
I have Bitcoin Core's bitcoind running and synced in a VM. Now I want to clone the VM and run one of the various hard forks (such as Bitcoin Cash) in the clone. The plan is to roll back my copy of the ...
- 21
0
votes
2
answers
444
views
How does bitcoind store blocks?
I want to parse blockchain manually and extract the UTXO set (for various reasons). Is there any way to understand how the blocks are stored without going through the C++ code?
Some specs will be ...
- 1,365
1
vote
2
answers
271
views
Non-obfuscated chainstate data
I'm wondering if there is a flag that allows running bitcoind without using an obfuscation key for the chainstate. I haven't been able to find it.
- 3,192
2
votes
1
answer
283
views
Chainstate Bitcoin Core 0.15
Recently updated my LevelDB parser to work with the new LevelDB 0.15 internal structure. However, I'm wondering about two small changes I found:
The prefix for transactions was changed from b'c' to b'...
- 3,192
-2
votes
1
answer
637
views
how to build altcoin in mingw?
OS : Windows 10
Installed Dependencies:
-qt4.8.6
gcc 6.3.0
boost 1_55_0
berkeleyDB 4.8.30NC
openssl 1.0.2l
I tried compiling with the following commands:
qmake "USE_UPNP=1" coin-pt.pro
mingw32-...
2
votes
1
answer
325
views
What will happen when the blockchain size will reach 1 Tb? Or 10 Tb?
My question is more about bitcoin client (bitcoind). Will it still be working fine or maybe something will go wrong? I mean, maybe LevelDB can't handle this amount of data correctly?
- 337
2
votes
1
answer
238
views
Bcoin - Database backend not found
/root/BCoin/node_modules/bcoin/lib/db/backends.js:16
throw new Error('Database backend "' + name + '" not found.');
^
Error: Database backend "leveldown" not found.
at Object.get (/root/...
- 70
2
votes
1
answer
201
views
Resyncing bcoin brings up database version error
I was resyncing my bcoin node and got the following error:
Error: Warning: Your database does not match the current database version.
This is likely because the database layout or serialization ...
- 183
4
votes
1
answer
2k
views
In which order does the leveldb iterator iterate over utxos?
I would like to know in which order the leveldb iterator iterates over the chainstate entries. I aim to serialize the chainstate and have to make sure that every node can calculate exactly the same ...
user50317
3
votes
1
answer
2k
views
Chainstate LevelDB corruption after reading from the database
I've been working with the LevelDB for a few weeks, coding some tools to access the database and parse the data to be human readable.
However, every single time I read from the chainstate the data ...
- 3,192
3
votes
2
answers
697
views
CVarint serialization format
Recently I started analyzing the UTXO set data that every full node stores in chainstate folder (a LevelDB database).
By looking into the code you can learn more or less how the data entries are ...
- 3,192
22
votes
1
answer
6k
views
Migration from Berkeley DB to LevelDB
In 2013 a new bitcoin core was released and one of the supposed improvement was migrating from Berkeley DB to LevelDB. According to the release notes at bitcoin.org:
LevelDB, a fast, open-source, ...
- 524
1
vote
1
answer
295
views
How does the wallet know which outputs are available with LevelDB
So, I found that in the original Bitcoin client there was a member variable vSpent in the class CWalletTX, however it appears that this is no longer the case in the new version. I know that the new ...
- 647
24
votes
1
answer
11k
views
How does Bitcoin read from/write to LevelDB
I know that Bitcoin Core uses LevelDB since 0.8 version. However, I couldn't find detailed explanation about how Bitcoin stores and retrieves from LevelDB. E.g. If B transaction uses an output from ...
- 647