I found an anomaly in the block size data: block 295182. This one seems to have a way higher payload. What happened there?

Bitcoin Block Size Or is this there something wrong with my parsing? This file block does appear to be at the end of a .dat file.

Here's the code I used:

import struct
import matplotlib.pyplot as plt

blockchain_path = 'mypath/blocks'

def get_block_path(index):
    file = 'blk' + str(index).zfill(5) + '.dat'
    return blockchain_path + '/' + file

def plot(x, y, title, xlabel, ylabel):
    plt.scatter(x, y)
    plt.suptitle(title, fontsize=20)

def uint4(stream):
    return struct.unpack('I', stream.read(4))[0]

def blocks_remaining(f, i):
    cur = f.tell()
        return True
        print("End of file: blk" + str(i).zfill(5) + '.dat')
        return False

BlockHeight, BlockSize = ([] for i in range(2))
cur_block_height = -1

for i in range(0, 100):
    block_path = get_block_path(i)
    #stay with single file
    f = open(block_path, 'rb', buffering=16 * 1024 * 1024)

  #loop blocks in file
    while blocks_remaining(f, i):
        cur_block_height += 1
        magic_num = uint4(f)
        block_size = uint4(f)

        print(cur_block_height, f.tell(), magic_num, block_size)

        #append data

        #skip to next block

plot(BlockHeight, BlockSize, 'Block Size', 'block height', 'bytes')
  • Coud their be some suffix to the block files after the payload of the last block of a dat file? Apr 22, 2021 at 13:04
  • 1
    block 295182 is 149,287 byte as you can see here blockchair.com/bitcoin/block/… Apr 22, 2021 at 13:05
  • @leevancleef I'm not trusting, just verifying. I have other values. If you claim theirs is right, then where is my mistake? Apr 22, 2021 at 13:13
  • 1
    you can check it on your node with "bitcoin-cli getblock 000000000000000043759025a93fbf64c13f581fdac9e678b5bbcf5b62d42790". if I knew where your mistake is, I would have answered :) Apr 22, 2021 at 13:25
  • If I'm reading your graph correctly, your code found a block that is around 2.4 Gigabytes in size. That's too large for a valid Bitcoin block. You might want to validate magic_num == 0xD9B4BEF9 and block_size <= 1M in your code Apr 22, 2021 at 13:33


Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.