4

There are multiple entities and open-source software that crawl the Bitcoin P2P network to discover and monitor nodes for various purposes (statistics, surveys, academic papers etc.)

Some of those I am aware of:

  • btc_node_scanner
  • dsn.tm.kit.edu
  • nodes.multiven.io
  • bitnodes.earn.com
  • bitnodes.io
  1. Banning such nodes would free my connection slots for real useful nodes that actually provide consensus sourcing. But, is there any downside to banning such crawler nodes?

  2. Also, what about banning btc-seeder nodes? Would that affect negatively the health of the P2P network?


I think the ideal answer could provide the effects to two cases:

  • banning done by one user and how they are affected
  • banning done by a grand/meaningful number of users and how the overall network would be affected

Thank you

1
  • Do they actually stay connected as a peer for any significant length of time? I would have though they just came and went. Anyway, maybe you could just up your number of slots? Because I doubt these monitoring nodes use that much network bandwidth ... or do they?
    – davidbak
    Jun 6, 2021 at 23:41

1 Answer 1

1

It would be hard to specifically ban crawlers as a practical matter because there is no reliable way to differentiate them from other normal nodes. They can, in fact, just be normal nodes that are instrumented with code to collect the desired data and report it back to an aggregation system.

So then you are left with banning normal nodes. Since all of the value of running a node comes from its connectivity to the P2P network via other nodes, this would not make sense.

2
  • The groups of nodes I mentioned (bitnodes, dsn.tm.kit.edu etc.), all have public user-agents (named subver in getpeerinfo), so you can (currently) ban them easily. Although it's possible that they could (start to) pretend to be normal nodes and use Bitcoin Core's subvers instead, the core question still remains. May 6, 2021 at 20:19
  • 3
    Crawlers will most definitely start imitating real nodes if they'd be banned in this way. Jun 5, 2021 at 18:27

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.