Fork a local node

[marcello33]

Hi all,

I have a running Ethereum goerli node on my linux system, with its HTTP server on default port localhost:8545
For testing reasons, and given the deprecation of goerli, I'd like to keep that state and fork the chain using hardhat.

My goeli node is completely synced

~/ethereum/execution/data$ geth attach geth.ipc
Welcome to the Geth JavaScript console!

instance: Geth/v1.13.14-stable-2bd6bd01/linux-amd64/go1.21.6
at block: 10666634 (Mon Mar 18 2024 04:16:12 GMT+0000 (UTC))
 datadir: /home/ubuntu/ethereum/execution/data
 modules: admin:1.0 clique:1.0 debug:1.0 engine:1.0 eth:1.0 miner:1.0 net:1.0 rpc:1.0 txpool:1.0 web3:1.0

To exit, press ctrl-d or type exit
> eth.syncing
false

And responding to requests

curl -i -X POST -H "Content-Type: application/json" --data '{"jsonrpc":"2.0","method":"eth_getBalance","params":["0xF02c1c8e6114b1Dbe8937a39260b5b0a374432bB","latest"],"id":1}' "http://localhost:8545"
HTTP/1.1 200 OK
Content-Type: application/json
Date: Fri, 19 Apr 2024 12:08:25 GMT
Content-Length: 54

{"jsonrpc":"2.0","id":1,"result":"0x27bef8d36cba710"}

I am running hardhat version v2.22.3

npx hardhat --version
2.22.3

And I initialized a hardhat project with npx hardhat init and have this configs file:

~/ethereum/shadow-fork$ cat hardhat.config.js
require("@nomicfoundation/hardhat-toolbox");

/** @type import('hardhat/config').HardhatUserConfig */
module.exports = {
  solidity: "0.8.24",
};

Since the node is running on localhost, together with the --fork option, I believe I also have to specify the hostname (which is still gonna be my local machine, hence 127.0.0.1), and a new port (to avoid it to default to 8545, where the original testnet goerli node is running, hence 9545).
However, when I try to fork it, with the following command
npx hardhat node --fork http://127.0.0.1:8545 --hostname 127.0.0.1 --port 9545
I get this error:

~/ethereum/shadow-fork$ npx hardhat node --fork http://127.0.0.1:8545 --hostname 127.0.0.1 --port 9545
Error HH604: Error running JSON-RPC server: The response reported error `-32000`: `missing trie node 1ba7b82936c32337a20a83663fca07030149a7bd0049c113e59740201d255f16 (path ) state 0x1ba7b82936c32337a20a83663fca07030149a7bd0049c113e59740201d255f16 is not available, not found`. (optional data: None). Request: [{"id":4,"jsonrpc":"2.0","method":"eth_getBalance","params":["0x3c44cdddb6a900fa2b585dd299e03d12fa4293bc","0xa2c26a"]},{"id":5,"jsonrpc":"2.0","method":"eth_getTransactionCount","params":["0x3c44cdddb6a900fa2b585dd299e03d12fa4293bc","0xa2c26a"]},{"id":6,"jsonrpc":"2.0","method":"eth_getCode","params":["0x3c44cdddb6a900fa2b585dd299e03d12fa4293bc","0xa2c26a"]}]

HardhatError: HH604: Error running JSON-RPC server: The response reported error `-32000`: `missing trie node 1ba7b82936c32337a20a83663fca07030149a7bd0049c113e59740201d255f16 (path ) state 0x1ba7b82936c32337a20a83663fca07030149a7bd0049c113e59740201d255f16 is not available, not found`. (optional data: None). Request: [{"id":4,"jsonrpc":"2.0","method":"eth_getBalance","params":["0x3c44cdddb6a900fa2b585dd299e03d12fa4293bc","0xa2c26a"]},{"id":5,"jsonrpc":"2.0","method":"eth_getTransactionCount","params":["0x3c44cdddb6a900fa2b585dd299e03d12fa4293bc","0xa2c26a"]},{"id":6,"jsonrpc":"2.0","method":"eth_getCode","params":["0x3c44cdddb6a900fa2b585dd299e03d12fa4293bc","0xa2c26a"]}]
    at SimpleTaskDefinition.action (/home/ubuntu/ethereum/shadow-fork/node_modules/hardhat/src/builtin-tasks/node.ts:372:17)
    at Environment._runTaskDefinition (/home/ubuntu/ethereum/shadow-fork/node_modules/hardhat/src/internal/core/runtime-environment.ts:359:14)
    at Environment.run (/home/ubuntu/ethereum/shadow-fork/node_modules/hardhat/src/internal/core/runtime-environment.ts:192:14)
    at main (/home/ubuntu/ethereum/shadow-fork/node_modules/hardhat/src/internal/cli/cli.ts:323:7)

    Caused by: ProviderError: The response reported error `-32000`: `missing trie node 1ba7b82936c32337a20a83663fca07030149a7bd0049c113e59740201d255f16 (path ) state 0x1ba7b82936c32337a20a83663fca07030149a7bd0049c113e59740201d255f16 is not available, not found`. (optional data: None). Request: [{"id":4,"jsonrpc":"2.0","method":"eth_getBalance","params":["0x3c44cdddb6a900fa2b585dd299e03d12fa4293bc","0xa2c26a"]},{"id":5,"jsonrpc":"2.0","method":"eth_getTransactionCount","params":["0x3c44cdddb6a900fa2b585dd299e03d12fa4293bc","0xa2c26a"]},{"id":6,"jsonrpc":"2.0","method":"eth_getCode","params":["0x3c44cdddb6a900fa2b585dd299e03d12fa4293bc","0xa2c26a"]}]
        at EdrProviderWrapper.request (/home/ubuntu/ethereum/shadow-fork/node_modules/hardhat/src/internal/hardhat-network/provider/provider.ts:430:19)
        at SimpleTaskDefinition.action (/home/ubuntu/ethereum/shadow-fork/node_modules/hardhat/src/builtin-tasks/node.ts:146:9)
        at Environment._runTaskDefinition (/home/ubuntu/ethereum/shadow-fork/node_modules/hardhat/src/internal/core/runtime-environment.ts:359:14)
        at Environment.run (/home/ubuntu/ethereum/shadow-fork/node_modules/hardhat/src/internal/core/runtime-environment.ts:192:14)
        at SimpleTaskDefinition.action (/home/ubuntu/ethereum/shadow-fork/node_modules/hardhat/src/builtin-tasks/node.ts:303:44)
        at Environment._runTaskDefinition (/home/ubuntu/ethereum/shadow-fork/node_modules/hardhat/src/internal/core/runtime-environment.ts:359:14)
        at Environment.run (/home/ubuntu/ethereum/shadow-fork/node_modules/hardhat/src/internal/core/runtime-environment.ts:192:14)
        at main (/home/ubuntu/ethereum/shadow-fork/node_modules/hardhat/src/internal/cli/cli.ts:323:7)

Am I doing something wrong here? Can anyone please help?
Thank you

[ItsNickBarry]

I believe regular nodes allow forking of the latest 256 blocks, but you'll need an archive node to fork anything older than that.

[marcello33]

Uhm, ok, I was able to fork it using foundry apparently

[ItsNickBarry]

Maybe foundry is defaulting to latest block, but Hardhat was set to fork from an older block?

[alcuadrado]

I think this is a bug in our end. Without specifying any block, it should pick a recent one, and it should work.

[marcello33]

I mean, this is a node I started and synced from scratch, and with foundry I was able to keep the whole state (I can query for years-old bocks). Not sure what went wrong with hardhat tho

[fvictorio]

@marcello33 this is very hackish, but if you open node_modules/hardhat/internal/hardhat-network/provider/utils/makeForkClient.js and add a bunch of console.logs, we'll be able to check if the problem is that it's using a block that is too old. Something like this:

    const networkId = await getNetworkId(forkProvider);
    console.log({ networkId })
    const actualMaxReorg = (0, reorgs_protection_1.getLargestPossibleReorg)(networkId);
    console.log({ actualMaxReorg })
    const maxReorg = actualMaxReorg ?? reorgs_protection_1.FALLBACK_MAX_REORG;
    console.log({ maxReorg })
    const latestBlockNumber = await getLatestBlockNumber(forkProvider);
    console.log({ latestBlockNumber })
    const lastSafeBlockNumber = getLastSafeBlockNumber(latestBlockNumber, maxReorg);
    console.log({ lastSafeBlockNumber })