shield_evm_behavioral_memory_sepolia

Oliverknowledge

v0.1.0/1 downloads/Repository

Package ref

shield-evm-behavioral-memory-sepolia@v0.1.0

Download .spkg

Run package

CLI

Run map_behavioral_profiles from the command line.

substreams run shield-evm-behavioral-memory-sepolia@v0.1.0 map_behavioral_profiles -e sepolia

Authenticate by running substreams auth or directly on thegraph.market (see docs).

README

Shield behavioural memory — EVM Substreams

The same five-module pipeline as ../substreams (Solana), for ShieldVault.sol on HyperEVM or any EVM chain, composed on The Graph's foundational ethereum-common@v0.3.3 package: its index_events block index filters both maps by evt_addr: (the vault contract and native USDC) so blocks with no relevant log are skipped before decoding.

map_shield_events       Block ⨯ index_events(params) -> ShieldEvents      typed ShieldVault events (Abigen)
store_vault_registry    set   exec:<vault>:<owner> -> 1|0                   which addresses are trading wallets
map_vault_flows         Block ⨯ events ⨯ registry -> VaultFlows            boundary crossings incl. USDC returns
store_flow_totals       add   sent/returned/deposited/topups/returns per vault
map_behavioral_profiles deltas -> BehavioralProfiles

Build: substreams build (Rust + wasm32 target; Foundry's ABI is copied to abi/ShieldVault.json). Run against The Graph Market with the shared JWT in .env (SUBSTREAMS_API_TOKEN; endpoint SUBSTREAMS_HYPEREVM_ENDPOINT, default hyperevm.substreams.pinax.network:443, HyperEVM mainnet only):

bun run substreams:hyperevm                  # last 20 blocks, proves auth + package load
bun run substreams:hyperevm <deploy block> +200   # with EVM_CHAIN_ID=999, SHIELD_VAULT_ADDRESS, USDC_ADDRESS set
# equivalent raw CLI:
SUBSTREAMS_API_TOKEN=<jwt> substreams run substreams.yaml map_vault_flows \
  -e hyperevm.substreams.pinax.network:443 -s <vault deploy block> -t +200 \
  -p map_shield_events="evt_addr:<vault>" \
  -p map_vault_flows="evt_addr:<vault> || evt_addr:<native usdc>"

The package passes substreams registry verify; publishing it as a reusable module on substreams.dev is substreams registry login && substreams registry publish from this directory (a human step: it needs a substreams.dev account).

server/evm-index.ts consumes the same module through @substreams/core when EVM_CHAIN_ID=999 and the JWT is set (/api/health → source.mode: "substreams").

Output Flow messages carry the same fields the Solana package emits, so server/behaviour.ts, server/policy.ts and the Chainlink CRE workflow consume either chain's stream unchanged: one pipeline shape, reused across chains.

Modules

Execution graph

7 modules

mapMain

map_behavioral_profiles

from #11654048

Output

shield.evm.v1.BehavioralProfiles

Inputs

store_flow_totals

map

map_shield_events

from #11654048

Output

shield.evm.v1.ShieldEvents

Inputs

paramssf.ethereum.type.v2.Block

map

map_vault_flows

from #11654048

Output

shield.evm.v1.VaultFlows

Inputs

paramssf.ethereum.type.v2.Block map_shield_events store_vault_registry

store

store_flow_totals

from #11654048

Store value

int64

Update policy

add

Inputs

map_vault_flows

store

store_vault_registry

from #11654048

Store value

string

Update policy

set

Inputs

map_shield_events

Show 2 dependencies

map

ethereum_common:all_events

`all_events` gives you all the events in a block (from successful transactions), with basic block hash/number/timestamp and transaction hash

Output

sf.substreams.ethereum.v1.Events

Inputs

sf.ethereum.type.v2.Block

blockIndex

ethereum_common:index_events

`index_events` sets the following keys on the block: * Event signatures evt_sig:0x0123456789abcdef0123456789abcdef0123456789abcdef0123456789abcdef (signature in hex, prefixed by 0x) * Event address evt_addr:0x0123456789abcdef0123456789abcdef01234567 (address in hex, prefixed by 0x)

Output

sf.substreams.index.v1.Keys

Inputs

ethereum_common:all_events

Protobuf

shield.evm.v1

BehavioralProfilesmain

shield.evm.v1.BehavioralProfiles

BehavioralProfile[]profiles = 1

ShieldEventsmain

shield.evm.v1.ShieldEvents

Typed ShieldVault.sol events (one message per log we care about).

ShieldEvent[]events = 1

VaultFlowsmain

shield.evm.v1.VaultFlows

Flow[]flows = 1

BehavioralProfile

shield.evm.v1.BehavioralProfile

stringvault = 1

uint64sent_to_execution = 2

uint64returned_from_execution = 3

int64net_execution_flow = 4

uint64deposited = 5

uint64top_up_count = 6

uint64return_count = 7

Flow

shield.evm.v1.Flow

uint64block = 1

uint64block_time = 2

stringtx_hash = 3

stringvault = 4

FlowKindkind = 5

booloutbound = 6

stringcounterparty = 7

uint64amount = 8

USDC base units (6 decimals)

boolcounterparty_is_execution = 9

ShieldEvent

shield.evm.v1.ShieldEvent

uint64block = 1

uint64block_time = 2

stringtx_hash = 3

uint32log_index = 4

stringvault = 5

authority address (lowercase hex)

stringname = 6

Deposited, TopUpExecuted, RegistrationChanged, ...

map<string, string>fields = 7

flat, stringly-typed fields so the schema is stable across versions

FlowKindenum

shield.evm.v1.FlowKind

FLOW_KIND_UNSPECIFIED = 0

TOP_UP_INSTANT = 1

TOP_UP_GATED = 2

COLD_TRANSFER = 3

FULL_EXIT = 4

RETURN = 5

DEPOSIT = 6

Show 48 dependencies

schema

ClickhouseIndexField

schema.ClickhouseIndexField

ClickhouseIndexField defines a secondary index for improved query performance. Secondary indexes help ClickHouse skip irrelevant data blocks during query execution.

stringname = 1

The name of the index (must be unique within the table)

stringfield_name = 2

The field name on which to create the index

IndexTypetype = 3

The type of index to create (e.g., minmax, bloom_filter, set)

uint32granularity = 4

The granularity parameter that controls index density (higher = less memory, lower precision)

Functionfunction = 5

Optional function to apply to the field value before indexing

ClickhouseOrderByField

schema.ClickhouseOrderByField

ClickhouseOrderByField defines a field used in the ClickHouse table ORDER BY clause. ORDER BY determines the physical storage order of data for optimal compression and query performance.

stringname = 1

The name of the field to include in the ORDER BY clause

booldescending = 2

Whether to sort this field in descending order (default is ascending)

Functionfunction = 3

Optional function to apply to the field value before ordering (e.g., toDate for timestamps)

ClickhousePartitionByField

schema.ClickhousePartitionByField

ClickhousePartitionByField defines a field used for ClickHouse table partitioning. Partitioning splits data into separate parts based on the specified field values.

stringname = 1

The name of the field to use for partitioning

Functionfunction = 2

Optional function to apply to the field value before partitioning (e.g., toYYYYMM for dates)

ClickhouseTableOptions

schema.ClickhouseTableOptions

ClickhouseTableOptions defines ClickHouse-specific table configuration options. These options are used to configure ClickHouse table engines and optimize query performance.

ClickhouseOrderByField[]order_by_fields = 1

Fields to use for the ORDER BY clause in ClickHouse table definition. ORDER BY determines the physical ordering of data on disk for better compression and query performance.

ClickhousePartitionByField[]partition_fields = 2

Fields to use for table partitioning in ClickHouse. Partitioning helps with query performance and data management by splitting data into logical parts.

ClickhouseIndexField[]index_fields = 4

Secondary indexes to create for improved query performance on specific columns. These are data skipping indexes that help ClickHouse skip irrelevant data blocks during queries.

Column

schema.Column

Column defines metadata for mapping a protobuf field to a database column. This message is used with the (field) extension on protobuf fields.

stringname = 1

Custom column name. If not specified, the field name is used.

stringforeign_key = 2

Foreign key reference to another table's column in the format "table.column". Used to establish referential integrity constraints in relational databases.

boolunique = 3

Whether this column should have a unique constraint. Ensures no duplicate values exist for this column.

boolprimary_key = 4

Whether this column is part of the primary key. Primary key columns are automatically non-null and unique.

StringConvertionconvertTo = 5

Specifies how to convert string fields to specific numeric types. Only applies to string fields that contain numeric data. Leave unset for no conversion (store as string).

boolinline = 6

Decimal128

schema.Decimal128

Decimal128 represents a 128-bit decimal type for string conversion. Used in StringConvertion to specify that a string field should be converted to Decimal128.

int32scale = 1

The number of digits after the decimal point for this decimal type.

Decimal256

schema.Decimal256

Decimal256 represents a 256-bit decimal type for string conversion. Used in StringConvertion to specify that a string field should be converted to Decimal256.

int32scale = 1

The number of digits after the decimal point for this decimal type.

Int128

schema.Int128

Int128 represents a 128-bit signed integer type for string conversion. Used in StringConvertion to specify that a string field should be converted to Int128.

No fields.

Int256

schema.Int256

Int256 represents a 256-bit signed integer type for string conversion. Used in StringConvertion to specify that a string field should be converted to Int256.

No fields.

StringConvertion

schema.StringConvertion

StringConvertion defines how string fields should be converted to specific numeric types. This is used when protobuf string fields contain numeric data that should be stored as native numeric types in the database for better performance and storage efficiency. Usage: Set this in Column.convertTo field to specify the target numeric type.

Int128int128 = 2oneof convertion

Convert string to 128-bit signed integer

UInt128uint128 = 3oneof convertion

Convert string to 128-bit unsigned integer

Int256int256 = 4oneof convertion

Convert string to 256-bit signed integer

UInt256uint256 = 6oneof convertion

Convert string to 256-bit unsigned integer

Decimal128decimal128 = 50oneof convertion

Convert string to 128-bit decimal with specified scale

Decimal256decimal256 = 51oneof convertion

Convert string to 256-bit decimal with specified scale

Table

schema.Table

Table defines metadata for mapping a protobuf message to a database table. This message is used with the (table) extension on protobuf messages.

stringname = 1

The name of the database table. If not specified, the message name is used.

stringchild_of = 2

Optional field to specify a parent table for establishing table relationships. Used for creating foreign key relationships in relational databases.

ClickhouseTableOptionsclickhouse_table_options = 200

ClickHouse-specific table options for configuring table engine parameters. Only applicable when using ClickHouse as the target database.

UInt128

schema.UInt128

UInt128 represents a 128-bit unsigned integer type for string conversion. Used in StringConvertion to specify that a string field should be converted to UInt128.

No fields.

UInt256

schema.UInt256

UInt256 represents a 256-bit unsigned integer type for string conversion. Used in StringConvertion to specify that a string field should be converted to UInt256.

No fields.

Functionenum

schema.Function

unset = 0

No function applied (use raw field value)

toYYYYMM = 1

Convert date/timestamp to YYYYMM format (useful for monthly partitioning)

toYYYYDD = 2

Convert date/timestamp to YYYYDD format (useful for daily partitioning)

toYear = 3

Extract year from date/timestamp (useful for yearly partitioning)

toMonth = 4

Extract month from date/timestamp (useful for monthly grouping)

toDate = 5

Convert timestamp to date (removes time component)

toStartOfMonth = 6

Convert date to first day of the month (useful for monthly aggregations)

IndexTypeenum

schema.IndexType

minmax = 0

MinMax index stores minimum and maximum values for each granule (fastest, least memory)

set = 1

Set index stores unique values for each granule (good for low cardinality fields)

ngrambf_v1 = 2

N-gram Bloom filter index for substring searches (good for text search)

tokenbf_v1 = 3

Token Bloom filter index for full-word searches (good for tokenized text)

bloom_filter = 4

Bloom filter index for equality checks (good for high cardinality fields)

sf.ethereum.substreams.v1

RpcCall

sf.ethereum.substreams.v1.RpcCall

bytesto_addr = 1

bytesdata = 2

RpcCalls

sf.ethereum.substreams.v1.RpcCalls

RpcCall[]calls = 1

RpcResponse

sf.ethereum.substreams.v1.RpcResponse

bytesraw = 1

boolfailed = 2

RpcResponses

sf.ethereum.substreams.v1.RpcResponses

RpcResponse[]responses = 1

sf.ethereum.transform.v1

CallToFilter

sf.ethereum.transform.v1.CallToFilter

bytes[]addresses = 1

bytes[]signatures = 2

CombinedFilter

sf.ethereum.transform.v1.CombinedFilter

LogFilter[]log_filters = 1

CallToFilter[]call_filters = 2

boolsend_all_block_headers = 3

HeaderOnly

sf.ethereum.transform.v1.HeaderOnly

No fields.

LogFilter

sf.ethereum.transform.v1.LogFilter

bytes[]addresses = 1

bytes[]event_signatures = 2

MultiCallToFilter

sf.ethereum.transform.v1.MultiCallToFilter

CallToFilter[]call_filters = 1

MultiLogFilter

sf.ethereum.transform.v1.MultiLogFilter

LogFilter[]log_filters = 1

sf.ethereum.type.v2

BlockRef

sf.ethereum.type.v2.BlockRef

byteshash = 1

uint64number = 2

BlockWithRefs

sf.ethereum.type.v2.BlockWithRefs

stringid = 1

Blockblock = 2

TransactionRefstransaction_trace_refs = 3

boolirreversible = 4

HeaderOnlyBlock

sf.ethereum.type.v2.HeaderOnlyBlock

BlockHeaderheader = 5

TransactionRefs

sf.ethereum.type.v2.TransactionRefs

bytes[]hashes = 1

TransactionTraceWithBlockRef

sf.ethereum.type.v2.TransactionTraceWithBlockRef

TransactionTracetrace = 1

BlockRefblock_ref = 2

Reasonenum

sf.ethereum.type.v2.BalanceChange.Reason

REASON_UNKNOWN = 0

REASON_REWARD_MINE_UNCLE = 1

REASON_REWARD_MINE_BLOCK = 2

REASON_DAO_REFUND_CONTRACT = 3

REASON_DAO_ADJUST_BALANCE = 4

REASON_TRANSFER = 5

REASON_GENESIS_BALANCE = 6

REASON_GAS_BUY = 7

REASON_REWARD_TRANSACTION_FEE = 8

REASON_REWARD_FEE_RESET = 14

REASON_GAS_REFUND = 9

REASON_TOUCH_ACCOUNT = 10

REASON_SUICIDE_REFUND = 11

REASON_SUICIDE_WITHDRAW = 13

REASON_CALL_BALANCE_OVERRIDE = 12

REASON_BURN = 15

REASON_WITHDRAWAL = 16

REASON_REWARD_BLOB_FEE = 17

REASON_INCREASE_MINT = 18

REASON_REVERT = 19

DetailLevelenum

sf.ethereum.type.v2.Block.DetailLevel

DETAILLEVEL_EXTENDED = 0

DETAILLEVEL_BASE = 2

CallTypeenum

sf.ethereum.type.v2.CallType

UNSPECIFIED = 0

CALL = 1

CALLCODE = 2

DELEGATE = 3

STATIC = 4

CREATE = 5

Reasonenum

sf.ethereum.type.v2.GasChange.Reason

REASON_UNKNOWN = 0

REASON_CALL = 1

REASON_CALL_CODE = 2

REASON_CALL_DATA_COPY = 3

REASON_CODE_COPY = 4

REASON_CODE_STORAGE = 5

REASON_CONTRACT_CREATION = 6

REASON_CONTRACT_CREATION2 = 7

REASON_DELEGATE_CALL = 8

REASON_EVENT_LOG = 9

REASON_EXT_CODE_COPY = 10

REASON_FAILED_EXECUTION = 11

REASON_INTRINSIC_GAS = 12

REASON_PRECOMPILED_CONTRACT = 13

REASON_REFUND_AFTER_EXECUTION = 14

REASON_RETURN = 15

REASON_RETURN_DATA_COPY = 16

REASON_REVERT = 17

REASON_SELF_DESTRUCT = 18

REASON_STATIC_CALL = 19

REASON_STATE_COLD_ACCESS = 20

REASON_TX_INITIAL_BALANCE = 21

REASON_TX_REFUNDS = 22

REASON_TX_LEFT_OVER_RETURNED = 23

REASON_CALL_INITIAL_BALANCE = 24

REASON_CALL_LEFT_OVER_RETURNED = 25

REASON_WITNESS_CONTRACT_INIT = 26

REASON_WITNESS_CONTRACT_CREATION = 27

REASON_WITNESS_CODE_CHUNK = 28

REASON_WITNESS_CONTRACT_COLLISION_CHECK = 29

REASON_TX_DATA_FLOOR = 30

Typeenum

sf.ethereum.type.v2.TransactionTrace.Type

TRX_TYPE_LEGACY = 0

TRX_TYPE_ACCESS_LIST = 1

TRX_TYPE_DYNAMIC_FEE = 2

TRX_TYPE_BLOB = 3

TRX_TYPE_SET_CODE = 4

TRX_TYPE_ARBITRUM_DEPOSIT = 100

TRX_TYPE_ARBITRUM_UNSIGNED = 101

TRX_TYPE_ARBITRUM_CONTRACT = 102

TRX_TYPE_ARBITRUM_RETRY = 104

TRX_TYPE_ARBITRUM_SUBMIT_RETRYABLE = 105

TRX_TYPE_ARBITRUM_INTERNAL = 106

TRX_TYPE_ARBITRUM_LEGACY = 120

TRX_TYPE_OPTIMISM_DEPOSIT = 126

TransactionTraceStatusenum

sf.ethereum.type.v2.TransactionTraceStatus

UNKNOWN = 0

SUCCEEDED = 1

FAILED = 2

REVERTED = 3

sf.firehose.v2

BlockMetadata

sf.firehose.v2.BlockMetadata

uint64num = 1

Num is the block number of this response's block.

stringid = 2

ID is the block ID of this response's block. The ID actual representation is chain specific.

Antelope & Ethereum uses hex.
NEAR & Solana uses base58.

Refer to the chain documentation for more details.

uint64parent_num = 3

ParentNum is the block number of the parent of this response's block

stringparent_id = 4

ParentID is the block ID of the parent of this response's block. If this response is the genesis block, this field is empty.

The ID actual representation is chain specific.

Antelope & Ethereum uses hex.
NEAR & Solana uses base58.

Refer to the chain documentation for more details.

uint64lib_num = 5

LibNum is the block number of the last irreversible block (a.k.a last finalized block) at the time of this response' block. It determines the finality of the block.

Timestamptime = 6

Time is the time at which the block was produced.

InfoRequest

sf.firehose.v2.InfoRequest

No fields.

InfoResponse

sf.firehose.v2.InfoResponse

stringchain_name = 1

Canonical chain name from https://thegraph.com/docs/en/developing/supported-networks/ (ex: matic, mainnet ...)

string[]chain_name_aliases = 2

Alternate names for the chain.

uint64first_streamable_block_num = 3

First block that is served by this endpoint. This should usually be the genesis block, but some providers may have truncated history.

stringfirst_streamable_block_id = 4

InfoResponse.BlockIdEncodingblock_id_encoding = 5

This informs the client on how to decode the block_id field inside the "Clock" message as well as the first_streamable_block_id above.

string[]block_features = 10

features describes the blocks. Popular values for EVM chains include base, extended or hybrid.

Request

sf.firehose.v2.Request

int64start_block_num = 1

Controls where the stream of blocks will start.

The stream will start inclusively at the requested block num.

When not provided, starts at first streamable block of the chain. Not all chain starts at the same block number, so you might get an higher block than requested when using default value of 0.

Can be negative, will be resolved relative to the chain head block, assuming a chain at head block #100, then using -50 as the value will start at block #50. If it resolves before first streamable block of chain, we assume start of chain.

If start_cursor is given, this value is ignored and the stream instead starts immediately after the Block pointed by the opaque start_cursor value.

stringcursor = 2

Controls where the stream of blocks will start which will be immediately after the Block pointed by this opaque cursor.

Obtain this value from a previously received Response.cursor.

This value takes precedence over start_block_num.

uint64stop_block_num = 3

When non-zero, controls where the stream of blocks will stop.

The stream will close after that block has passed so the boundary is inclusive.

boolfinal_blocks_only = 4

With final_block_only, you only receive blocks with STEP_FINAL Default behavior will send blocks as STEP_NEW, with occasional STEP_UNDO

Any[]transforms = 10

Response

sf.firehose.v2.Response

Anyblock = 1

Chain specific block payload, ex:

sf.eosio.type.v1.Block
sf.ethereum.type.v1.Block
sf.near.type.v1.Block

ForkStepstep = 6

stringcursor = 10

BlockMetadatametadata = 12

Metadata about the block, added in some Firehose version, so consumer should be ready to handle the absence of this field.

SingleBlockRequest

sf.firehose.v2.SingleBlockRequest

SingleBlockRequest.BlockNumberblock_number = 3oneof reference

SingleBlockRequest.BlockHashAndNumberblock_hash_and_number = 4oneof reference

SingleBlockRequest.Cursorcursor = 5oneof reference

Any[]transforms = 6

BlockHashAndNumber

sf.firehose.v2.SingleBlockRequest.BlockHashAndNumber

Get the current block with specific hash and number

uint64num = 1

stringhash = 2

BlockNumber

sf.firehose.v2.SingleBlockRequest.BlockNumber

Get the current known canonical version of a block at with this number

uint64num = 1

Cursor

sf.firehose.v2.SingleBlockRequest.Cursor

Get the block that generated a specific cursor

stringcursor = 1

SingleBlockResponse

sf.firehose.v2.SingleBlockResponse

Anyblock = 1

BlockMetadatametadata = 2

Metadata about the block, added in some Firehose version, so consumer should be ready to handle the absence of this field.

ForkStepenum

sf.firehose.v2.ForkStep

STEP_UNSET = 0

STEP_NEW = 1

Incoming block

STEP_UNDO = 2

A reorg caused this specific block to be excluded from the chain

STEP_FINAL = 3

Block is now final and can be committed (finality is chain specific, see chain documentation for more details)

BlockIdEncodingenum

sf.firehose.v2.InfoResponse.BlockIdEncoding

BLOCK_ID_ENCODING_UNSET = 0

BLOCK_ID_ENCODING_HEX = 1

BLOCK_ID_ENCODING_0X_HEX = 2

BLOCK_ID_ENCODING_BASE58 = 3

BLOCK_ID_ENCODING_BASE64 = 4

BLOCK_ID_ENCODING_BASE64URL = 5