polymarket-ctf

colindickson

v0.13.0/46 downloads/Repository

Package ref

polymarket-ctf@v0.13.0

Download .spkg

Run package

CLI

Run map_ctf_events from the command line.

substreams run polymarket-ctf@v0.13.0 map_ctf_events -e polygon --start-block -1

Authenticate by running substreams auth or directly on thegraph.market (see docs).

README

Polymarket CTF Substreams Package

Substreams package for extracting events from the Polymarket Conditional Tokens Framework (CTF) contract on Polygon.

Contract Information

Address: 0x4D97DCd97eC945f40cF65F87097ACe5EA0476045
Network: Polygon
Explorer: View on Polygonscan

Available Modules

Module	Description	Output Type
`map_ctf_events`	Extracts CTF-specific events	`proto:ctf.v1.CtfEvents`
`map_erc1155_events`	Extracts ERC-1155 token events	`proto:ctf.v1.Erc1155Events`
`map_all_events`	Extracts all CTF and ERC-1155 events	`proto:ctf.v1.AllEvents`

Quick Start

Build the WASM binary:

make build-ctf
# or
cd polymarket-ctf && substreams build

Create the Substreams package:

cd polymarket-ctf && substreams pack

Run the Substreams:

substreams run substreams.yaml map_all_events \
  --network polygon \
  --start-block -1000

Event Types

The package extracts the following event categories:

CTF Events

ConditionPreparation - New prediction market condition prepared
ConditionResolution - Condition resolved with payout numerators
PositionSplit - Collateral split into conditional positions
PositionsMerge - Conditional positions merged back to collateral
PayoutRedemption - Winning positions redeemed for collateral

ERC-1155 Events

TransferBatch - Batch transfer of tokens
TransferSingle - Single token transfer
ApprovalForAll - Approval for all operator

Dependencies

substreams: ^0.7
substreams-ethereum: ^0.11
ethabi: 17

Binary Output

Build artifacts: target/wasm32-unknown-unknown/release/polymarket_ctf.wasm

Modules

Execution graph

5 modules

mapMain

map_ctf_events

Extracts CTF-specific events (ConditionPreparation, ConditionResolution, PositionSplit, PositionsMerge, PayoutRedemption).

from #4023686

Output

polymarket.ctf.v1.CtfEvents

Inputs

sf.ethereum.type.v2.Block

map

map_all_events

Extracts all CTF and ERC-1155 events from a single pass over the CTF contract.

from #4023686

Output

polymarket.ctf.v1.AllEvents

Inputs

sf.ethereum.type.v2.Block

map

map_erc1155_events

Extracts ERC-1155 token events (TransferSingle, TransferBatch, ApprovalForAll) from the CTF contract.

from #4023686

Output

polymarket.ctf.v1.Erc1155Events

Inputs

sf.ethereum.type.v2.Block

Show 2 dependencies

map

eth_common:all_events

`all_events` gives you all the events in a block (from successful transactions), with basic block hash/number/timestamp and transaction hash

Output

sf.substreams.ethereum.v1.Events

Inputs

sf.ethereum.type.v2.Block

blockIndex

eth_common:index_events

`index_events` sets the following keys on the block: * Event signatures evt_sig:0x0123456789abcdef0123456789abcdef0123456789abcdef0123456789abcdef (signature in hex, prefixed by 0x) * Event address evt_addr:0x0123456789abcdef0123456789abcdef01234567 (address in hex, prefixed by 0x)

Output

sf.substreams.index.v1.Keys

Inputs

eth_common:all_events

Protobuf

polymarket.ctf.v1

AllEventsmain

polymarket.ctf.v1.AllEvents

AllEvents combines both CTF and ERC1155 events

CtfEventsctf_events = 1

Erc1155Eventserc1155_events = 2

CtfEventsmain

polymarket.ctf.v1.CtfEvents

CtfEvents is a collection of all CTF-specific events

ConditionPreparation[]condition_preparation = 1

ConditionResolution[]condition_resolution = 2

PositionSplit[]position_split = 3

PositionsMerge[]positions_merge = 4

PayoutRedemption[]payout_redemption = 5

Erc1155Eventsmain

polymarket.ctf.v1.Erc1155Events

Erc1155Events is a collection of all ERC1155 events

TransferSingle[]transfer_single = 1

TransferBatch[]transfer_batch = 2

ApprovalForAll[]approval_for_all = 3

ApprovalForAll

polymarket.ctf.v1.ApprovalForAll

ApprovalForAll - emitted when operator approval for all tokens is set or unset

stringaccount = 1

stringoperator = 2

boolapproved = 3

TransactionContexttx = 4

ConditionPreparation

polymarket.ctf.v1.ConditionPreparation

ConditionPreparation - emitted when a new condition is prepared

bytescondition_id = 1

stringoracle = 2

bytesquestion_id = 3

uint32outcome_slot_count = 4

TransactionContexttx = 5

ConditionResolution

polymarket.ctf.v1.ConditionResolution

ConditionResolution - emitted when a condition is resolved

bytescondition_id = 1

stringoracle = 2

bytesquestion_id = 3

uint32outcome_slot_count = 4

string[]payout_numerators = 5

TransactionContexttx = 6

PayoutRedemption

polymarket.ctf.v1.PayoutRedemption

PayoutRedemption - emitted when a payout is redeemed

stringredeemer = 1

stringcollateral_token = 2

bytesparent_collection_id = 3

bytescondition_id = 4

string[]index_sets = 5

stringpayout = 6

TransactionContexttx = 7

PositionsMerge

polymarket.ctf.v1.PositionsMerge

PositionsMerge - emitted when positions are merged

stringstakeholder = 1

stringcollateral_token = 2

bytesparent_collection_id = 3

bytescondition_id = 4

string[]partition = 5

stringamount = 6

TransactionContexttx = 7

PositionSplit

polymarket.ctf.v1.PositionSplit

PositionSplit - emitted when a position is split

stringstakeholder = 1

stringcollateral_token = 2

bytesparent_collection_id = 3

bytescondition_id = 4

string[]partition = 5

stringamount = 6

TransactionContexttx = 7

TransactionContext

polymarket.ctf.v1.TransactionContext

TransactionContext contains metadata about the transaction and log entry

stringtx_hash = 1

uint64log_index = 2

uint64block_number = 3

uint64timestamp = 4

TransferBatch

polymarket.ctf.v1.TransferBatch

TransferBatch - emitted when a batch of ERC1155 tokens is transferred

stringoperator = 1

stringfrom = 2

stringto = 3

string[]ids = 4

string[]values = 5

TransactionContexttx = 6

TransferSingle

polymarket.ctf.v1.TransferSingle

TransferSingle - emitted when a single ERC1155 token is transferred

stringoperator = 1

stringfrom = 2

stringto = 3

stringid = 4

stringvalue = 5

TransactionContexttx = 6

Show 48 dependencies

schema

ClickhouseIndexField

schema.ClickhouseIndexField

ClickhouseIndexField defines a secondary index for improved query performance. Secondary indexes help ClickHouse skip irrelevant data blocks during query execution.

stringname = 1

The name of the index (must be unique within the table)

stringfield_name = 2

The field name on which to create the index

IndexTypetype = 3

The type of index to create (e.g., minmax, bloom_filter, set)

uint32granularity = 4

The granularity parameter that controls index density (higher = less memory, lower precision)

Functionfunction = 5

Optional function to apply to the field value before indexing

ClickhouseOrderByField

schema.ClickhouseOrderByField

ClickhouseOrderByField defines a field used in the ClickHouse table ORDER BY clause. ORDER BY determines the physical storage order of data for optimal compression and query performance.

stringname = 1

The name of the field to include in the ORDER BY clause

booldescending = 2

Whether to sort this field in descending order (default is ascending)

Functionfunction = 3

Optional function to apply to the field value before ordering (e.g., toDate for timestamps)

ClickhousePartitionByField

schema.ClickhousePartitionByField

ClickhousePartitionByField defines a field used for ClickHouse table partitioning. Partitioning splits data into separate parts based on the specified field values.

stringname = 1

The name of the field to use for partitioning

Functionfunction = 2

Optional function to apply to the field value before partitioning (e.g., toYYYYMM for dates)

ClickhouseTableOptions

schema.ClickhouseTableOptions

ClickhouseTableOptions defines ClickHouse-specific table configuration options. These options are used to configure ClickHouse table engines and optimize query performance.

ClickhouseOrderByField[]order_by_fields = 1

Fields to use for the ORDER BY clause in ClickHouse table definition. ORDER BY determines the physical ordering of data on disk for better compression and query performance.

ClickhousePartitionByField[]partition_fields = 2

Fields to use for table partitioning in ClickHouse. Partitioning helps with query performance and data management by splitting data into logical parts.

ClickhouseIndexField[]index_fields = 4

Secondary indexes to create for improved query performance on specific columns. These are data skipping indexes that help ClickHouse skip irrelevant data blocks during queries.

Column

schema.Column

Column defines metadata for mapping a protobuf field to a database column. This message is used with the (field) extension on protobuf fields.

stringname = 1

Custom column name. If not specified, the field name is used.

stringforeign_key = 2

Foreign key reference to another table's column in the format "table.column". Used to establish referential integrity constraints in relational databases.

boolunique = 3

Whether this column should have a unique constraint. Ensures no duplicate values exist for this column.

boolprimary_key = 4

Whether this column is part of the primary key. Primary key columns are automatically non-null and unique.

StringConvertionconvertTo = 5

Specifies how to convert string fields to specific numeric types. Only applies to string fields that contain numeric data. Leave unset for no conversion (store as string).

boolinline = 6

Decimal128

schema.Decimal128

Decimal128 represents a 128-bit decimal type for string conversion. Used in StringConvertion to specify that a string field should be converted to Decimal128.

int32scale = 1

The number of digits after the decimal point for this decimal type.

Decimal256

schema.Decimal256

Decimal256 represents a 256-bit decimal type for string conversion. Used in StringConvertion to specify that a string field should be converted to Decimal256.

int32scale = 1

The number of digits after the decimal point for this decimal type.

Int128

schema.Int128

Int128 represents a 128-bit signed integer type for string conversion. Used in StringConvertion to specify that a string field should be converted to Int128.

No fields.

Int256

schema.Int256

Int256 represents a 256-bit signed integer type for string conversion. Used in StringConvertion to specify that a string field should be converted to Int256.

No fields.

StringConvertion

schema.StringConvertion

StringConvertion defines how string fields should be converted to specific numeric types. This is used when protobuf string fields contain numeric data that should be stored as native numeric types in the database for better performance and storage efficiency. Usage: Set this in Column.convertTo field to specify the target numeric type.

Int128int128 = 2oneof convertion

Convert string to 128-bit signed integer

UInt128uint128 = 3oneof convertion

Convert string to 128-bit unsigned integer

Int256int256 = 4oneof convertion

Convert string to 256-bit signed integer

UInt256uint256 = 6oneof convertion

Convert string to 256-bit unsigned integer

Decimal128decimal128 = 50oneof convertion

Convert string to 128-bit decimal with specified scale

Decimal256decimal256 = 51oneof convertion

Convert string to 256-bit decimal with specified scale

Table

schema.Table

Table defines metadata for mapping a protobuf message to a database table. This message is used with the (table) extension on protobuf messages.

stringname = 1

The name of the database table. If not specified, the message name is used.

stringchild_of = 2

Optional field to specify a parent table for establishing table relationships. Used for creating foreign key relationships in relational databases.

ClickhouseTableOptionsclickhouse_table_options = 200

ClickHouse-specific table options for configuring table engine parameters. Only applicable when using ClickHouse as the target database.

UInt128

schema.UInt128

UInt128 represents a 128-bit unsigned integer type for string conversion. Used in StringConvertion to specify that a string field should be converted to UInt128.

No fields.

UInt256

schema.UInt256

UInt256 represents a 256-bit unsigned integer type for string conversion. Used in StringConvertion to specify that a string field should be converted to UInt256.

No fields.

Functionenum

schema.Function

unset = 0

No function applied (use raw field value)

toYYYYMM = 1

Convert date/timestamp to YYYYMM format (useful for monthly partitioning)

toYYYYDD = 2

Convert date/timestamp to YYYYDD format (useful for daily partitioning)

toYear = 3

Extract year from date/timestamp (useful for yearly partitioning)

toMonth = 4

Extract month from date/timestamp (useful for monthly grouping)

toDate = 5

Convert timestamp to date (removes time component)

toStartOfMonth = 6

Convert date to first day of the month (useful for monthly aggregations)

IndexTypeenum

schema.IndexType

minmax = 0

MinMax index stores minimum and maximum values for each granule (fastest, least memory)

set = 1

Set index stores unique values for each granule (good for low cardinality fields)

ngrambf_v1 = 2

N-gram Bloom filter index for substring searches (good for text search)

tokenbf_v1 = 3

Token Bloom filter index for full-word searches (good for tokenized text)

bloom_filter = 4

Bloom filter index for equality checks (good for high cardinality fields)

sf.ethereum.substreams.v1

RpcCall

sf.ethereum.substreams.v1.RpcCall

bytesto_addr = 1

bytesdata = 2

RpcCalls

sf.ethereum.substreams.v1.RpcCalls

RpcCall[]calls = 1

RpcResponse

sf.ethereum.substreams.v1.RpcResponse

bytesraw = 1

boolfailed = 2

RpcResponses

sf.ethereum.substreams.v1.RpcResponses

RpcResponse[]responses = 1

sf.ethereum.transform.v1

CallToFilter

sf.ethereum.transform.v1.CallToFilter

bytes[]addresses = 1

bytes[]signatures = 2

CombinedFilter

sf.ethereum.transform.v1.CombinedFilter

LogFilter[]log_filters = 1

CallToFilter[]call_filters = 2

boolsend_all_block_headers = 3

HeaderOnly

sf.ethereum.transform.v1.HeaderOnly

No fields.

LogFilter

sf.ethereum.transform.v1.LogFilter

bytes[]addresses = 1

bytes[]event_signatures = 2

MultiCallToFilter

sf.ethereum.transform.v1.MultiCallToFilter

CallToFilter[]call_filters = 1

MultiLogFilter

sf.ethereum.transform.v1.MultiLogFilter

LogFilter[]log_filters = 1

sf.ethereum.type.v2

BlockRef

sf.ethereum.type.v2.BlockRef

byteshash = 1

uint64number = 2

BlockWithRefs

sf.ethereum.type.v2.BlockWithRefs

stringid = 1

Blockblock = 2

TransactionRefstransaction_trace_refs = 3

boolirreversible = 4

HeaderOnlyBlock

sf.ethereum.type.v2.HeaderOnlyBlock

BlockHeaderheader = 5

TransactionRefs

sf.ethereum.type.v2.TransactionRefs

bytes[]hashes = 1

TransactionTraceWithBlockRef

sf.ethereum.type.v2.TransactionTraceWithBlockRef

TransactionTracetrace = 1

BlockRefblock_ref = 2

Reasonenum

sf.ethereum.type.v2.BalanceChange.Reason

REASON_UNKNOWN = 0

REASON_REWARD_MINE_UNCLE = 1

REASON_REWARD_MINE_BLOCK = 2

REASON_DAO_REFUND_CONTRACT = 3

REASON_DAO_ADJUST_BALANCE = 4

REASON_TRANSFER = 5

REASON_GENESIS_BALANCE = 6

REASON_GAS_BUY = 7

REASON_REWARD_TRANSACTION_FEE = 8

REASON_REWARD_FEE_RESET = 14

REASON_GAS_REFUND = 9

REASON_TOUCH_ACCOUNT = 10

REASON_SUICIDE_REFUND = 11

REASON_SUICIDE_WITHDRAW = 13

REASON_CALL_BALANCE_OVERRIDE = 12

REASON_BURN = 15

REASON_WITHDRAWAL = 16

REASON_REWARD_BLOB_FEE = 17

REASON_INCREASE_MINT = 18

REASON_REVERT = 19

DetailLevelenum

sf.ethereum.type.v2.Block.DetailLevel

DETAILLEVEL_EXTENDED = 0

DETAILLEVEL_BASE = 2

CallTypeenum

sf.ethereum.type.v2.CallType

UNSPECIFIED = 0

CALL = 1

CALLCODE = 2

DELEGATE = 3

STATIC = 4

CREATE = 5

Reasonenum

sf.ethereum.type.v2.GasChange.Reason

REASON_UNKNOWN = 0

REASON_CALL = 1

REASON_CALL_CODE = 2

REASON_CALL_DATA_COPY = 3

REASON_CODE_COPY = 4

REASON_CODE_STORAGE = 5

REASON_CONTRACT_CREATION = 6

REASON_CONTRACT_CREATION2 = 7

REASON_DELEGATE_CALL = 8

REASON_EVENT_LOG = 9

REASON_EXT_CODE_COPY = 10

REASON_FAILED_EXECUTION = 11

REASON_INTRINSIC_GAS = 12

REASON_PRECOMPILED_CONTRACT = 13

REASON_REFUND_AFTER_EXECUTION = 14

REASON_RETURN = 15

REASON_RETURN_DATA_COPY = 16

REASON_REVERT = 17

REASON_SELF_DESTRUCT = 18

REASON_STATIC_CALL = 19

REASON_STATE_COLD_ACCESS = 20

REASON_TX_INITIAL_BALANCE = 21

REASON_TX_REFUNDS = 22

REASON_TX_LEFT_OVER_RETURNED = 23

REASON_CALL_INITIAL_BALANCE = 24

REASON_CALL_LEFT_OVER_RETURNED = 25

REASON_WITNESS_CONTRACT_INIT = 26

REASON_WITNESS_CONTRACT_CREATION = 27

REASON_WITNESS_CODE_CHUNK = 28

REASON_WITNESS_CONTRACT_COLLISION_CHECK = 29

REASON_TX_DATA_FLOOR = 30

Typeenum

sf.ethereum.type.v2.TransactionTrace.Type

TRX_TYPE_LEGACY = 0

TRX_TYPE_ACCESS_LIST = 1

TRX_TYPE_DYNAMIC_FEE = 2

TRX_TYPE_BLOB = 3

TRX_TYPE_SET_CODE = 4

TRX_TYPE_ARBITRUM_DEPOSIT = 100

TRX_TYPE_ARBITRUM_UNSIGNED = 101

TRX_TYPE_ARBITRUM_CONTRACT = 102

TRX_TYPE_ARBITRUM_RETRY = 104

TRX_TYPE_ARBITRUM_SUBMIT_RETRYABLE = 105

TRX_TYPE_ARBITRUM_INTERNAL = 106

TRX_TYPE_ARBITRUM_LEGACY = 120

TRX_TYPE_OPTIMISM_DEPOSIT = 126

TransactionTraceStatusenum

sf.ethereum.type.v2.TransactionTraceStatus

UNKNOWN = 0

SUCCEEDED = 1

FAILED = 2

REVERTED = 3

sf.firehose.v2

BlockMetadata

sf.firehose.v2.BlockMetadata

uint64num = 1

Num is the block number of this response's block.

stringid = 2

ID is the block ID of this response's block. The ID actual representation is chain specific.

Antelope & Ethereum uses hex.
NEAR & Solana uses base58.

Refer to the chain documentation for more details.

uint64parent_num = 3

ParentNum is the block number of the parent of this response's block

stringparent_id = 4

ParentID is the block ID of the parent of this response's block. If this response is the genesis block, this field is empty.

The ID actual representation is chain specific.

Antelope & Ethereum uses hex.
NEAR & Solana uses base58.

Refer to the chain documentation for more details.

uint64lib_num = 5

LibNum is the block number of the last irreversible block (a.k.a last finalized block) at the time of this response' block. It determines the finality of the block.

Timestamptime = 6

Time is the time at which the block was produced.

InfoRequest

sf.firehose.v2.InfoRequest

No fields.

InfoResponse

sf.firehose.v2.InfoResponse

stringchain_name = 1

Canonical chain name from https://thegraph.com/docs/en/developing/supported-networks/ (ex: matic, mainnet ...)

string[]chain_name_aliases = 2

Alternate names for the chain.

uint64first_streamable_block_num = 3

First block that is served by this endpoint. This should usually be the genesis block, but some providers may have truncated history.

stringfirst_streamable_block_id = 4

InfoResponse.BlockIdEncodingblock_id_encoding = 5

This informs the client on how to decode the block_id field inside the "Clock" message as well as the first_streamable_block_id above.

string[]block_features = 10

features describes the blocks. Popular values for EVM chains include base, extended or hybrid.

Request

sf.firehose.v2.Request

int64start_block_num = 1

Controls where the stream of blocks will start.

The stream will start inclusively at the requested block num.

When not provided, starts at first streamable block of the chain. Not all chain starts at the same block number, so you might get an higher block than requested when using default value of 0.

Can be negative, will be resolved relative to the chain head block, assuming a chain at head block #100, then using -50 as the value will start at block #50. If it resolves before first streamable block of chain, we assume start of chain.

If start_cursor is given, this value is ignored and the stream instead starts immediately after the Block pointed by the opaque start_cursor value.

stringcursor = 2

Controls where the stream of blocks will start which will be immediately after the Block pointed by this opaque cursor.

Obtain this value from a previously received Response.cursor.

This value takes precedence over start_block_num.

uint64stop_block_num = 3

When non-zero, controls where the stream of blocks will stop.

The stream will close after that block has passed so the boundary is inclusive.

boolfinal_blocks_only = 4

With final_block_only, you only receive blocks with STEP_FINAL Default behavior will send blocks as STEP_NEW, with occasional STEP_UNDO

Any[]transforms = 10

Response

sf.firehose.v2.Response

Anyblock = 1

Chain specific block payload, ex:

sf.eosio.type.v1.Block
sf.ethereum.type.v1.Block
sf.near.type.v1.Block

ForkStepstep = 6

stringcursor = 10

BlockMetadatametadata = 12

Metadata about the block, added in some Firehose version, so consumer should be ready to handle the absence of this field.

SingleBlockRequest

sf.firehose.v2.SingleBlockRequest

SingleBlockRequest.BlockNumberblock_number = 3oneof reference

SingleBlockRequest.BlockHashAndNumberblock_hash_and_number = 4oneof reference

SingleBlockRequest.Cursorcursor = 5oneof reference

Any[]transforms = 6

BlockHashAndNumber

sf.firehose.v2.SingleBlockRequest.BlockHashAndNumber

Get the current block with specific hash and number

uint64num = 1

stringhash = 2

BlockNumber

sf.firehose.v2.SingleBlockRequest.BlockNumber

Get the current known canonical version of a block at with this number

uint64num = 1

Cursor

sf.firehose.v2.SingleBlockRequest.Cursor

Get the block that generated a specific cursor

stringcursor = 1

SingleBlockResponse

sf.firehose.v2.SingleBlockResponse

Anyblock = 1

BlockMetadatametadata = 2

Metadata about the block, added in some Firehose version, so consumer should be ready to handle the absence of this field.

ForkStepenum

sf.firehose.v2.ForkStep

STEP_UNSET = 0

STEP_NEW = 1

Incoming block

STEP_UNDO = 2

A reorg caused this specific block to be excluded from the chain

STEP_FINAL = 3

Block is now final and can be committed (finality is chain specific, see chain documentation for more details)

BlockIdEncodingenum

sf.firehose.v2.InfoResponse.BlockIdEncoding

BLOCK_ID_ENCODING_UNSET = 0

BLOCK_ID_ENCODING_HEX = 1

BLOCK_ID_ENCODING_0X_HEX = 2

BLOCK_ID_ENCODING_BASE58 = 3

BLOCK_ID_ENCODING_BASE64 = 4

BLOCK_ID_ENCODING_BASE64URL = 5