DATA_FIELD streaming format Confirmed

Overview

Implementation: crates/asset/src/lib.rs::parse_streaming.

Layout

[u32 type_size] [size_bytes of raw data]
[u32 type_size] [size_bytes of raw data]
...
[u32 terminator]    // type_size with low 24 bits all zero

Where:

• type_size = (type_byte << 24) | (size_bytes & 0x00FFFFFF).
• type_byte matches the asset type table.
• The next chunk header starts at current_pos + 4 + (size & ~3) - i.e., header + size truncated to a 4-byte boundary. Sizes are always 4-aligned in practice.
• Terminator: any header u32 whose low 24 bits are zero.

What's in the wild

Strict-validating PROT entries with asset scan-stream finds 26 hits, concentrated in the _other5 cluster (entries 1214–1219+) plus a few in dolk2, rikuroa2, rayman. Each entry has 3 chunks of single-asset shape:

chunk[0]: TIM   (single, magic 0x10)        - sprite atlas / texture
chunk[1]: TMD2  (single, magic 0x80000002)  - single Legaia TMD
chunk[2]: MOVE2 (single, magic 0x08)        - animation data
terminator

The chunk layouts are single assets here (one TIM, one TMD2, one MOVE2), not packs. Other clusters elsewhere in the corpus do use pack-shaped TIM_LIST / TMD chunks; the pack format handles that case.

Trailer data

Some entries contain bytes past the streaming terminator. asset extract preserves these as _trailer.bin next to the extracted chunks. The function that consumes the trailer has not been located.

Related shapes

• The scene-TMD-prefixed streaming shape is structurally similar but the leading chunk has no [u32 type_size] header and the inner content is a bare TMD instead of a TIM.
• The scene-VAB-prefixed streaming shape uses the same chunk0-header trick but with VAB content.
• Pack format lives inside TIM_LIST / TMD chunks when the chunk's data is a pack rather than a single asset.
• A handful of entries (0157_rikuroa, 0228_station, 0373_taiku, 1205_other5) carry the streaming layout but the final chunk's declared size walks past EOF without a terminator on disc. The runtime extends the chunk via streaming DMA continuation rather than consuming a literal terminator. Detector: crates/asset/src/data_field_truncated.rs (class data_field_truncated).

Per-scene field bundles - what's still open

The CDNAME block for a typical field/town scene (e.g. town01, bubu1) carries 8–12 PROT entries. Categorize (the sweep that classifies every archive entry by format) identifies several known shapes per block:

What's NOT modelled yet:

• Cross-entry pointers (NPC references that point into other PROT entries - the asset chain in asset-loader.md is best-effort).
• The per-slot semantics of the field-pack shared-template block (magic 0x01059B84; see field-pack) - known shape, consumer unlocated.
• The retail engine's per-scene "asset table" indirection (SceneAssetTable and SceneScriptedAssetTable detectors fire on a small fraction of entries; full reverse needs an overlay capture of FUN_8001f7c0 at scene-load time).

The categorize sweep classifies every PROT entry to something; the items above are the residual edge. See the engine page for how scene loading consumes these shapes.

See also