Save partial checkpoint within a step (for long-running batch operations)

Partials are consumed on resume: the coding step reads progressive_coding_partial.rds (via the pipeline) and the sentiment step reads sentiment_done_partial.rds (inside analyze_sentiment), so a crash mid-step does not re-pay the LLM cost of completed entries. A successful save_checkpoint for the step deletes its partial.

Usage

save_partial_checkpoint(manager, step_name, data, progress_idx)

Arguments

manager

CheckpointManager object

step_name

Step identifier

data

Partial results so far

progress_idx

Index of last completed item