Pipeline template

Preparing API data for analytics

Flatten paginated API responses, normalize values, and produce a clean customer-level table ready for analytics ingestion. Backs the blog post and recording at data/blog/preparing-api-data-for-analytics/.

Run Template

Runnable example

Run this template on your JSON

Start from the sample input, edit the JSON, and open the same pipeline in the visual editor when you want to customize it.

Output

[
  {
    "page": 1,
    "next": "/customers?page=2",
    "data": [
      {
        "id": "cus_001",
        "user": {
          "email": "maya@example.com"
        },
        "total": "29.99",
        "subscribed": "yes",
        "status": "active"
      },
      {
        "id": "cus_002",
        "user": {
          "email": "liam@example.com"
        },
        "total": "49.50",
        "subscribed": "no",
        "status": null
      }
    ]
  },
  {
    "page": 2,
    "next": "/customers?page=3",
    "data": [
      {
        "id": "cus_003",
        "user": {
          "email": "ava@example.com"
        },
        "total": "15.00",
        "subscribed": "yes",
        "status": "active"
      },
      {
        "id": "cus_001",
        "user": {
          "email": "maya@example.com"
        },
        "total": "29.99",
        "subscribed": "yes",
        "status": "active"
      }
    ]
  },
  {
    "page": 3,
    "next": null,
    "data": [
      {
        "id": "cus_004",
        "user": {
          "email": "noah@example.com"
        },
        "total": "78.25",
        "subscribed": "no",
        "status": "active"
      }
    ]
  }
]

[
  {
    "page": 1,
    "next": "/customers?page=2",
    "data": [
      {
        "id": "cus_001",
        "user": {
          "email": "maya@example.com"
        },
        "total": "29.99",
        "subscribed": "yes",
        "status": "active"
      },
      {
        "id": "cus_002",
        "user": {
          "email": "liam@example.com"
        },
        "total": "49.50",
        "subscribed": "no",
        "status": null
      }
    ]
  },
  {
    "page": 2,
    "next": "/customers?page=3",
    "data": [
      {
        "id": "cus_003",
        "user": {
          "email": "ava@example.com"
        },
        "total": "15.00",
        "subscribed": "yes",
        "status": "active"
      },
      {
        "id": "cus_001",
        "user": {
          "email": "maya@example.com"
        },
        "total": "29.99",
        "subscribed": "yes",
        "status": "active"
      }
    ]
  },
  {
    "page": 3,
    "next": null,
    "data": [
      {
        "id": "cus_004",
        "user": {
          "email": "noah@example.com"
        },
        "total": "78.25",
        "subscribed": "no",
        "status": "active"
      }
    ]
  }
]

Output

Output will appear here after you run the pipeline.

Love the result?

Use this exact pipeline in your app, backend, or LLM workflow.

No setup needed. Works with curl, Node, Python.

Uses example data. For edited input, copy from the playground.

Read integration guide

Need multiple transformations?

Try ForgeJSON Pipeline to combine extraction, cleanup, normalization, validation, and export steps into one reusable workflow.

Try ForgeJSON Pipeline