Dynamic JSON Workflows with LLM + API Integration — Need Guidance

Hey all, I’m building a system where an LLM interfaces with external APIs to perform multi-step actions dynamically. I’m running into a common challenge and could use some insight.

Use Case:

The assistant needs to:

1. Fetch Identifiers (GET request): Pull relevant IDs based on user input.

2. Use Identifiers (POST request): Plug those IDs into a second API call to complete an action (e.g., create or update data).

Example:

Input: “Schedule a meeting with Sarah next week.”

Step 1 (GET): Find Sarah’s contact/user ID from the CRM.

Step 2 (POST): Use that ID to create a new meeting entry via API.

The JSON structures are consistent, but I need the LLM to handle these GET/POST flows dynamically based on natural language inputs.

Question:

What’s the best way to architect this? Anyone using tools or frameworks that help bridge LLMs with real-time API response handling (especially for JSON workflows)? Sample patterns, code, or lessons learned would be awesome.

Thanks!