Skip to main content

FAQ

1. What is Model Testing – Interactive Sessions?

Model Testing – Interactive Sessions is a service in the FPT AI Factory Portal that allows you to test and validate fine-tuned AI models in real-world scenarios through a chat-style interface.

2. When should I use Model Testing – Interactive Sessions?

You should use it when you want to:

  • Simulate real user interactions.
  • Evaluate tone, style, and contextual relevance.
  • Identify edge cases or unexpected behaviors before deployment.

3. Which models can be used in Model Testing – Interactive Sessions?

Only models that meet the following criteria:

  • Model type: LLM (text only) or VLM (text + image)
  • Model size: greater than 0
  • Learning stage: Must be Instruction-tuned

4. How do I create a session?

  1. Go to Model Testing --> Interactive Sessions.
  2. Click Create New Session.
  3. Fill in the session name, description, select a model, and configure session stop.
  4. Submit the session.

5. Can I restart a stopped session?

No. Once stopped, a session cannot be restarted. You must create a new session.

6. What is the Playground?

The Playground is where you:

  • Chat with the model.
  • Adjust parameters (temperature, top-p, output length, add stop sequence).
  • Refine messages and evaluate responses.

7. How do I integrate the model via API?

  1. Click Get API Endpoint in the Playground.
  2. Copy the sample code to send requests.