Skip to main content

FAQs

1. What is Model Testing - Test Jobs?​

Test Job is a service that enables users to evaluate AI models using test suites. It supports automated, large-scale testing and provides performance metrics to assess model quality before deployment.

2. How is Model Testing - Test Jobs different from Model Testing - Interactive Sessions?​

  • Test Jobs: automated, repeatable, and scalable testing using test suites.
  • Interactive Sessions: manual, real-time interaction for quick checks or demos.

3. Who should use Test Jobs?​

Anyone who needs to:

  • Validate model performance at scale.
  • Compare different model versions.
  • Produce quantitative evaluation metrics.
  • Ensure model stability before deploying to production.

4. Which model types are supported?​

  • LLM (Large Language Models): Text input only
  • VLM (Vision-Language Models): Text and image input
  • Models must be instruction-tuned and have all required files uploaded.

5. Which data formats are supported?​

  • Alpaca: Instruction-following format.
  • ShareGPT: Multi-turn conversations.
  • ShareGPT_Image: Multimodal conversations with images.

6. What should I do if I encounter an issue?​

  • Make sure your account has sufficient balance.
  • Check whether your model and dataset meet the required format.
  • Contact support via Hotline: 1900 638 399 or support@fptcloud.com
Last updated on by Dang Tran