Let me conclude first: Do not choose an LLM API gateway solely by model count, price, or claimed latency. Use a temporary key to verify protocol behavior, model declarations, critical capabilities, reliability, billing, and migration options under consistent test conditions, and retain reproducible evidence.
Open the free API gateway detection toolYou can start by checking for public HTTPS, Bearer authentication, and OpenAI Chat Completions compatible endpoints. The test results are risk screening, not model manufacturer certification.
First eliminate three types of entrances that are not suitable for production
Before detailed grading, access should be suspended in any of the following situations:
- Requires production API Key submission on web page, group chat, or remote desktop.
- Unable to indicate billing unit, balance change, model ID, or whether a failed request was charged.
- There is no independent key, limit, or cancellation method. If a leak occurs, the entire account can only be replaced.
"A successful request" can only prove that the shortest link is available at that time, but cannot prove the model identity, long-term stability or agent capability.
12-item practical test list
| Check items | minimal verification method | pass standard |
|---|---|---|
| 1. HTTPS and Authentication | Request /v1/models |
HTTPS OK; error Key returns clear 401/403 instead of HTML login page |
| 2. Real model ID | save /v1/models result |
Able to copy the callable ID and guess the model name without the need for promotional titles |
| 3. Basic Agreement | Request /v1/chat/completions |
status code,choices、model and error structure parsable |
| 4. Model declaration | Compare requests and responses model |
consistent, or the service provider publicly states the alias, version and routing rules |
| 5. Token field | Check usage |
Input, output, and total amounts can be explained, and bills and request records can be corresponding. |
| 6. Streaming output | Use stream=true and curl -N |
Return by SSE increment with an explicit end event |
| 7. Tool call | Send tool definition with random parameters | The tool name and JSON parameters are returned completely, not only natural language is generated |
| 8. Stability | Fixed request repeated more than 20 times | Statistical success rate and error distribution, do not replace stability with single results |
| 9. Delay | Record the first byte and total time taken | Watch P50 and P95 at the same time, not only show the best one |
| 10. rate limiting and retrying | Small-scale concurrency and observation 429 | Returns an identifiable error; the client can back off without generating a retry storm |
| 11. Security and Audit | Create, limit, and revoke independent Keys | Key can be managed by projects; the log does not return the complete key and sensitive text |
| 12. Exit costs | Switch back to alternate address and model | There are timeouts, circuit breakers, backup entrances and data export methods |
Reproducible first round verification
Create a temporary low-limit Key first, do not use a production key. Put the address, key and model ID into environment variables:
export BASE_URL="https://www.aifast.club/v1"
export API_KEY="YOUR_TEMP_API_KEY"
export MODEL_ID="YOUR_REAL_MODEL_ID"Query model list:
curl --fail-with-body --silent --show-error \
"$BASE_URL/models" \
-H "Authorization: Bearer $API_KEY"Send minimal non-streaming request:
curl --fail-with-body --silent --show-error \
"$BASE_URL/chat/completions" \
-H "Authorization: Bearer $API_KEY" \
-H "Content-Type: application/json" \
-d "{\"model\":\"$MODEL_ID\",\"messages\":[{\"role\":\"user\",\"content\":\"Reply only READY\"}],\"temperature\":0}"Check the response for model、usage, request ID, and error text. Do not paste full keys, user data, or internal prompts into public reports.
How to measure stability and latency so as not to mislead
Sample at least once each at low peak, peak and the next day. Use the same model, parameters and short prompt words in each round, and record:
timestamp, provider, model_requested, model_returned,
http_status, first_byte_ms, total_ms, input_tokens,
output_tokens, request_id, error_typeThe results are calculated at least for success rate, P50 and P95. The average value easily masks a small number of particularly slow requests; just intercepting the fastest result once cannot represent the real experience.
For production business, the real question set after desensitization should also be added to calculate the constraint compliance rate, structured output pass rate, tool call success rate and manual rework time respectively.
Price should compare to complete task cost
Don’t just compare “price per million Tokens”. Full mission costs also include:
- Input tokens brought by system prompts and historical conversations.
- Failed retries, timeout retries, and Agent tool loops.
- Manual rework resulting from changes in output quality after routing switching.
- Separate billing items for images, videos, retrieval and caching.
If the same task requires multiple retries with low-price entries, the actual cost may be higher. It is recommended to check billing changes and request logs by model, key and time window.
How to use the rating scale
Each item presses 0 / 1 / 2 Rating: 0 for Unverifiable, 1 for Partially Satisfied, 2 for Fully Satisfied with Evidence. Protocols, security, billing, and exit paths should be made mandatory, and the lack of security cannot be offset by the "large number of models".
Candidate entrance：__________ Test date：__________
Agreement __/6 Ability __/4 Stability __/4
billing __/4 safe __/4 exit path __/2
blocking problem：____________________________
evidence location：____________________________Ratings are only used for team decision-making and do not mean that the underlying model has received official certification. If there is an exception in the model declaration, token or key capabilities, continue readingModel API comparison test templateandHow to investigate model impersonation and route substitution。
How AIFast should be verified
AIFast’s OpenAI Compatible Base URL is https://www.aifast.club/v1. Model ID, price, and open status are dynamic information and should end withconsole、Model price pageand /v1/models Real-time results shall prevail.
It is recommended to use it firstQuick start in 3 minutesComplete the minimum call and then verify other candidate entries using the same criteria as this article. A unified approach makes it easier to draw verifiable conclusions than just looking at a particular company's promotional page.