We analyzed 15+ LLMs and their pricing and performance. LLM API pricing can be complex and depends on your preferred usage. If you plan to use:
- The chat user interface, see all major LLM subscription plans
- APIs, see LLMs ranked by their performance and type your volume needs in terms of tokens to see the exact pricing:
Hover over model names to see their full names and over headers to see explanations about the columns.
Ranking: The ranking of models is based on the Overall Arena Score in the Chatbot Arena LLM leaderboard.1
When the official Grok 3 API is released and Gemini’s experimental models exit their experimental phase, the missing values will be populated with the official values.
Rate limits control Google API request frequency for free tiers.2
You can check the hallucination rates and reasoning performance of top LLMs in our benchmarks.
Understanding LLM Pricing
Tokens: The Fundamental Unit of Pricing
Figure 1: Example of tokenization using the GPT-4o & GPT-4o mini tokenizer for the sentence “Identify New Technologies, Accelerate Your Enterprise.”3
While providers offer a variety of pricing structures, per-token pricing is the most common. Tokenization methods differ across models; examples include:
- Byte-Pair Encoding (BPE): Splits words into frequent subword units, balancing vocabulary size and efficiency.4
- Example: “unbelievable” → [“un”, “believ”, “able”]
- WordPiece: Similar to BPE but optimizes for language model likelihood, used in BERT.5
- Example: “tokenization” → [“token”, “##ization”]. “token” is a standalone word; “##ization” is a suffix.
- SentencePiece: Tokenizes text without relying on spaces, effective for multilingual models like T5.6
- Example: “natural language” → [” natural”, ” lan”, “guage”] or [” natu”, “ral”, ” language”].
Please note that the exact subwords depend on the training data and BPE/WordPiece process. To better understand these tokenization methods, watch the video below:
After grasping tokenization, an average price can be estimated based on the project token length. Table 2 outlines token ranges by content type, such as UI prompts, email snippets, marketing blogs, detailed reports, and research papers, while noting that token counts vary across models. Once a model is chosen, its tokenizer can be used to estimate the average token count for the content.
Table 2: Typical content types, their size ranges, and enterprise considerations (ranges are estimates and may vary).
Context Window Implications
Awareness of the context window concept is another crucial factor to consider regarding pricing. Here, it is essential to ensure that the total number of tokens from both the input and output does not exceed the context window/length.
If the total exceeds the context window, it may lead to the truncation of the excess output, as shown in Figure 2. Therefore, the output may not be as expected. It is important to note that tokens generated during the reasoning process are also counted within this limitation.
Figure 2: Illustration of context window limitations leading to output truncation in a multi-turn conversation.7
Max Output Tokens
This is an important parameter in Large Language Models (LLMs) to achieve the desired output and manage costs effectively. While many documentations mention that it can be adjusted using the max_tokens parameter, it is crucial to review the documentation of the specific API being used to identify the correct parameter. It should be adjusted according to the specific needs:
If set too low: It may result in incomplete outputs, causing the model to cut off responses before delivering the full answer.
If set too high: Depending on the temperature (a parameter that controls response creativity), it can lead to unnecessarily verbose outputs, longer response times, and increased cost.
Therefore, it is a parameter that requires careful consideration to optimize resource usage while balancing output quality, cost, and performance.
Table 3: Example input prompts and estimated token counts per content type.
*This assumes that each model produces responses with an equal number of output tokens, although the token count for both input and output may vary depending on each model’s tokenization; the number has been kept constant here for each model.
The LLM API price calculator can be used to determine the total cost per model when generating content types from Table 2 via the API, using the sample prompts provided in Table 3. Additionally, it can be used to calculate costs for custom cases beyond the suggested content types.
LLM API Price Calculator
You can calculate your total cost by filling out these 3 values below and sorting the results by input cost, output cost, total cost, or alphabetically in increasing or decreasing order:
Note: The default ranking is based on the total cost.
Comparing LLM Subscription Plans
Non-technical users may prefer to use the UI rather than the API, here is the UI pricing:
Using Multiple Language Models
A tool like OpenRouter allows the same prompt to be sent simultaneously to multiple models. The responses, token consumption, response time, and pricing can then be compared to determine which model is most suitable for the task.
Figure 3: Interface showcasing a prompt sent to multiple Large Language Models (LLMs), including R1, Mistral Small 3, GPT-4o-mini, and Claude 3.5 Sonnet.8
Benefits and Challenges
- Increased Adaptability and Efficiency: Orchestration enhances responsiveness, allowing for real-time assessment of model efficiency, leading to the identification of a cost-effective model and potential savings.
- Prompt Sensitivity and Optimization: Identical prompts can elicit vastly different outputs across models, necessitating prompt engineering tailored to each model to achieve desired results, adding to development and maintenance complexity.
FAQ
Reference Links
Cem's work has been cited by leading global publications including Business Insider, Forbes, Washington Post, global firms like Deloitte, HPE and NGOs like World Economic Forum and supranational organizations like European Commission. You can see more reputable companies and resources that referenced AIMultiple.
Throughout his career, Cem served as a tech consultant, tech buyer and tech entrepreneur. He advised enterprises on their technology decisions at McKinsey & Company and Altman Solon for more than a decade. He also published a McKinsey report on digitalization.
He led technology strategy and procurement of a telco while reporting to the CEO. He has also led commercial growth of deep tech company Hypatos that reached a 7 digit annual recurring revenue and a 9 digit valuation from 0 within 2 years. Cem's work in Hypatos was covered by leading technology publications like TechCrunch and Business Insider.
Cem regularly speaks at international technology conferences. He graduated from Bogazici University as a computer engineer and holds an MBA from Columbia Business School.
Be the first to comment
Your email address will not be published. All fields are required.