Breaking News: Grepper is joining You.com. Read the official announcement!

count token openai

Darkstar answered on December 29, 2023 Popularity 8/10 Helpfulness 6/10

answer count token openai

count token openai

Comment

import tiktoken

def count_token(txt, model):
    encoding = tiktoken.encoding_for_model(model)
    num_token = len(encoding.encode(txt))
    return num_token
  
## example usage
count_token("hello brother, how are you", "gpt-4-1106-preview")
# output: 6

Popularity 8/10 Helpfulness 6/10 Language python

Source: Grepper

Tags: count openai python token

Link to this answer
Share Copy Link

Contributed on Dec 29 2023

Darkstar

0 Answers Avg Quality 2/10

Continue with Google

By continuing, I agree that I have read and agree to Greppers's Terms of Service and Privacy Policy.

count token openai

Contents

More Related Answers

count token openai

Grepper

Documentation

Social

Legal

Contact

Oops, You will need to install Grepper and log-in to perform this action.