Sudachi: Setup Best

print(f"surface\tlemma\tpos")

You will enter an interactive mode. Type a Japanese sentence and press Enter. sudachi setup

# Tokenize a sentence text = "大阪府で人工知能の勉強をする。" # mode='A', 'B', or 'C' (default is 'C') # A: Shortest unit (detailed) # B: Middle unit (default) # C: Named Entity style (longest) result = tokenizer.tokenize(text, mode='C') sudachi setup