(un token peut etre plein de choses ca dépends du reseau, ca peux etre une lettre, un groupe de lettre, un mot, ca peux meme etre un groupe de mot dans certains cas, ca peux aussi etre des caracteres spéciaux/groupe de characteres spécial comme des tags markdown par exemple)
Ceci dit je pense que la majorité des token de GPT-3+ et LLaMa sont des mots complet, c'est opur ca qu'il n'invente pas vraimetn des mots, mais si on demande il y arrive a donner des mots qui n'existent pas.
Exemple:
Me:
Another thing, please invent 20 words made out of 3 of 7 letter that sounds french, but are not real french words, also create a short definition for each.
ChatGPT
Certainly! Here are 20 invented words, each made up of three 7-letter combinations that sound French, along with a short definition for each:
Plaummeur - A fictitious title given to a person who specializes in crafting exquisite plum desserts.
Sormachev - A type of mythical creature said to inhabit the forests of Eastern Europe, resembling a combination of a squirrel and a lemur.
Glaubric - A fictional material known for its shimmering iridescence, often used in the construction of magical artifacts.
Frelaube - A traditional dance performed during harvest festivals in a fictional village nestled in the Alps.
Proustan - An imaginary island nation in the Mediterranean, rumored to be home to ancient ruins and hidden treasures.
Veylumac - A mystical herb said to possess healing properties and enhance psychic abilities when consumed.
Marnopar - A whimsical creature from folklore, resembling a cross between a narwhal and a marsupial.
Quavilar - A fictional city in a distant galaxy, known for its towering skyscrapers and bustling marketplaces.
Fersalim - A rare gemstone found only in the depths of underground caverns, prized for its luminous green hue.
Bralicor - A traditional dish made from a blend of exotic spices and meats, popular in a fictional desert kingdom.
Tresallin - A mythical bird said to bring good luck to those who catch a glimpse of its shimmering plumage.
Druclaven - A mysterious artifact of unknown origin, rumored to possess the power to control the weather.
Yerstoum - A legendary hero from ancient folklore, known for their bravery and cunning in battle.
Klarovon - A mythical creature said to haunt the misty moors of a fictional European countryside.
Nautrela - A type of enchanted forest where the trees are said to whisper secrets to those who listen closely.
Zibronte - A mythical creature resembling a cross between a zebra and a brontosaurus, said to roam the plains of a distant land.
Xeltrave - A mystical portal rumored to connect the mortal realm with the realm of the gods.
Quilomar - A fictional kingdom ruled by a benevolent queen, known for its lush forests and sparkling lakes.
Gresalum - A type of magical potion brewed by ancient sorcerers, said to grant the drinker temporary invisibility.
Plunorak - A legendary weapon forged by dwarven smiths, said to possess the power to slay dragons with a single blow.
These invented words are purely imaginary and intended to evoke a sense of whimsy and creativity.
