This word does not exist

This Word Does Not Exist

This is a project allows
people to train a variant of GPT-2 that makes
up words, definitions and examples from scratch.

For example

incromulentness (noun)

lack of sincerity or candor

«incromulentness in the manner of speech»

Check out https://www.thisworddoesnotexist.com as a demo

Check out https://twitter.com/robo_define for a twitter bot demo

Generating Words / Running Inference

Python deps are in https://github.com/turtlesoupy/this-word-does-not-exist/blob/master/cpu_deploy_environment.yml

Pre-trained model files:

• Blacklist: https://storage.googleapis.com/this-word-does-not-exist-models/blacklist.pickle.gz
• Forward Model (word -> definition): https://storage.googleapis.com/this-word-does-not-exist-models/forward-dictionary-model-v1.tar.gz
• Inverse model (definition -> word): https://storage.googleapis.com/this-word-does-not-exist-models/inverse-dictionary-model-v1.tar.gz

To use them:

from title_maker_pro.word_generator import WordGenerator
word_generator = WordGenerator(
  device="cpu",
  forward_model_path="<somepath1>",
  inverse_model_path="<somepath2>",
  blacklist_path="<blacklist>",
  quantize=False,
)

# a word from scratch:
print(word_generator.generate_word())

# definition for a word you make up
print(word_generator.generate_definition("glooberyblipboop")) 

# new word made up from a definition
print(word_generator.generate_word_from_definition("a word that does not exist")) 

Training a model

For raw thoughts, take a look at some of the notebooks in https://github.com/turtlesoupy/this-word-does-not-exist/tree/master/notebooks

To train, you’ll need to find a dictionary — there is code to extract from

• Apple dictionaries in https://github.com/turtlesoupy/this-word-does-not-exist/blob/master/title_maker_pro/dictionary_definition.py (e.g. /System/Library/Assets/com_apple_MobileAsset_DictionaryServices_dictionaryOSX/).
• Urban dictionary in https://github.com/turtlesoupy/this-word-does-not-exist/blob/master/title_maker_pro/urban_dictionary_scraper.py

After extracting a dictionary you can use the master training script: https://github.com/turtlesoupy/this-word-does-not-exist/blob/master/title_maker_pro/train.py. A sample recent run is https://github.com/turtlesoupy/this-word-does-not-exist/blob/master/scripts/sample_run_parsed_dictionary.sh

Website Development Instructions

cd ./website
pip install -r requirements.txt
pip install aiohttp-devtools 
adev runserver

Машинное обучение, Искусственный интеллект, Алгоритмы

Рекомендация: подборка платных и бесплатных курсов Python — https://katalog-kursov.ru/

A sesquipedalian is a person who overuses uncommon words like lameen (a bishop’s letter expressing a fault or reprimand) or salvestate (to transport car seats to the dining room) just for the sake of it. The first of those italicized words is real. The second two aren’t. But they totally should be. They’re the invention of a new website called This Word Does Not Exist. Powered by machine learning, it conjures up entirely new words never before seen or used, and even generates a halfway convincing definition for them. It’s all kinds of brilliant.

“In February, I quit my job as an engineering director at Instagram after spending seven intense years building their ranking algorithms like non-chronological feed,” Thomas Dimson, creator of This Word Does Not Exist, told Digital Trends. “A friend and I were trying to brainstorm names for a company we could start together in the A.I. space. After [coming up with] some lame ones, I decided it was more appropriate to let A.I. name a company about A.I.”

Then, as Dimson tells it, a global pandemic happened, and he found himself at home with lots of time on his hands to play around with his name-making algorithm. “Eventually I stumbled upon the Mac dictionary as a potential training set and [started] generating arbitrary words instead of just company names,” he said.

If you’ve ever joked that someone who uses complex words in their daily lives must have swallowed a dictionary, that’s pretty much exactly what This Word Does Not Exist has done. The algorithm was trained from a dictionary file Dimson structured according to different parts of speech, definition, and example usage. The model refines OpenAI’s controversial GPT-2 text generator, the much-hyped algorithm once called too dangerous to release to the public. Dimson’s twist on it assigns probabilities to potential words based on which letters are likely to follow one another until the “word” looks like a reasonably convincing dictionary entry. As a final step, it checks that the generated word isn’t a real one by looking it up in the original training set.

This Word Does Not Exist is just the latest in a series of “[Insert object] Does Not Exist” creations. Others range from non-existent Airbnb listings to fake people to computer-generated memes which nonetheless capture the oddball humor of real ones.

“People have a nervous curiosity toward what makes us human,” Dimson said. “By looking at these machine-produced demos, we are better able to understand ourselves. I’m reminded of the fascination with Deep Blue beating Kasparov in 1996 or AlphaGo beating Lee Sedol in 2016.”

Editors’ Recommendations

• The iRobot Genius 4.0 update makes Roombas even smarter

• Adobe’s new Photoshop and Illustrator features make the iPad a real photo editor

• Nvidia’s new voice A.I. sounds just like a real person

• An Amazon A.I. scientist wants to transform downtown Jackson, Mississippi

• Clever new A.I. system promises to train your dog while you’re away from home

29.05.2020

Here’s something fun for your Friday.

I just found (via Reddit) a site where an AI invents words and their definitions every time you refresh the page. For example:

This is not exactly new – I follow someone on Twitter who does this all the time with machine learning, and I also follow another account the generates words and definitions, and tweets them.

One way this site differs from similar projects is that the words and definitions  come very close to sounding real – if you found one in a legitimate dictionary, you would not question it.

Enjoy!

This Word Does Not Exist

P.S. Find any particularly cromulent words?