Serving OPT Langauge Model with Alpa

OPT is a generative language model released by Meta AI. It reproduces the famous GPT-3 model. In this demo, we use Alpa and the weights released by Meta to serve this mode.

WARNING: This model will generate MANY offensive things. Due to this being an alpha demo, NO safety measures are in place.

Tips for better generation:

• Use the examples to get an idea of how to control it.
• Avoid spaces at the end of your query. New lines are great though.
• Simple questions trigger chatbot mode. Try "Question: ... Answer:" to get more factual responses.
• Using proper capitalization and punctuation can help avoid chatbot mode. Sometimes.

Examples: Question Cryptocurrency Chatbot Poetry Math

Links

• Start Alpa on github
• This website interface is modified from metaseq
• Check out the Alpa paper and OPT paper for technical details.