GPT-3: Building Innovative NLP Products Using Large Language Models

Length: 175 pages
Edition: 1
Language: English
Publisher: O'Reilly Media
Publication Date: 2022-06-14
ISBN-10: 1098113624
ISBN-13: 9781098113629
Sales Rank: #0 (See Top 100 Books)

GPT-3: NLP with LLMs is a unique, pragmatic take on Generative Pre-trained Transformer 3, the famous AI language model launched by OpenAI in 2020. This model is capable of tackling a wide array of tasks, like conversation, text completion, and even coding with stunningly good performance. Since its launch, the API has powered a staggering number of applications that have now grown into full-fledged startups generating business value. This book will be a deep dive into what GPT-3 is, why it is important, what it can do, what has already been done with it, how to get access to it, and how one can build a GPT-3 powered product from scratch.

This book is for anyone who wants to understand the scope and nature of GPT-3. The book will evaluate the GPT-3 API from multiple perspectives and discuss the various components of the new, burgeoning economy enabled by GPT-3. This book will look at the influence of GPT-3 on important AI trends like creator economy, no-code, and Artificial General Intelligence and will equip the readers to structure their imaginative ideas and convert them from mere concepts to reality.

1. Era of Large Language Models       
	   Natural Language Processing: Under the Hood         
	   Language Models: Bigger & Better          
		 The Generative Pre-Trained Transformer: GPT-3           
			   Generative models             
			   Pre-trained models             
			   Transformer models             
			   Sequence-to-sequence models             
			   Transformers and attention mechanisms             
			   A Brief History of GPT-3              
		 Accessing the OpenAI API           
2. Using the  OpenAI  API
    Navigating  OpenAI  Playground
        Prompt Engineering & Design
    Components of the  OpenAI  API
        Execution Engine 
        Response Length
        Temperature and Top P
        Frequency and Presence Penalties
        Best Of
        Stop Sequence
        Inject Start Text and Inject Restart Text
        Show Probabilities
    Execution Engines 
        Davinci
        Curie
        Babbage
        Ada
        Instruct Model Series
    Endpoints
    GPT-3 Fine-tuning 
        Prepare and upload training data
        Train a new fine-tuned model
        Using the fine-tuned model
    Tokens 
    Pricing
    Performance on Conventional NLP Tasks
        Text Classification
        Zero-Shot Classification
        Single Shot/ Few Shots Classification
        Batch Classification 
        Named Entity Recognition
        Text Summarization
        Text Generation
    Summary
3. Programming with GPT-3
     Using OpenAI API with Python 
     Using OpenAI API with Go
     Using OpenAI API with Java
    GPT-3 Sandbox Powered by Streamlit
    Going Live with GPT-3-Powered Applications
    Conclusion
About the Authors

AI & Machine Learning Data Mining Data Warehousing Database Storage & Design Natural Language Processing

To access the Link, solve the captcha.

How to download source code?

1. Go to: https://www.oreilly.com/

2. Search the book title: GPT-3: Building Innovative NLP Products Using Large Language Models, sometime you may not get the results, please search the main title

3. Click the book title in the search results

3. Publisher resources section, click Download Example Code.

1. Disable the AdBlock plugin. Otherwise, you may not get any links.

2. Solve the CAPTCHA.

3. Click download link.

4. Lead to download server to download.