Modelling Natural Language with Claude Shannon's Notion of Surprisal
eBook - ePub

Modelling Natural Language with Claude Shannon's Notion of Surprisal

  1. 188 pages
  2. English
  3. ePUB (mobile friendly)
  4. Available on iOS & Android
eBook - ePub

Modelling Natural Language with Claude Shannon's Notion of Surprisal

About this book

Have you ever wondered how the principles behind Shannon's groundbreaking Information Theory can be interwoven with the intricate fabric of linguistic communication? This book takes you on a fascinating journey, offering insights into how humans process and comprehend language. By applying Information Theory to the realm of natural language semantics, it unravels the connection between regularities in linguistic messages and the cognitive intricacies of language processing. Highlighting the intersections of information theory with linguistics, philosophy, cognitive psychology, and computer science, this book serves as an inspiration for anyone seeking to understand the predictive capabilities of Information Theory in modeling human communication. It elaborates on the seminal works from giants in the field like Dretske, Hale, and Zipf, exploring concepts like surprisal theory and the principle of least effort.

With its empirical approach, this book not only discusses the theoretical aspects but also ventures into the application of Shannon's Information Theory in real-world language scenarios, strengthened by advanced statistical methods and machine learning. It touches upon challenging areas such as the distinction between mathematical and semantic information, the concept of information in linguistic utterances, and the intricate play between truth, context, and meaning.

Whether you are a linguist, a cognitive psychologist, a philosopher, or simply an enthusiast eager to dive deep into the world where language meets information, this book promises a thought-provoking journey.

Frequently asked questions

Yes, you can cancel anytime from the Subscription tab in your account settings on the Perlego website. Your subscription will stay active until the end of your current billing period. Learn how to cancel your subscription.
No, books cannot be downloaded as external files, such as PDFs, for use outside of Perlego. However, you can download books within the Perlego app for offline reading on mobile or tablet. Learn more here.
Perlego offers two plans: Essential and Complete
  • Essential is ideal for learners and professionals who enjoy exploring a wide range of subjects. Access the Essential Library with 800,000+ trusted titles and best-sellers across business, personal growth, and the humanities. Includes unlimited reading time and Standard Read Aloud voice.
  • Complete: Perfect for advanced learners and researchers needing full, unrestricted access. Unlock 1.4M+ books across hundreds of subjects, including academic and specialized titles. The Complete Plan also includes advanced features like Premium Read Aloud and Research Assistant.
Both plans are available with monthly, semester, or annual billing cycles.
We are an online textbook subscription service, where you can get access to an entire online library for less than the price of a single book per month. With over 1 million books across 1000+ topics, we’ve got you covered! Learn more here.
Look out for the read-aloud symbol on your next book to see if you can listen to it. The read-aloud tool reads text aloud for you, highlighting the text as it is being read. You can pause it, speed it up and slow it down. Learn more here.
Yes! You can use the Perlego app on both iOS or Android devices to read anytime, anywhere — even offline. Perfect for commutes or when you’re on the go.
Please note we cannot support devices running on iOS 13 and Android 7 or earlier. Learn more about using the app.
Yes, you can access Modelling Natural Language with Claude Shannon's Notion of Surprisal by Michael Richter in PDF and/or ePUB format, as well as other popular books in Languages & Linguistics & Linguistics. We have over one million books available in our catalogue for you to explore.

Table of contents

  1. Title Page
  2. Copyright
  3. Contents
  4. Acknowledgements
  5. Introduction
  6. Chapter 1 Information and contexts
  7. Chapter 2 Previous work on application of Information Theory to the semantics of natural language
  8. Chapter 3 Modelling intensification through Shannon information
  9. Chapter 4 Shannon Information in information retrieval
  10. Chapter 5 Shannon information, form and linguistic coding
  11. Chapter 6 Some concluding remarks
  12. Index