🕷️ Crawler Inspector

URL Lookup

Direct Parameter Lookup

Raw Queries and Responses

1. Shard Calculation

Query:
Response:
Calculated Shard: 102 (from laksa092)

2. Crawled Status Check

Query:
Response:

3. Robots.txt Check

Query:
Response:

4. Spam/Ban Check

Query:
Response:

5. Seen Status Check

ℹ️ Skipped - page is already crawled

đź“„
INDEXABLE
âś…
CRAWLED
1 day ago
🤖
ROBOTS ALLOWED

Page Info Filters

FilterStatusConditionDetails
HTTP statusPASSdownload_http_code = 200HTTP 200
Age cutoffPASSdownload_stamp > now() - 6 MONTH0.1 months ago
History dropPASSisNull(history_drop_reason)No drop reason
Spam/banPASSfh_dont_index != 1 AND ml_spam_score = 0ml_spam_score=0
CanonicalPASSmeta_canonical IS NULL OR = '' OR = src_unparsedNot set

Page Details

PropertyValue
URLhttps://www.countbayesie.com/blog/2016/5/1/a-guide-to-bayesian-statistics
Last Crawled2026-04-26 00:18:25 (1 day ago)
First Indexed2016-05-03 07:27:07 (9 years ago)
HTTP Status Code200
Content
Meta TitleA Guide to Bayesian Statistics — Count Bayesie
Meta DescriptionA guide for getting started with Bayesian Statistics! Start your way with Bayes' Theorem and end up building your own Bayesian Hypothesis test!
Meta Canonicalnull
Boilerpipe Text
Bayesian statistics is one of my favorite topics on this blog. I love the topic so much I wrote a book on Bayesian Statistics to help anyone learn: Bayesian Statistics the Fun Way! The following post is the original guide to Bayesian Statistics that eventually became a the book! If you enjoy the resources below, please consider ordering a copy of “Bayesian Statistics the Fun Way!” It includes reworked versions of these posts and tons of original content. Getting Started with Bayes' Theorem and Prior Probability This guide only assumes you have a basic familiarity with probability. If you can work out the chance of flipping a coin and getting 3 heads in a row, then you should be all set. If you do need a refresher the Khan Academy has some great lectures on the topic. There is no need for a background in Statistics. The beauty of Bayesian Statistics is it can be built up from basic probability. What to read to get you excited? The Signal and The Noise This is a great book to get you excited about Bayesian Stats! Nate Silver's The Signal and the Noise is a fun read and will get you very excited about Bayesian statistics. There are no strong math requirements for this book. If equations still make you a bit nervous this is a great place to build up your enthusiasm to dive in! Recommended posts for getting started! Bayes' Theorem with Lego Bayes' Theorem is much easier to understand visually The best place to start learning is with Bayes' Theorem. In this popular post, we'll cover the basics using Lego bricks. This allows you to use visual learning to build a deep intuition for the theorem. We won't be ignoring the mathematical detail either. By the end of this post, you'll be able to derive this formula from scratch! Han Solo and Bayesian Priors "Never tell me the Odds!" The next key topic is Bayesian Priors. Prior Probabilities allow us to model our beliefs about the world. This post focuses on C3POs classic underestimation of Han Solo's ability to navigate an asteroid field. Rather than simply dismissing C3PO, we'll see how using a Prior could help him. Use Bayes' Theorem to Investigate Food Allergies Let's put Bayes' theorem to use! Ever wonder if your friend is really allergic to gluten? We can use Bayes' Theorem and prior information to find out! We'll also discuss how being more certain than not is not all that certain. Thinking like a Bayesian With the basics down, it's time to start really thinking like a Bayesian! In these posts, we focus on how we can model our beliefs about the world, learn about the beliefs of others and compare hypotheses the Bayesian way! Recommended Posts to get you thinking like a Bayesian! Bayesian Reasoning in The Twilight Zone! That glimmer in his eye is from Bayesian Statistics! Are you superstitious? Do you believe that a dinner novelty could have mystic powers? How much would it take to convince you? Using a classic episode of the Twilight Zone we'll learn how to answer these questions mathematically. We'll learn about Bayes' Factor and how we can use it to understand everyday reasoning. Using Bayes' Factor to Build a Voight-Kampff Test! Just say no to p-values We further explore Bayes' Factor by building the Voight-Kampff Test from Blade Runner! In this post, we explore how to make Bayes' Factor easier to interpret using decibel-based 'evidence'. Evidence allows us to very easily interpret the results of our test. No more confusing p-values! Recommend Reading to really understand Bayesian thinking Probability Theory: The Logic of Science You could easily spend a lifetime pondering this Jaynes' masterpiece. Probability Theory: The Logic of Science is the book to read if you're fascinated with Bayesian thinking. Though there is plenty of math, this book is about philosophy. Jaynes is probably the most radical Bayesian there is. A few pages often provide me with food for thought for months. Also, if you need insults to sling at Frequentists this is the place to get them! The catch is that this is a very challenging book. To help guide you through it Aubrey Clayton has put together a very nice set of lectures.  Introductory lecture on Probability Theory: The Logic of Science by E.T. Jaynes. Aubrey Clayton, March 2015 Bayesian Analysis Bayesian analysis is where we put what we've learned to practical use. In my experience, there are two major benefits to Bayesian statistics over classical statistics:  The first is that you very easy model existing information. This can very often lead to better results since the model has more to work with. Additionally, you can account for inherent bias in your analysis. By modeling the subjective parts of analysis, you can better control them. The second is that is no "mystery meat" in your tools. All of Bayesian statistics is built from the basics of probability. If you understand the posts so far, you have the tools to build nearly everything you'll need for practical analysis.  Recommend Posts to Learn Bayesian Analysis Parameter Estimation Understanding CDF plots is very important Most probability books tell us how likely events are. We'll be told that a biased coin has a 0.6 probability of heads. In practice, we often don't know these probabilities. Determining whether or not the data comes from a biased coin is the real challenge. Parameter estimation deals with how we fill in these missing probabilities.  Bayesian Priors for Parameter Estimation Three priors from the same data We've seen that priors can be used for subjective information. But quite often prior beliefs are based on hard data. In this post, we see how we can use existing data to develop priors. With data backed priors we can develop much better parameter estimates. Rejection Sampling and Tricky Priors Rejection sampling looks pretty fun! In all of the examples we've seen so far we've had very nice probability distributions to work with. Quite often we aren't so lucky. In this post, we learn one of the simpler techniques for working difficult prior probabilities and still getting useful results. Bayesian A/B Testing: A Hypothesis Test that Makes Sense The beauty of two competing posteriors! Can you derive a classical t-test from scratch? My guess is not without some difficulty. One of the benefits of Bayesian statistics is everything can be built from the basics. In this post, we combine everything covered so far to build an A/B test from scratch. Recommend Books for Bayesian Analysis Doing Bayesian Data Analysis. The next logic step after the posts here If you've followed the post up to this point Doing Bayesian Data Analysis is an excellent next step. It will cover much of the material we have so far and then take you much further. The approach is mathematical, but never too challenging.  Bayesian Data Analysis. This book is full of wonderful, practical examples For practical Bayesian statistics, nobody gets me more excited than Andrew Gelman! This is not an easy book to work through but it is an absolute gem. The text is filled with wonderful, real world example that will alway renew your love of Bayesian Statistics. Here's a great video that shows off Gelman's enthusiasm for Bayesian Analysis: Delivered by Andrew Gelman, Director, Applied Statistics Center, Columbia University, at the inaugural New York R Conference in New York City at Work-Bench on Friday, April 24th, and Saturday, April 25th. It's never the end! Look out for updates! There's always more to explore in Bayesian Statistics! I plan to continually update this guide as I write relevant posts or come across other amazing books. Please subscribe the to email list or follow me on twitter for updates. Feel free to leave a comment on any topics you'd like to see covered!
Markdown
# [Count Bayesie](https://www.countbayesie.com/ "Count Bayesie") Probably a Probability Blog - [Blog](https://www.countbayesie.com/) - [Updates and More content\!](https://www.countbayesie.com/subscribe) - [All Posts](https://www.countbayesie.com/all-posts) - [About](https://www.countbayesie.com/about) - [Books](https://www.countbayesie.com/books) # [A Guide to Bayesian Statistics](https://www.countbayesie.com/blog/2016/5/1/a-guide-to-bayesian-statistics) [May 02, 2016](https://www.countbayesie.com/blog/2016/5/1/a-guide-to-bayesian-statistics) [by Will Kurt](https://www.countbayesie.com/?author=54e50c13e4b006a58919aa7a) [![BayesianStats.png](https://images.squarespace-cdn.com/content/v1/54e50c15e4b058fc6806d068/1563717711212-B6LDKYI2Z1LIAY7MUA6I/BayesianStats.png)](https://nostarch.com/learnbayes) Bayesian statistics is one of my favorite topics on this blog. I love the topic so much I wrote a book on Bayesian Statistics to help anyone learn: [Bayesian Statistics the Fun Way\!](https://nostarch.com/learnbayes) The following post is the original guide to Bayesian Statistics that eventually became a the book! If you enjoy the resources below, please consider ordering a copy of “Bayesian Statistics the Fun Way!” It includes reworked versions of these posts and tons of original content. ## Getting Started with Bayes' Theorem and Prior Probability This guide only assumes you have a basic familiarity with probability. If you can work out the chance of flipping a coin and getting 3 heads in a row, then you should be all set. If you do need a refresher the [Khan Academy](https://www.khanacademy.org/math/probability) has some great lectures on the topic. There is no need for a background in Statistics. The beauty of Bayesian Statistics is it can be built up from basic probability. ### What to read to get you excited? [The Signal and The Noise](http://amzn.to/23hnz5f) [![This is a great book to get you excited about Bayesian Stats\!](https://images.squarespace-cdn.com/content/v1/54e50c15e4b058fc6806d068/1462139479914-7A8QSM5ERNHOKV3BN72H/image-asset.jpeg)](http://amzn.to/1TEhUn7) This is a great book to get you excited about Bayesian Stats\! Nate Silver's *The Signal and the Noise* is a fun read and will get you very excited about Bayesian statistics. There are no strong math requirements for this book. If equations still make you a bit nervous this is a great place to build up your enthusiasm to dive in\! ### Recommended posts for getting started\! [**Bayes' Theorem with Lego**](https://www.countbayesie.com/blog/2015/2/18/bayes-theorem-with-lego) [![Bayes' Theorem is much easier to understand visually](https://images.squarespace-cdn.com/content/v1/54e50c15e4b058fc6806d068/1462139647115-HYZ6ND4I21I4P2SSINHW/bayes-lego.jpg)](https://www.countbayesie.com/blog/2015/2/18/bayes-theorem-with-lego) Bayes' Theorem is much easier to understand visually The best place to start learning is with Bayes' Theorem. In this popular post, we'll cover the basics using Lego bricks. This allows you to use visual learning to build a deep intuition for the theorem. We won't be ignoring the mathematical detail either. By the end of this post, you'll be able to derive this formula from scratch\! [**Han Solo and Bayesian Priors**](https://www.countbayesie.com/blog/2015/2/18/hans-solo-and-bayesian-priors) [!["Never tell me the Odds!"](https://images.squarespace-cdn.com/content/v1/54e50c15e4b058fc6806d068/1462139849926-YO8U8INKDSR08OHNLX20/han-solo-priors)](https://www.countbayesie.com/blog/2015/2/18/hans-solo-and-bayesian-priors) "Never tell me the Odds!" The next key topic is Bayesian Priors. Prior Probabilities allow us to model our beliefs about the world. This post focuses on C3POs classic underestimation of Han Solo's ability to navigate an asteroid field. Rather than simply dismissing C3PO, we'll see how using a Prior could help him. [**Use Bayes' Theorem to Investigate Food Allergies**](https://www.countbayesie.com/blog/2016/1/22/why-you-should-believe-your-friends-claims-about-food-allergies) [![Let's put Bayes' theorem to use\!](https://images.squarespace-cdn.com/content/v1/54e50c15e4b058fc6806d068/1462139983227-5YS1Y4IAI1MIIAG226PD/applying-bayes-theorem)](https://www.countbayesie.com/blog/2016/1/22/why-you-should-believe-your-friends-claims-about-food-allergies) Let's put Bayes' theorem to use\! Ever wonder if your friend is really allergic to gluten? We can use Bayes' Theorem and prior information to find out! We'll also discuss how being more certain than not is not all that certain. ## Thinking like a Bayesian With the basics down, it's time to start really thinking like a Bayesian! In these posts, we focus on how we can model our beliefs about the world, learn about the beliefs of others and compare hypotheses the Bayesian way\! ### Recommended Posts to get you thinking like a Bayesian\! [**Bayesian Reasoning in The Twilight Zone\!**](https://www.countbayesie.com/blog/2016/3/16/bayesian-reasoning-in-the-twilight-zone) [![That glimmer in his eye is from Bayesian Statistics\!](https://images.squarespace-cdn.com/content/v1/54e50c15e4b058fc6806d068/1462140180087-JFRA9FV5QLRARJ0XN9YQ/bayes-factor-twilight-zone)](https://www.countbayesie.com/blog/2016/3/16/bayesian-reasoning-in-the-twilight-zone) That glimmer in his eye is from Bayesian Statistics\! Are you superstitious? Do you believe that a dinner novelty could have mystic powers? How much would it take to convince you? Using a classic episode of the Twilight Zone we'll learn how to answer these questions mathematically. We'll learn about Bayes' Factor and how we can use it to understand everyday reasoning. [**Using Bayes' Factor to Build a Voight-Kampff Test\!**](https://www.countbayesie.com/blog/2015/2/27/building-a-bayesian-voight-kampff-test) [![Just say no to p-values](https://images.squarespace-cdn.com/content/v1/54e50c15e4b058fc6806d068/1462140319882-5EKMU2K8FRYSHW2TIS5H/no-p-value)](https://www.countbayesie.com/blog/2015/2/27/building-a-bayesian-voight-kampff-test) Just say no to p-values We further explore Bayes' Factor by building the Voight-Kampff Test from Blade Runner! In this post, we explore how to make Bayes' Factor easier to interpret using decibel-based 'evidence'. Evidence allows us to very easily interpret the results of our test. No more confusing p-values\! ### Recommend Reading to really understand Bayesian thinking [Probability Theory: The Logic of Science](http://amzn.to/21ojaxP) [![You could easily spend a lifetime pondering this Jaynes' masterpiece.](https://images.squarespace-cdn.com/content/v1/54e50c15e4b058fc6806d068/1462140459935-6BLUB6CS5YX8EDBDW8DP/probability-theory-the-logic-of-science)](http://amzn.to/21ojaxP) You could easily spend a lifetime pondering this Jaynes' masterpiece. [Probability Theory: The Logic of Science](http://amzn.to/21ojaxP) is the book to read if you're fascinated with Bayesian thinking. Though there is plenty of math, this book is about philosophy. Jaynes is probably the most radical Bayesian there is. A few pages often provide me with food for thought for months. Also, if you need insults to sling at Frequentists this is the place to get them\! The catch is that this is a very challenging book. To help guide you through it Aubrey Clayton has put together a very nice set of lectures. Introductory lecture on Probability Theory: The Logic of Science by E.T. Jaynes. Aubrey Clayton, March 2015 ## Bayesian Analysis Bayesian analysis is where we put what we've learned to practical use. In my experience, there are two major benefits to Bayesian statistics over classical statistics: The first is that you very easy model existing information. This can very often lead to better results since the model has more to work with. Additionally, you can account for inherent bias in your analysis. By modeling the subjective parts of analysis, you can better control them. The second is that is no "mystery meat" in your tools. All of Bayesian statistics is built from the basics of probability. If you understand the posts so far, you have the tools to build nearly everything you'll need for practical analysis. ### Recommend Posts to Learn Bayesian Analysis [**Parameter Estimation**](https://www.countbayesie.com/blog/2015/4/4/parameter-estimation-the-pdf-cdf-and-quantile-function) [![Understanding CDF plots is very important](https://images.squarespace-cdn.com/content/v1/54e50c15e4b058fc6806d068/1462141258162-NYYB3J8TUNGAQEL95K66/parameter-estimation)](https://www.countbayesie.com/blog/2015/4/4/parameter-estimation-the-pdf-cdf-and-quantile-function) Understanding CDF plots is very important Most probability books tell us how likely events are. We'll be told that a biased coin has a 0.6 probability of heads. In practice, we often don't know these probabilities. Determining whether or not the data comes from a biased coin is the real challenge. Parameter estimation deals with how we fill in these missing probabilities. [**Bayesian Priors for Parameter Estimation**](https://www.countbayesie.com/blog/2015/4/4/parameter-estimation-adding-bayesian-priors) [![Three priors from the same data](https://images.squarespace-cdn.com/content/v1/54e50c15e4b058fc6806d068/1462141354662-2IKTYT1HZRZVTEVCORRD/beta-priors)](https://www.countbayesie.com/blog/2015/4/4/parameter-estimation-adding-bayesian-priors) Three priors from the same data We've seen that priors can be used for subjective information. But quite often prior beliefs are based on hard data. In this post, we see how we can use existing data to develop priors. With data backed priors we can develop much better parameter estimates. [**Rejection Sampling and Tricky Priors**](https://www.countbayesie.com/blog/2015/6/20/tricky-priors-and-rejection-sampling) [![Rejection sampling looks pretty fun\!](https://images.squarespace-cdn.com/content/v1/54e50c15e4b058fc6806d068/1462141430810-8XP0ZSOFDGFOZOOVO6PG/rejection-sampling)](https://www.countbayesie.com/blog/2015/6/20/tricky-priors-and-rejection-sampling) Rejection sampling looks pretty fun\! In all of the examples we've seen so far we've had very nice probability distributions to work with. Quite often we aren't so lucky. In this post, we learn one of the simpler techniques for working difficult prior probabilities and still getting useful results. [**Bayesian A/B Testing: A Hypothesis Test that Makes Sense**](https://www.countbayesie.com/blog/2015/4/25/bayesian-ab-testing) [![The beauty of two competing posteriors\!](https://images.squarespace-cdn.com/content/v1/54e50c15e4b058fc6806d068/1462141540066-7MVCPYJP42MONDN4QG1A/bayesian-ab-test)](https://www.countbayesie.com/blog/2015/4/25/bayesian-ab-testing) The beauty of two competing posteriors\! Can you derive a classical t-test from scratch? My guess is not without some difficulty. One of the benefits of Bayesian statistics is everything can be built from the basics. In this post, we combine everything covered so far to build an A/B test from scratch. ### Recommend Books for Bayesian Analysis [Doing Bayesian Data Analysis.](http://amzn.to/1TEm8es) [![The next logic step after the posts here](https://images.squarespace-cdn.com/content/v1/54e50c15e4b058fc6806d068/1462141756528-95M2HWY9BZUOFQR1YIKN/doing-bayesian-data-analysis)](http://amzn.to/1TEm8es) The next logic step after the posts here If you've followed the post up to this point Doing Bayesian Data Analysis is an excellent next step. It will cover much of the material we have so far and then take you much further. The approach is mathematical, but never too challenging. [Bayesian Data Analysis.](http://amzn.to/1UqBGox) [![This book is full of wonderful, practical examples](https://images.squarespace-cdn.com/content/v1/54e50c15e4b058fc6806d068/1462141840752-19BP893UN190RWIOU626/bayesian-data-analysis-gelman)](http://amzn.to/1UqBGox) This book is full of wonderful, practical examples For practical Bayesian statistics, nobody gets me more excited than Andrew Gelman! This is not an easy book to work through but it is an absolute gem. The text is filled with wonderful, real world example that will alway renew your love of Bayesian Statistics. Here's a great video that shows off Gelman's enthusiasm for Bayesian Analysis: Delivered by Andrew Gelman, Director, Applied Statistics Center, Columbia University, at the inaugural New York R Conference in New York City at Work-Bench on Friday, April 24th, and Saturday, April 25th. ## It's never the end! Look out for updates\! There's always more to explore in Bayesian Statistics! I plan to continually update this guide as I write relevant posts or come across other amazing books. Please [subscribe the to email list](https://www.countbayesie.com/subscribe/) or [follow me on twitter](https://twitter.com/willkurt) for updates. Feel free to leave a comment on any topics you'd like to see covered\! [May 02, 2016](https://www.countbayesie.com/blog/2016/5/1/a-guide-to-bayesian-statistics) /[Will Kurt](https://www.countbayesie.com/?author=54e50c13e4b006a58919aa7a) - [Newer](https://www.countbayesie.com/blog/2017/5/9/kullback-leibler-divergence-explained "Kullback-Leibler Divergence Explained") - [Older](https://www.countbayesie.com/blog/2016/3/16/bayesian-reasoning-in-the-twilight-zone "Bayesian Reasoning in The Twilight Zone!") Powered by [Squarespace](http://www.squarespace.com/)
Readable Markdown
[![BayesianStats.png](https://images.squarespace-cdn.com/content/v1/54e50c15e4b058fc6806d068/1563717711212-B6LDKYI2Z1LIAY7MUA6I/BayesianStats.png)](https://nostarch.com/learnbayes) Bayesian statistics is one of my favorite topics on this blog. I love the topic so much I wrote a book on Bayesian Statistics to help anyone learn: [Bayesian Statistics the Fun Way\!](https://nostarch.com/learnbayes) The following post is the original guide to Bayesian Statistics that eventually became a the book! If you enjoy the resources below, please consider ordering a copy of “Bayesian Statistics the Fun Way!” It includes reworked versions of these posts and tons of original content. ## Getting Started with Bayes' Theorem and Prior Probability This guide only assumes you have a basic familiarity with probability. If you can work out the chance of flipping a coin and getting 3 heads in a row, then you should be all set. If you do need a refresher the [Khan Academy](https://www.khanacademy.org/math/probability) has some great lectures on the topic. There is no need for a background in Statistics. The beauty of Bayesian Statistics is it can be built up from basic probability. ### What to read to get you excited? [The Signal and The Noise](http://amzn.to/23hnz5f) [![This is a great book to get you excited about Bayesian Stats\!](https://images.squarespace-cdn.com/content/v1/54e50c15e4b058fc6806d068/1462139479914-7A8QSM5ERNHOKV3BN72H/image-asset.jpeg)](http://amzn.to/1TEhUn7) This is a great book to get you excited about Bayesian Stats\! Nate Silver's *The Signal and the Noise* is a fun read and will get you very excited about Bayesian statistics. There are no strong math requirements for this book. If equations still make you a bit nervous this is a great place to build up your enthusiasm to dive in\! ### Recommended posts for getting started\! [**Bayes' Theorem with Lego**](https://www.countbayesie.com/blog/2015/2/18/bayes-theorem-with-lego) [![Bayes' Theorem is much easier to understand visually](https://images.squarespace-cdn.com/content/v1/54e50c15e4b058fc6806d068/1462139647115-HYZ6ND4I21I4P2SSINHW/bayes-lego.jpg)](https://www.countbayesie.com/blog/2015/2/18/bayes-theorem-with-lego) Bayes' Theorem is much easier to understand visually The best place to start learning is with Bayes' Theorem. In this popular post, we'll cover the basics using Lego bricks. This allows you to use visual learning to build a deep intuition for the theorem. We won't be ignoring the mathematical detail either. By the end of this post, you'll be able to derive this formula from scratch\! [**Han Solo and Bayesian Priors**](https://www.countbayesie.com/blog/2015/2/18/hans-solo-and-bayesian-priors) [!["Never tell me the Odds!"](https://images.squarespace-cdn.com/content/v1/54e50c15e4b058fc6806d068/1462139849926-YO8U8INKDSR08OHNLX20/han-solo-priors)](https://www.countbayesie.com/blog/2015/2/18/hans-solo-and-bayesian-priors) "Never tell me the Odds!" The next key topic is Bayesian Priors. Prior Probabilities allow us to model our beliefs about the world. This post focuses on C3POs classic underestimation of Han Solo's ability to navigate an asteroid field. Rather than simply dismissing C3PO, we'll see how using a Prior could help him. [**Use Bayes' Theorem to Investigate Food Allergies**](https://www.countbayesie.com/blog/2016/1/22/why-you-should-believe-your-friends-claims-about-food-allergies) [![Let's put Bayes' theorem to use\!](https://images.squarespace-cdn.com/content/v1/54e50c15e4b058fc6806d068/1462139983227-5YS1Y4IAI1MIIAG226PD/applying-bayes-theorem)](https://www.countbayesie.com/blog/2016/1/22/why-you-should-believe-your-friends-claims-about-food-allergies) Let's put Bayes' theorem to use\! Ever wonder if your friend is really allergic to gluten? We can use Bayes' Theorem and prior information to find out! We'll also discuss how being more certain than not is not all that certain. ## Thinking like a Bayesian With the basics down, it's time to start really thinking like a Bayesian! In these posts, we focus on how we can model our beliefs about the world, learn about the beliefs of others and compare hypotheses the Bayesian way\! ### Recommended Posts to get you thinking like a Bayesian\! [**Bayesian Reasoning in The Twilight Zone\!**](https://www.countbayesie.com/blog/2016/3/16/bayesian-reasoning-in-the-twilight-zone) [![That glimmer in his eye is from Bayesian Statistics\!](https://images.squarespace-cdn.com/content/v1/54e50c15e4b058fc6806d068/1462140180087-JFRA9FV5QLRARJ0XN9YQ/bayes-factor-twilight-zone)](https://www.countbayesie.com/blog/2016/3/16/bayesian-reasoning-in-the-twilight-zone) That glimmer in his eye is from Bayesian Statistics\! Are you superstitious? Do you believe that a dinner novelty could have mystic powers? How much would it take to convince you? Using a classic episode of the Twilight Zone we'll learn how to answer these questions mathematically. We'll learn about Bayes' Factor and how we can use it to understand everyday reasoning. [**Using Bayes' Factor to Build a Voight-Kampff Test\!**](https://www.countbayesie.com/blog/2015/2/27/building-a-bayesian-voight-kampff-test) [![Just say no to p-values](https://images.squarespace-cdn.com/content/v1/54e50c15e4b058fc6806d068/1462140319882-5EKMU2K8FRYSHW2TIS5H/no-p-value)](https://www.countbayesie.com/blog/2015/2/27/building-a-bayesian-voight-kampff-test) Just say no to p-values We further explore Bayes' Factor by building the Voight-Kampff Test from Blade Runner! In this post, we explore how to make Bayes' Factor easier to interpret using decibel-based 'evidence'. Evidence allows us to very easily interpret the results of our test. No more confusing p-values\! ### Recommend Reading to really understand Bayesian thinking [Probability Theory: The Logic of Science](http://amzn.to/21ojaxP) [![You could easily spend a lifetime pondering this Jaynes' masterpiece.](https://images.squarespace-cdn.com/content/v1/54e50c15e4b058fc6806d068/1462140459935-6BLUB6CS5YX8EDBDW8DP/probability-theory-the-logic-of-science)](http://amzn.to/21ojaxP) You could easily spend a lifetime pondering this Jaynes' masterpiece. [Probability Theory: The Logic of Science](http://amzn.to/21ojaxP) is the book to read if you're fascinated with Bayesian thinking. Though there is plenty of math, this book is about philosophy. Jaynes is probably the most radical Bayesian there is. A few pages often provide me with food for thought for months. Also, if you need insults to sling at Frequentists this is the place to get them\! The catch is that this is a very challenging book. To help guide you through it Aubrey Clayton has put together a very nice set of lectures. Introductory lecture on Probability Theory: The Logic of Science by E.T. Jaynes. Aubrey Clayton, March 2015 ## Bayesian Analysis Bayesian analysis is where we put what we've learned to practical use. In my experience, there are two major benefits to Bayesian statistics over classical statistics: The first is that you very easy model existing information. This can very often lead to better results since the model has more to work with. Additionally, you can account for inherent bias in your analysis. By modeling the subjective parts of analysis, you can better control them. The second is that is no "mystery meat" in your tools. All of Bayesian statistics is built from the basics of probability. If you understand the posts so far, you have the tools to build nearly everything you'll need for practical analysis. ### Recommend Posts to Learn Bayesian Analysis [**Parameter Estimation**](https://www.countbayesie.com/blog/2015/4/4/parameter-estimation-the-pdf-cdf-and-quantile-function) [![Understanding CDF plots is very important](https://images.squarespace-cdn.com/content/v1/54e50c15e4b058fc6806d068/1462141258162-NYYB3J8TUNGAQEL95K66/parameter-estimation)](https://www.countbayesie.com/blog/2015/4/4/parameter-estimation-the-pdf-cdf-and-quantile-function) Understanding CDF plots is very important Most probability books tell us how likely events are. We'll be told that a biased coin has a 0.6 probability of heads. In practice, we often don't know these probabilities. Determining whether or not the data comes from a biased coin is the real challenge. Parameter estimation deals with how we fill in these missing probabilities. [**Bayesian Priors for Parameter Estimation**](https://www.countbayesie.com/blog/2015/4/4/parameter-estimation-adding-bayesian-priors) [![Three priors from the same data](https://images.squarespace-cdn.com/content/v1/54e50c15e4b058fc6806d068/1462141354662-2IKTYT1HZRZVTEVCORRD/beta-priors)](https://www.countbayesie.com/blog/2015/4/4/parameter-estimation-adding-bayesian-priors) Three priors from the same data We've seen that priors can be used for subjective information. But quite often prior beliefs are based on hard data. In this post, we see how we can use existing data to develop priors. With data backed priors we can develop much better parameter estimates. [**Rejection Sampling and Tricky Priors**](https://www.countbayesie.com/blog/2015/6/20/tricky-priors-and-rejection-sampling) [![Rejection sampling looks pretty fun\!](https://images.squarespace-cdn.com/content/v1/54e50c15e4b058fc6806d068/1462141430810-8XP0ZSOFDGFOZOOVO6PG/rejection-sampling)](https://www.countbayesie.com/blog/2015/6/20/tricky-priors-and-rejection-sampling) Rejection sampling looks pretty fun\! In all of the examples we've seen so far we've had very nice probability distributions to work with. Quite often we aren't so lucky. In this post, we learn one of the simpler techniques for working difficult prior probabilities and still getting useful results. [**Bayesian A/B Testing: A Hypothesis Test that Makes Sense**](https://www.countbayesie.com/blog/2015/4/25/bayesian-ab-testing) [![The beauty of two competing posteriors\!](https://images.squarespace-cdn.com/content/v1/54e50c15e4b058fc6806d068/1462141540066-7MVCPYJP42MONDN4QG1A/bayesian-ab-test)](https://www.countbayesie.com/blog/2015/4/25/bayesian-ab-testing) The beauty of two competing posteriors\! Can you derive a classical t-test from scratch? My guess is not without some difficulty. One of the benefits of Bayesian statistics is everything can be built from the basics. In this post, we combine everything covered so far to build an A/B test from scratch. ### Recommend Books for Bayesian Analysis [Doing Bayesian Data Analysis.](http://amzn.to/1TEm8es) [![The next logic step after the posts here](https://images.squarespace-cdn.com/content/v1/54e50c15e4b058fc6806d068/1462141756528-95M2HWY9BZUOFQR1YIKN/doing-bayesian-data-analysis)](http://amzn.to/1TEm8es) The next logic step after the posts here If you've followed the post up to this point Doing Bayesian Data Analysis is an excellent next step. It will cover much of the material we have so far and then take you much further. The approach is mathematical, but never too challenging. [Bayesian Data Analysis.](http://amzn.to/1UqBGox) [![This book is full of wonderful, practical examples](https://images.squarespace-cdn.com/content/v1/54e50c15e4b058fc6806d068/1462141840752-19BP893UN190RWIOU626/bayesian-data-analysis-gelman)](http://amzn.to/1UqBGox) This book is full of wonderful, practical examples For practical Bayesian statistics, nobody gets me more excited than Andrew Gelman! This is not an easy book to work through but it is an absolute gem. The text is filled with wonderful, real world example that will alway renew your love of Bayesian Statistics. Here's a great video that shows off Gelman's enthusiasm for Bayesian Analysis: Delivered by Andrew Gelman, Director, Applied Statistics Center, Columbia University, at the inaugural New York R Conference in New York City at Work-Bench on Friday, April 24th, and Saturday, April 25th. ## It's never the end! Look out for updates\! There's always more to explore in Bayesian Statistics! I plan to continually update this guide as I write relevant posts or come across other amazing books. Please [subscribe the to email list](https://www.countbayesie.com/subscribe/) or [follow me on twitter](https://twitter.com/willkurt) for updates. Feel free to leave a comment on any topics you'd like to see covered\!
ML Classification
ML Categories
/Science
66.4%
/Science/Mathematics
65.3%
/Science/Mathematics/Statistics
64.8%
/Finance
10.3%
Raw JSON
{
    "/Science": 664,
    "/Science/Mathematics": 653,
    "/Science/Mathematics/Statistics": 648,
    "/Finance": 103
}
ML Page Types
/Article
97.8%
/Article/Tutorial_or_Guide
96.9%
Raw JSON
{
    "/Article": 978,
    "/Article/Tutorial_or_Guide": 969
}
ML Intent Types
Informational
98.5%
Commercial
13.0%
Raw JSON
{
    "Informational": 985,
    "Commercial": 130
}
Content Metadata
Languageen-us
AuthorWill Kurt
Publish Time2016-05-02 17:42:30 (9 years ago)
Original Publish Time2016-05-01 00:00:00 (9 years ago)
RepublishedNo
Word Count (Total)1,365
Word Count (Content)1,305
Links
External Links18
Internal Links18
Technical SEO
Meta NofollowNo
Meta NoarchiveNo
JS RenderedNo
Redirect Targetnull
Performance
Download Time (ms)284
TTFB (ms)284
Download Size (bytes)23,122
Shard102 (laksa)
Root Hash16139550678664426302
Unparsed URLcom,countbayesie!www,/blog/2016/5/1/a-guide-to-bayesian-statistics s443