Eric Maugendre<p><span class="h-card" translate="no"><a href="https://a.gup.pe/u/data" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@<span>data</span></a></span> <span class="h-card" translate="no"><a href="https://a.gup.pe/u/datadon" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@<span>datadon</span></a></span> 🧵</p><p>How to assess a statistical model?<br>How to choose between variables?</p><p>Pearson's <a href="https://hachyderm.io/tags/correlation" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>correlation</span></a> is irrelevant if you suspect that the relationship is not a straight line.</p><p>If monotonic relationship:<br>"<a href="https://hachyderm.io/tags/Spearman" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Spearman</span></a>’s rho is particularly useful for small samples where weak correlations are expected, as it can detect subtle monotonic trends." It is "widespread across disciplines where the measurement precision is not guaranteed".<br>"<a href="https://hachyderm.io/tags/Kendall" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Kendall</span></a>’s Tau-b is less affected [than Spearman’s rho] by outliers in the data, making it a robust option for datasets with extreme values."<br>Ref: <a href="https://statisticseasily.com/kendall-tau-b-vs-spearman/" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">statisticseasily.com/kendall-t</span><span class="invisible">au-b-vs-spearman/</span></a></p><p><a href="https://hachyderm.io/tags/normality" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>normality</span></a> <a href="https://hachyderm.io/tags/normalDistribution" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>normalDistribution</span></a> <a href="https://hachyderm.io/tags/modeling" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>modeling</span></a> <a href="https://hachyderm.io/tags/dataDev" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>dataDev</span></a> <a href="https://hachyderm.io/tags/AIDev" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>AIDev</span></a> <a href="https://hachyderm.io/tags/ML" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ML</span></a> <a href="https://hachyderm.io/tags/modelEvaluation" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>modelEvaluation</span></a> <a href="https://hachyderm.io/tags/regression" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>regression</span></a> <a href="https://hachyderm.io/tags/modelling" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>modelling</span></a> <a href="https://hachyderm.io/tags/dataLearning" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>dataLearning</span></a> <a href="https://hachyderm.io/tags/featureEngineering" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>featureEngineering</span></a> <a href="https://hachyderm.io/tags/linearRegression" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>linearRegression</span></a> <a href="https://hachyderm.io/tags/modeling" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>modeling</span></a> <a href="https://hachyderm.io/tags/probability" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>probability</span></a> <a href="https://hachyderm.io/tags/probabilities" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>probabilities</span></a> <a href="https://hachyderm.io/tags/statistics" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>statistics</span></a> <a href="https://hachyderm.io/tags/stats" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>stats</span></a> <a href="https://hachyderm.io/tags/correctionRatio" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>correctionRatio</span></a> <a href="https://hachyderm.io/tags/ML" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ML</span></a> <a href="https://hachyderm.io/tags/Pearson" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Pearson</span></a> <a href="https://hachyderm.io/tags/bias" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>bias</span></a> <a href="https://hachyderm.io/tags/regressionRedress" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>regressionRedress</span></a> <a href="https://hachyderm.io/tags/distributions" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>distributions</span></a></p>