scispace - formally typeset
Open AccessJournal ArticleDOI

Fitting and Goodness-of-Fit Test of Non-Truncated and Truncated Power-Law Distributions

Anna Deluca, +1 more
- 26 Sep 2013 - 
- Vol. 61, Iss: 6, pp 1351-1394
TLDR
In this article, Clauset, Shalizi, and Newman have proposed a systematic method to find over which range (if any) a certain distribution behaves as a power law, but their method has been found to fail, in the sense that true (simulated) power-law tails are not recognized as such in some instances, and then the power law hypothesis is rejected.
Abstract
Recently, Clauset, Shalizi, and Newman have proposed a systematic method to find over which range (if any) a certain distribution behaves as a power law. However, their method has been found to fail, in the sense that true (simulated) power-law tails are not recognized as such in some instances, and then the power-law hypothesis is rejected. Moreover, the method does not work well when extended to power-law distributions with an upper truncation. We explain in detail a similar but alternative procedure, valid for truncated as well as for non-truncated power-law distributions, based in maximum likelihood estimation, the Kolmogorov-Smirnov goodness-of-fit test, and Monte Carlo simulations. An overview of the main concepts as well as a recipe for their practical implementation is provided. The performance of our method is put to test on several empirical data which were previously analyzed with less systematic approaches. We find the functioning of the method very satisfactory.

read more

Content maybe subject to copyright    Report

Citations
More filters
Posted Content

Implicit Self-Regularization in Deep Neural Networks: Evidence from Random Matrix Theory and Implications for Learning

TL;DR: A theory to identify 5+1 Phases of Training, corresponding to increasing amounts of Implicit Self-Regularization, which demonstrates that DNN optimization with larger batch sizes leads to less-well implicitly-regularized models, and it provides an explanation for the generalization gap phenomena.
Journal ArticleDOI

Large-Scale Analysis of Zipf’s Law in English Texts

TL;DR: This work studies three different versions of Zipf’s law by fitting them to all available English texts in the Project Gutenberg database and finds one of them is able to fit more than 40% of thetexts in the database at the 0.05 significance level.
Journal ArticleDOI

Analysis of Power Laws, Shape Collapses, and Neural Complexity: New Techniques and MATLAB Support via the NCC Toolbox.

TL;DR: Maximum-likelihood estimation is used to automatically fit power laws with left and right cutoffs, the first automated shape collapse algorithm is presented, and new techniques to account for large numbers of neural variables and small data sets in the calculation of neural complexity are described.
Journal ArticleDOI

Power-law distribution in the number of confirmed COVID-19 cases

TL;DR: In this article, the authors studied the distribution of confirmed COVID-19 cases and deaths for countries worldwide and for counties in the US and showed that both distributions follow a truncated power-law over five orders of magnitude.
References
More filters
BookDOI

Density estimation for statistics and data analysis

TL;DR: The Kernel Method for Multivariate Data: Three Important Methods and Density Estimation in Action.
Journal ArticleDOI

Power-Law Distributions in Empirical Data

TL;DR: This work proposes a principled statistical framework for discerning and quantifying power-law behavior in empirical data by combining maximum-likelihood fitting methods with goodness-of-fit tests based on the Kolmogorov-Smirnov (KS) statistic and likelihood ratios.
Book

Continuous univariate distributions

TL;DR: Continuous Distributions (General) Normal Distributions Lognormal Distributions Inverse Gaussian (Wald) Distributions Cauchy Distribution Gamma Distributions Chi-Square Distributions Including Chi and Rayleigh Exponential Distributions Pareto Distributions Weibull Distributions Abbreviations Indexes