Probability Distributions.- Linear Models for Regression.- Linear Models for Classification.- Neural Networks.- Kernel Methods.- Sparse Kernel Machines.- Graphical Models.- Mixture Models and EM.- Approximate Inference.- Sampling Methods.- Continuous Latent Variables.- Sequential Data.- Combining Models.

Pattern Recognition and Machine Learning

Preface1Difference Equations12Lag Operators253Stationary ARMA Processes434Forecasting725Maximum Likelihood Estimation1176Spectral Analysis1527Asymptotic Distribution Theory1808Linear Regression Models2009Linear Systems of Simultaneous Equations23310Covariance-Stationary Vector Processes25711Vector Autoregressions29112Bayesian Analysis35113The Kalman Filter37214Generalized Method of Moments40915Models of Nonstationary Time Series43516Processes with Deterministic Time Trends45417Univariate Processes with Unit Roots47518Unit Roots in Multivariate Time Series54419Cointegration57120Full-Information Maximum Likelihood Analysis of Cointegrated Systems63021Time Series Models of Heteroskedasticity65722Modeling Time Series with Changes in Regime677A Mathematical Review704B Statistical Tables751C Answers to Selected Exercises769D Greek Letters and Mathematical Symbols Used in the Text786Author Index789Subject Index792

https://sisis.rz.htw-berlin.de/inh2007/12357004.pdf

Time series analysis

A number of panel unit root tests that allow for cross section dependence have been proposed in the literature, notably by Bai and Ng (2002), Moon and Perron (2003), and Phillips and Sul (2002) who use orthogonalization type procedures to asymptotically eliminate the cross dependence of the series before standard panel unit root tests are applied to the transformed series. In this paper we propose a simple alternative test where the standard DF (or ADF) regressions are augmented with the cross section averages of lagged levels and first-differences of the individual series. A truncated version of the CADF statistics is also considered. New asymptotic results are obtained both for the individual CADF statistics, and their simple averages. It is shown that the CADF_i statistics are asymptotically similar and do not depend on the factor loadings under joint asymptotics where N (cross section dimension) and T (time series dimension) tends to infinity, such that N/T tends to k, where k is a fixed finite non-zero constant. But they are asymptotically correlated due to their dependence on the common factor. Despite this it is shown that the limit distribution of the average CADF statistic exists and its critical values are tabulated. The small sample properties of the proposed tests are investigated by Monte Carlo experiments, for a variety of models. It is shown that the cross sectionally augmented panel unit root tests have satisfactory size and power even for relatively small values of N and T. This is particularly true of cross sectionally augmented and truncated versions of the simple average t-test of Im, Pesaran and Shin, and Choi's inverse normal combination test.

A Simple Panel Unit Root Test in the Presence of Cross Section Dependence

In this book, Andrew Harvey sets out to provide a unified and comprehensive theory of structural time series models. Unlike the traditional ARIMA models, structural time series models consist explicitly of unobserved components, such as trends and seasonals, which have a direct interpretation. As a result the model selection methodology associated with structural models is much closer to econometric methodology. The link with econometrics is made even closer by the natural way in which the models can be extended to include explanatory variables and to cope with multivariate time series. From the technical point of view, state space models and the Kalman filter play a key role in the statistical treatment of structural time series models. The book includes a detailed treatment of the Kalman filter. This technique was originally developed in control engineering, but is becoming increasingly important in fields such as economics and operations research. This book is concerned primarily with modelling economic and social time series, and with addressing the special problems which the treatment of such series poses. The properties of the models and the methodological techniques used to select them are illustrated with various applications. These range from the modellling of trends and cycles in US macroeconomic time series to to an evaluation of the effects of seat belt legislation in the UK.

Forecasting, Structural Time Series Models and the Kalman Filter

/pdf/statistical-analysis-in-climate-research-51ik9f04rx.pdf

Statistical Analysis in Climate Research

Any series of observations ordered along a single dimension, such as time, may be thought of as a time series. The emphasis in time series analysis is on studying the dependence among observations at different points in time. What distinguishes time series analysis from general multivariate analysis is precisely the temporal order imposed on the observations. Many economic variables, such as GNP and its components, price indices, sales, and stock returns are observed over time. In addition to being interested in the contemporaneous relationships among such variables, we are often concerned with relationships between their current and past values, that is, relationships over time.

Time Series Analysis

Using a newly developed measure of global real economic activity, a structural decomposition of the real price of crude oil in four components is proposed: oil supply shocks driven by political events in OPEC countries; other oil supply shocks; aggregate shocks to the demand for industrial commodities; and demand shocks that are specific to the crude oil market. The latter shock is designed to capture shifts in the price of oil driven by higher precautionary demand associated with concerns about the availability of future oil supplies. The paper quantifies the magnitude and timing of these shocks, their dynamic effects on the real price of oil and their relative importance in determining the real price of oil during 1975-2005. The analysis also sheds light on the origins of the major oil price shocks since 1979. Distinguishing between the sources of higher oil prices is shown to be crucial for assessing the effect of higher oil prices on U.S. real GDP and CPI inflation. It is shown that policies aimed at dealing with higher oil prices must take careful account of the origins of higher oil prices. The paper also quantifies the extent to which the macroeconomic performance of the U.S. since the mid-1970s has been determined by the external economic shocks driving the real price of oil as opposed to domestic economic factors and policies.

Not All Oil Price Shocks are Alike: Disentangling Demand and Supply Shocks in the Crude Oil Market

Using a newly developed measure of global real economic activity, a structural decomposition of the real price of crude oil into three components is proposed: crude oil supply shocks; shocks to the global demand for all industrial commodities; and demand shocks that are specific to the crude oil market. The latter shock is designed to capture shifts in the price of oil driven by higher precautionary demand associated with concerns about future oil supply shortfalls. The paper estimates the dynamic effects of these shocks on the real price of oil. A historical decomposition sheds light on the causes of the major oil price shocks since 1975. The implications of higher oil prices for U.S. real GDP and CPI inflation are shown to depend on the cause of the oil price increase. Changes in the composition of shocks help explain why regressions of macroeconomic aggregates on oil prices tend to be unstable. Evidence that the recent increase in crude oil prices was driven primarily by global aggregate demand shocks helps explain why this oil price shock so far has failed to cause a major recession in the U.S.

/pdf/not-all-oil-price-shocks-are-alike-disentangling-demand-and-5le3dqs54s.pdf

Not All Oil Price Shocks Are Alike: Disentangling Demand and Supply Shocks in the Crude Oil Market

It is shown that the reaction of U.S. real stock returns to an oil price shock differs greatly depending on whether the change in the price of oil is driven by demand or supply shocks in the oil market. The demand and supply shocks driving the global crude oil market jointly account for 22% of the long-run variation in U.S. real stock returns. The responses of industry-specific U.S. stock returns to demand and supply shocks in the crude oil market are consistent with accounts of the transmission of oil price shocks that emphasize the reduction in domestic final demand.

https://papers.ssrn.com/sol3/Delivery.cfm/DP6166.pdf?abstractid=1133810&mirid=1

The impact of oil price shocks on the u.s. stock market

SUMMARY
We develop a structural model of the global market for crude oil that for the first time explicitly allows for shocks to the speculative demand for oil as well as shocks to flow demand and flow supply. The speculative component of the real price of oil is identified with the help of data on oil inventories. Our estimates rule out explanations of the 2003–2008 oil price surge based on unexpectedly diminishing oil supplies and based on speculative trading. Instead, this surge was caused by unexpected increases in world oil consumption driven by the global business cycle. There is evidence, however, that speculative demand shifts played an important role during earlier oil price shock episodes including 1979, 1986 and 1990. Our analysis implies that additional regulation of oil markets would not have prevented the 2003–2008 oil price surge. We also show that, even after accounting for the role of inventories in smoothing oil consumption, our estimate of the short-run price elasticity of oil demand is much higher than traditional estimates from dynamic models that do not account for for the endogeneity of the price of oil. Copyright © 2013 John Wiley & Sons, Ltd.

/pdf/the-role-of-inventories-and-speculative-trading-in-the-4q7qw7jmys.pdf

Lutz Kilian

Papers

Time Series Analysis

Not All Oil Price Shocks are Alike: Disentangling Demand and Supply Shocks in the Crude Oil Market

Not All Oil Price Shocks Are Alike: Disentangling Demand and Supply Shocks in the Crude Oil Market

The impact of oil price shocks on the u.s. stock market

The role of inventories and speculative trading in the global market for crude oil