**American Journal of Industrial and Business Management**

Vol.09 No.05(2019), Article ID:92536,19 pages

10.4236/ajibm.2019.95079

Forecasting and Backtesting of VaR in International Dry Bulk Shipping Market under Skewed Distributions

Qiannan Du^{ }

College of Transport & Communications, Shanghai Maritime University, Shanghai, China

Copyright © 2019 by author(s) and Scientific Research Publishing Inc.

This work is licensed under the Creative Commons Attribution International License (CC BY 4.0).

http://creativecommons.org/licenses/by/4.0/

Received: April 16, 2019; Accepted: May 19, 2019; Published: May 22, 2019

ABSTRACT

It is extremely important to model the empirical distributions of dry bulk shipping returns accurately in estimating risk measures. Based on several commonly used distributions and alternative distributions, this paper establishes nine different risk models to forecast the Value-at-Risk (VaR) of dry bulk shipping markets. Several backtests are explored to compare the accuracy of VaR forecasting. The empirical results indicate the risk models based on commonly used distributions have relatively poor performance, while the alternative distributions, i.e. Skewed Student-T (SST) distribution, Skewed Generalized Error Distribution (SGED), and Hyperbolic distribution (HYP) produce more accurate VaR measurement. The empirical results suggest risk managers further consider more flexible empirical distributions when managing extreme risks in dry bulk shipping markets.

**Keywords:**

Dry Bulk Shipping Market, Value-at-Risk, Skewed Generalized Error Distribution, Backtesting

1. Introduction

Due to global trades, economic and policy uncertainties, the world dry bulk shipping market is characterized as a high-risk and highly volatile market, which brings various risks and opportunities to market participants [1] .

Value-at-risk (VaR) is widely used by financial institutions and Banks as a standard tool for quantifying market risks [2] . Chao [3] applied the VaR model to analyze the Normal, Student-t (ST) and Skewed Student-T (SST) distribution performance to assess the risk of dry bulk freight charges, and considered SST distributed asymmetric long memory volatility structure can obtain accurate VaR measurements.

Most of the researches on risk forecasting of the shipping market are based on the selection and comparison of the volatility model, yet the modeling of the returns distributions is also an important factor affecting the VaR estimation [4] . Numerous studies have confirmed asset returns which generally exhibit Leptokurtosis and Skewness features [5] . In order to better capture these characteristics, many scholars began to seek more reasonable distribution hypotheses. The generalized error distribution (GED) is a commonly used distribution characterizing the heavy-tailedness. Theodossiou [6] then proposed the Skewed Generalized Error Distribution (SGED), which has shown good performance in market risk prediction research. Bollerslev [7] pioneered ST distribution that can characterize the heavy-tailedness but not consider the skewness. Hansen [8] further proposed the SST distribution based on the ST distribution. Ferreira [9] extended the skew of the normal distribution, skewed-normal distribution (SN). The GH distributions proposed by Barndorff-Nielsen [10] derive different subclasses according to the parameter settings to form a flexible distribution family. The Norm Inverse Gaussian (NIG) distribution can well describe the asymmetry of the asset returns, and both tails are half-thick tails, which are more suitable for fitting data with less thick tails. The Hyperbolic distribution (HYP), is the easiest subclass of the GH family and often preferred for practical applications. Aas [11] later extended the Generalized Hyperbolic Skew-Student (GHST) distribution, which has a polynomial in the GH family and a unique exponential behavior.

Except for VaR forecasting, backtesting is also responsible for assessing the accuracy of risk prediction models, is also significant in market risk forecasting, and is related to the rigor of conclusions [12] . The most common backtesting method is unconditional coverage test (UC test) following Kupiec [13] . Christoffersen [14] then proposed the conditional coverage test; the dynamic quantile test proposed by Engle [15] has also become a more common test; Dumitrescu [16] pointed out that each method has certain limitations, and different types of backtesting should be used as much as possible in actual research.

This study makes three contributions: First, VaR is largely dependent on volatility estimation, and previous studies on risk forecasting have almost focused on the selection and comparison of different volatility models. This paper forecasts the VaR value for One Day Ahead1 from the perspective of statistical distribution modeling. Second, totally nine distributions are conducted to model the characters of the dry bulk return distribution: Normal, SN, ST, GED, SGED, SST, HYP, GHST and NIG, then we provide empirical evidence on whether the alternative distributions, some of which have significant advantages over those commonly used distributions on describing the tail phenomena of dry bulk returns, could improve the VaR prediction accuracy in dry bulk shipping markets. Furthermore, this paper makes the VaR predictions on both long position that represents the shape of left tail and short position shaped by short tail, which can provide more robust conclusions. Third, as there is no evidence that any backtesting methods have absolute advantage over any other, so several tests should be used to ensure the robustness. This paper takes all four tests to evaluate each risk model: UC, IND, CC and DQ tests under six quantile levels.

The remainder of this paper is as follows: Section 2 introduces risk prediction model based on different distributions; Section 3 reviews the backtests; Section 4 provides data descriptions and preliminary analysis; Section 5 introduces empirical results; Section 6 concludes.

2. Methodology

2.1. Freight Rate Volatility Models

The excess returns in dry bulk shipping markets are specified as:

${r}_{t}={m}_{t}+{\epsilon}_{t}={m}_{t}+{\sigma}_{t}{z}_{t}$ (1)

where ${m}_{t}$ and ${\sigma}_{t}$ are the conditional mean and standard deviation, and assume that ${z}_{t}$ follows the standard distributions used in this study.

This paper chooses the GJR-GARCH model [17] to model the volatility, which can describe the negative impact of the moment than the positive impact on the variance of the moment, and is more suitable for studying the asymmetric leverage problem of the dry bulk market. For the GJR-GARCH model, variance ${\sigma}_{t}^{2}$ is defined as:

${\sigma}_{t}^{2}=\omega +\left({\beta}_{0}+\gamma {I}_{t-1}\right){\epsilon}_{t-1}^{2}+{\beta}_{1}{\sigma}_{t-1}^{2}$ (2)

where if ${r}_{t-1}\ge {m}_{t}$ ,then ${I}_{t-1}=0$ ; if ${r}_{t-1}<{m}_{t}$ , then ${I}_{t-1}=1$ ; parameter $\gamma $ represents the leverage factor. In addition, all parameters in this paper are estimated by the maximum likelihood method.

2.2. Modeling the Distributions

This section describes the distribution model used for modeling. Theodossiou extends the GED distribution to accommodate the skewness and leptokurtosis of the returns empirical distribution. The probability density function of the standardized SGED distribution is expressed as follows:

${f}_{SGED}\left(x;\alpha ;\nu ;u;\sigma \right)=\frac{\nu \Gamma {\left(\frac{1}{\nu}\right)}^{-1}}{2\theta \sigma}\mathrm{exp}\left[-\frac{{\left|x-\mu +\delta \sigma \right|}^{\nu}}{{\left[1-sign\left(x-\mu +\delta \sigma \right)\alpha \right]}^{\nu}{\theta}^{\nu}{\sigma}^{\nu}}\right]$ (3)

where

$\theta =\Gamma {\left(\frac{1}{\nu}\right)}^{\frac{1}{2}}\Gamma {\left(\frac{3}{\nu}\right)}^{-\frac{1}{2}}S{\left(\alpha \right)}^{-1}$ , $\delta =2\alpha S{\left(\alpha \right)}^{-1}\Gamma \left(\frac{2}{v}\right)\Gamma {\left(\frac{1}{\nu}\right)}^{-\frac{1}{2}}\Gamma {\left(\frac{3}{\nu}\right)}^{-\frac{1}{2}}$ ,

$S\left(\alpha \right)=\sqrt{1+3{\alpha}^{2}-4{A}^{2{\alpha}^{2}}}$ , $\alpha $ is the skewness parameter, $\alpha \in \left(0,1\right)$ ; $\nu $ is the shape parameter controls the height and heavy tails, and $\nu >0$ , $sign(\u2022)$ is the sign function, $\Gamma (\u2022)$ is is the Gamma function, SGED reduces to GED when $\alpha =0$ . Setting $\nu =2$ , it reduces to the standardized normal distribution. Refer to Theodossiou (2015) [18] for more details.

Next is the SST distribution which can describe both the heavy-tailedness and skewness proposed by Hanson. Its probability density function is expressed as:

${f}_{SST}\left(x,\alpha ,\nu ,\mu ,\sigma \right)=\{\begin{array}{l}\frac{1}{\sigma}K\left(\nu \right){\left[1+\frac{1}{\nu}{\left(\frac{x-\mu}{2\alpha \sigma}\right)}^{2}\right]}^{\frac{-\left(\nu +1\right)}{2}},\text{\hspace{0.17em}}\text{\hspace{0.17em}}\text{\hspace{0.17em}}\text{\hspace{0.17em}}\text{\hspace{0.17em}}\text{\hspace{0.17em}}\text{\hspace{0.17em}}\text{\hspace{0.17em}}\text{\hspace{0.17em}}\text{\hspace{0.05em}}\text{\hspace{0.05em}}\text{\hspace{0.17em}}x\le \mu \\ \frac{1}{\sigma}K\left(\nu \right){\left[1+\frac{1}{\nu}{\left(\frac{x-\mu}{2\left(1-\alpha \right)\sigma}\right)}^{2}\right]}^{\frac{-\left(\nu +1\right)}{2}},\text{\hspace{0.17em}}\text{\hspace{0.17em}}\text{\hspace{0.17em}}\text{\hspace{0.17em}}x>\mu \end{array}$ (4)

where $K\left(\nu \right)=\frac{\Gamma \left(\left(\nu +1\right)/2\right)}{\sqrt{\text{\pi}\nu}\Gamma \left(\nu /2\right)}$ , when $\alpha =0.5$ , the above function becomes the general form of ST; Further when $\nu =\infty $ , the above function is simplified to the general form of SN.

Finally the GH distribution family, HYP, GHST, and NIG are all specific distributions of GH distribution parameterization constraints. The standardized density function of the GH distribution is as follows:

${f}_{GH}\left(x,\alpha ,\sigma ,\delta ,\lambda ,\mu \right)=\frac{{\left({\delta}^{2}-{\alpha}^{2}\right)}^{\frac{\lambda}{2}}{K}_{\lambda -\frac{1}{2}}\left(\delta \sqrt{{\sigma}^{2}+{\left(x-\mu \right)}^{2}}\right)\mathrm{exp}\left(\alpha \left(x-\mu \right)\right)}{\sqrt{2\text{\pi}}{\delta}^{\lambda -1/2}{\sigma}^{\lambda}{K}_{\lambda}\left(\sigma \sqrt{{\delta}^{2}-{\alpha}^{2}}\right){\left(\sqrt{{\sigma}^{2}+{\left(x-\mu \right)}^{2}}\right)}^{1/2-\lambda}}$ (5)

where ${K}_{j}$ is a modified Bessel function of the third order, which determines the shape of the distribution, $\alpha $ and $\delta $ are the shape parameters, $\mu $ determines the location of the distribution.

when $\lambda =1$ , function (6) is simplified as follows:

$\begin{array}{l}{f}_{HYP}\left(x,\alpha ,\sigma ,\delta ,\mu \right)\\ =\frac{\sqrt{{\delta}^{2}-{\alpha}^{2}}}{2\alpha \sigma {K}_{1}\left(\sigma \sqrt{{\delta}^{2}-{\alpha}^{2}}\right)}\mathrm{exp}\left(-\delta \sqrt{{\sigma}^{2}+{\left(x-\mu \right)}^{2}}+\alpha \left(x-\mu \right)\right)\end{array}$ (6)

This is the density function of the hyperbolic distribution (HYP), which is the easiest subclass of the generalized hyperbolic distribution family and is often preferred as a practical application.

when $\lambda =-\frac{1}{2}$ , a normal inverse Gaussian (NIG) distribution can be obtained with a density function:

$\begin{array}{l}{f}_{NIG}\left(x,\alpha ,\sigma ,\mu ,\delta \right)\\ =\frac{\alpha}{\text{\pi}}\mathrm{exp}\left(\sigma |\sqrt{{\delta}^{2}-{\alpha}^{2}}+\alpha \left(x-\mu \right)\right)\frac{\sigma {K}_{1}\left(\delta \sqrt{{\sigma}^{2}+{\left(x-\mu \right)}^{2}}\right)}{\sqrt{{\sigma}^{2}+{\left(x-\mu \right)}^{2}}}\end{array}$ (7)

when $\lambda =-\frac{\nu}{2},\sigma \to \left|\alpha \right|$ , then we can get the generalized hyperbolic Skew Student-T distribution and its density function is:

$\begin{array}{l}{f}_{GHST}\left(x,\nu ,\delta ,\mu \right)\\ =\{\begin{array}{l}\frac{{2}^{\frac{1-\nu}{2}}{\delta}^{\nu}{\left|\beta \right|}^{\frac{\nu +1}{2}}{K}_{\frac{\nu +1}{2}}\left(\sqrt{{\beta}^{2}\left({\delta}^{2}+{\left(x-\mu \right)}^{2}\right)}\right)\mathrm{exp}\left(\beta \left(x-\mu \right)\right)}{\Gamma \left(\frac{\nu}{2}\right)\sqrt{\text{\pi}}{\left(\sqrt{{\delta}^{2}+{\left(x-\mu \right)}^{2}}\right)}^{\frac{\nu +1}{2}}},\text{\hspace{0.17em}}\text{\hspace{0.17em}}\text{\hspace{0.17em}}\beta \ne 0\\ \frac{\Gamma \left(\frac{\nu +1}{2}\right)}{\sqrt{\text{\pi}}\delta \Gamma \left(\frac{\nu}{2}\right)}{\left[1+\frac{{\left(x-\mu \right)}^{2}}{{\delta}^{2}}\right]}^{-\frac{\nu +1}{2}},\text{\hspace{0.17em}}\text{\hspace{0.17em}}\text{\hspace{0.17em}}\text{\hspace{0.17em}}\text{\hspace{0.17em}}\text{\hspace{0.17em}}\text{\hspace{0.17em}}\text{\hspace{0.17em}}\text{\hspace{0.17em}}\text{\hspace{0.17em}}\text{\hspace{0.17em}}\text{\hspace{0.17em}}\text{\hspace{0.17em}}\text{\hspace{0.17em}}\text{\hspace{0.17em}}\text{\hspace{0.17em}}\text{\hspace{0.17em}}\text{\hspace{0.17em}}\text{\hspace{0.17em}}\text{\hspace{0.17em}}\text{\hspace{0.17em}}\text{\hspace{0.17em}}\text{\hspace{0.17em}}\text{\hspace{0.17em}}\text{\hspace{0.17em}}\text{\hspace{0.17em}}\text{\hspace{0.17em}}\text{\hspace{0.17em}}\text{\hspace{0.17em}}\text{\hspace{0.17em}}\text{\hspace{0.17em}}\text{\hspace{0.17em}}\text{\hspace{0.17em}}\text{\hspace{0.17em}}\text{\hspace{0.17em}}\text{\hspace{0.17em}}\text{\hspace{0.17em}}\text{\hspace{0.17em}}\text{\hspace{0.17em}}\beta =0\end{array}\end{array}$ (8)

3. VaR Estimating and Backtesting Methodologies

3.1. VaR Calculation

This paper takes VaR as the risk forecasting measures, for a given time horizon and confidence level q, setting $\alpha =1-q$ , the VaR is equal to:

$Va{R}_{t}^{\alpha}={m}_{t+1\text{|}t}+{z}_{\alpha}{\sigma}_{t+1|t}$ (9)

where ${m}_{t+1|t}=E\left({m}_{t+1|t}|{I}_{t}\right)$ is the conditional mean, ${I}_{t}$ represents all information sets before the realization of ${r}_{t}$ , ${\sigma}_{t+1|t}$ is the conditional standard deviation. ${z}_{\alpha}$ is the quantile at $\alpha \text{\%}$ returns ${r}_{t}$ .

The previous 2500 observations were used as in-sample. We estimate them using models in Section 2.1 and 2.2 and get the predicted values of ${\sigma}_{t+1|t}$ and ${m}_{t+1|t}$ , then get the first VaR value by formula (8). then by recursively updating parameter estimates, the total forecasted VaRs can be obtained.

3.2. VaR Backtesing

We use four backtesting methods to evaluate the predictive performance of the risk model. The first is Kupiec’s UC test. First, define a Binary Variable sequence associated with the VaR measure “Violation” at a quantile level.

${I}_{t}\left(\alpha \right)=\{\begin{array}{l}1,\text{\hspace{0.17em}}\text{\hspace{0.17em}}\text{\hspace{0.05em}}\text{\hspace{0.05em}}\text{if}\text{\hspace{0.17em}}{r}_{t}<Va{R}_{t}\\ 0,\text{\hspace{0.17em}}\text{\hspace{0.17em}}\text{if}\text{\hspace{0.17em}}{r}_{t}\ge Va{R}_{t}\end{array}$ (10)

when the null hypothesis: the risk measure model for calculating the VaR value is sufficiently accurate) is established, it can be proved that the following likelihood function ratio LR_{uc} satisfies:

$L{R}_{uc}=-2\mathrm{ln}\left\{{\left(1-\alpha \right)}^{{T}_{0}}{\alpha}^{{T}_{1}}/\left[{\left(1-{T}_{1}/T\right)}^{{T}_{0}}{\left({T}_{1}/T\right)}^{{T}_{1}}\right]\right\}~{\chi}^{2}\left(1\right)$ (11)

where T is the total length of the collision sequence, ${T}_{0}$ is the sum of the occurrences when the value is 0 in the sequence, and ${T}_{1}$ is the sum of the number of occurrences when the value in the sequence is 1. At one quantile level, if the calculated LR statistic is greater than the critical value of the distribution with a degree of freedom l at that level, the null hypothesis is rejected; otherwise, the null hypothesis is accepted, the risk metric model employed is considered sufficient precise.

Later, Christoffersen proposed an independence test and a conditional coverage test. The null hypothesis of the independence test is that this “failure event” is independent of the previous one. In the case where the null hypothesis is established, it can be proved that the likelihood function ratio LR_{ind} satisfies:

$L{R}_{ind}=-2\left\{\left[{\left(1-{P}_{2}\right)}^{{n}_{00}+{n}_{10}}{P}_{2}^{{n}_{01}+{n}_{11}}\right]-\mathrm{ln}\left[{\left(1-{P}_{01}\right)}^{{n}_{00}}{P}_{01}^{{n}_{01}}{\left(1-{P}_{11}\right)}^{{n}_{10}}{P}_{11}^{{n}_{11}}\right]\right\}~{\chi}^{2}\left(1\right)$ (12)

${n}_{00}$ indicates the model has been successfully measured in the current period, that is, the actual loss of the current period does not exceed the VaR value, and the number of observation periods that were successful in the previous period. Similarly, if the calculated LR statistic is greater than the distribution threshold at that level, the null hypothesis is rejected; otherwise, the null hypothesis is accepted.

The conditional coverage test is in the case where the null hypothesis is established. It can be proved that the likelihood function ratio LR_{cc} satisfies:

$L{R}_{cc}=L{R}_{uc}+L{R}_{ind}~{\chi}^{2}\left(2\right)$ (13)

Finally, Engle proposed a dynamic quantile DQ test based on the linear regression method of hit variables. The process of the hit function is expressed as:

$Hit\left(\alpha \right)={I}_{t}\left(\alpha \right)-\alpha $ (14)

where ${I}_{t}\left(\alpha \right)$ is a sequence of binary variables in Equation (12). Then perform a linear regression on the following formula:

$Hit=X\lambda +{\epsilon}_{t}$ (15)

where ${\epsilon}_{t}$ is a discrete process with a mean of zero and X is a matrix. In the case where the null hypothesis is established, the DQ statistics should satisfy:

$DQ=\frac{\widehat{\lambda}{X}^{\text{T}}X\widehat{\lambda}}{\alpha \left(1-\alpha \right)}~{\chi}^{2}\left(K\right)$ (16)

Under the quantile $\alpha $ , the DQ statistic is greater than the critical value of the distribution of degrees of freedom, rejecting the null hypothesis; otherwise, accepting the null hypothesis, that is, the risk measure model used is accurate.

4. Data and Preliminary Analysis

This paper selects the Baltic Dry Bulk Daily Freight Index of four sectors in the dry bulk market (Capesize, Panamax, Supramax, Handysize) as samples, that is BCI, BPI, BSI and BHSI. Taking period from September 2006 to December 2017 as the in-sample, and the latter data as the out-sample to evaluate the prediction performance of each risk model. As data contains fluctuations during the 2008 financial crisis, it also challenges the VaR forecasting. Define ${p}_{t}$ as the closing price on day t, and the daily returns are calculated as ${r}_{t}=\left[\mathrm{ln}\left({p}_{t}\right)-\mathrm{ln}\left({p}_{t-1}\right)\right]\ast 100$ . Figure 1 shows daily return series for the four samples. Table 1 gives descriptive statistics.

According to the descriptive statistical results in Figure 1, Figure 2 and Table 1, it can be found that:

Figure 1. Daily returns series of four samples.

Figure 2. Histogram of four samples from dry bulk market.

Table 1. Descriptive statistics of the returns series of different freight index.

Notes: ADF and PP in the table are unit root test; J-B is the Jarque-Bera statistic; LQ(1) is the Ljung and Box statistics of the return series of the 1th order; (** *, **, *) represent significant levels of 1%, 5%, and 10%, respectively.

1) The return series of the four indexes fluctuates greatly. The value of BCI returns is concentrated between −20 and 20, with the largest fluctuation range; the value of BPI returns is concentrated between −10 and 10, while value of BSI and BHSI returns are concentrated between −5 and 5, with relatively small fluctuation range. These results are in line with the real fluctuations in each market, respectively.

2) The skewness of BPI and BHSI are negative, while BCI and BSI positive, which indicates that all the samples display asymmetry. The kurtosis of all the samples is greater than 3, and BSI and BHSI samples is almost 5 - 6 times of the standard value, indicating that all four samples displays significant leptokurtosis.

3) J-B statistics show that the four samples all reject the normal hypothesis. LQ(1) indicates that they are strongly correlated with each other. ADF and PP test results reject the null hypothesis of non-stationary significantly, implying all return series are stationary.

5. Empirical Results

5.1. Estimation for GJR-GARCH Models with Different Distributions

This section discusses parameter estimation of the GJR-GARCH model based on nine statistical distributions. Due to space constraints, Table 2 only shows the BCI estimates.

Table 2. Estimation and diagnostic test results of GJR-GARCH model based on 9 distributions.

Notes: In parenthesis is standard errors. Ln(θ) is the the maximized log-likelihood value. LQ(i) are the Ljung-Box statistics of order i. ***,**, * denote the significance level of 1%, 5%, and 10%, respectively.

From Table 2, the ARCH and GARCH coefficients of all the models are very significant, indicating that the dry bulk shipping market returns display significant volatility clustering. All the shape parameters and heavy-tailed parameters of each model are significant at a 1% level except for the HYP distribution, indicating that the return series are asymmetric, leptokurtosis and heavy-tailedness. In addition, the skewness coefficients of these distributions except for GHST distribution are all significantly positive, indicting the distribution of Capesize dry bulk shipping market returns is right-skewed, which is consistent with the second conclusion of Table 1. Moreover, at the same level of kurtosis, all of the nine distributions perform better in the negative-skewness case compared to the positive skewed one. LQ tests with different lag orders found no autocorrelation in the standardized residues, indicating that each model can capture the dynamics of the returns.

5.2. VaR Estimation Results

In this section, We present the one-day-ahead VaRs with 9 different distributions. Due to space constraints, this paper only shows the Panamax sector of shipping markets under 5% and 95% quantiles. For the sake of clarity, we randomly selected 250 predicted values for display.

Visually, see Figure 3 and Figure 4. There were significant differences of VaR in each model based on different distributions and quantile levels. The absolute values of VaR based on the GH family distributions are relatively larger, which means the risk prediction is more conservative. Of course, more rigorous and reliable conclusions need to be obtained by systematic backtesting analyses.

5.3. Backtesting Results

We use four methods to perform backtesting of each risk model. Tables 3-8 show the results for six quantile levels (1%, 5%, 10%, 99%, 95%, 90%). Table 9 summarizes the total number of rejections from Tables 3-8 to present results in a clearer manner.

Figure 3. 5% VaR forecasting results of different models.

Figure 4. 95% VaR forecasting results of different models.

Table 3. VaR backtesting results based on 1% quantile level.

Note: The above table shows the backtesting results of the four indices at the six quantile level. Columns 3 to 7, columns 10 to 14 report the P-values for each model. ** indicates the significance of P < 0.01; * indicates the significance of P < 0.05.

Table 4. VaR backtesting results based on 5% quantile level.

Note: Same as Table 3.

Table 5. VaR backtesting results based on 10% quantile level.

Note: Same as Table 3.

Table 6. VaR backtesting results based on 99% quantile level.

Note: Same as Table 3.

Table 7. VaR backtesting results based on 95% quantile level.

Note: Same as Table 3.

Table 8. VaR backtesting results based on 90% quantile level.

Note: Same as Table 3.

Table 9. The total rejection results in VaR backtests of four samples at two significant levels.

Note: P < 0.05, P < 0.01 represent the 5% level and 1% level, respectively.

The main conclusions from the results in Tables 3-9 are as follows:

First, most risk prediction models based on the normal distribution display the lowest accuracy. The P values are rejected most at the two significance levels, with 27 rejections at a 1% significance level, 11 rejections at the 5% significance level, 38 times out of 96 cases the P values are rejected at two significance levels, reaching about 39%. It also performs poorly in each type of shipping market from Table 9. The empirical results demonstrate that the normal distribution has the lowest accuracy in predicting the tail risk of the dry bulk shipping market. The GHST distribution was rejected about 34%, second only to the normal distribution, indicating that it can’t well characterize the empirical returns distribution of dry bulk shipping market. In addition, risk prediction models based on commonly used distributions (norm, GED, ST) show a lower accuracy. For the GED distribution, the P values are rejected for 9 times at the 5% significance level and 18 times at the 1% significance level, 27 times out of 96 cases the P values are rejected at two significance levels. But it perform relatively better in the Capesize market, with only 4 rejection times. For the ST distribution, the number of rejections is the same as the GED distribution. These conclusions further suggest when forecasting risks in the dry bulk shipping market, managers should avoid using commonly used distributions, but consider the alternative distributions that can describe the skewness and leptokurtosis features.

Second, due to the different operations of four segments in dry bulk shipping market, the shipping freights volatility and tail risks are also different. As shown in Table 9, risk models based on different distributions perform differently in each market with the best accuracy (marked with lines). Specifically, the backtesting results for BCI and BPI have shown that the SGED distribution exhibits the highest accuracy, with only 3 times rejected at the 5% significant level, all passed at the 1% significance level. The backtesting results for BSI show the SST and HYP distributions have the highest accuracy with a total rejection of 4 times. For BHSI, the HYP distribution performed best, rejecting only one time at the 5% significance level. It is worth noting that from Table 1, BCI and BPI return series is relatively skewed, the leptokurtosis feature less obvious, while the BSI and BSHI returns are more skewed and leptokurtosis. Cause the SGED distribution can well describe the skewness, while the SST and HYP distributions can simultaneously characterize skewness and leptokurtosis of asset returns, which just corresponds to our backtesting results. Therefore, when forecasting and managing the risks of the dry bulk shipping market, participants should consider a more appropriate and accurate empirical distribution according to different ship sector.

Third, three alternative distributions (SGED, HYP and SST) generally show better accuracy than commonly used distributions. With HYP distribution, the backtesting results show that for 14 times the P values are rejected at the 1% significance and 6 times at the 5% significance level among the 96 cases, accounting for about 20%. HYP, GHST, NIG distributions are all in the GH family, but GHYP outperforms the other two distinctively. With SGED distribution, the backtesting results show that for 9 times the P values are rejected at the 1% significance level, and 11 times at the 5% significance level, accounting for 17%. With SST distribution, the backtesting results show that for 11 times the P values are rejected at the 1% significance level, and 6 times at the 5% significance level, accounting for 17%, which displays the best accuracy on four samples. Risk prediction models based on these three distributions perform relatively well in the dry bulk shipping market, which provides empirical evidence for risk managers that they can consider SGED, HYP or SST distribution to model and forecast risks.

Finally, compared with symmetric distributions, their skewed extensions perform better in forecasting risks in dry bulk shipping market. The SST distribution extended by the ST distribution is about 9% more accurate than the ST distribution; the accuracy of the SGED distribution extended by the GED distribution is about 6% higher than the GED distribution; and the SN distribution is also about 6% higher than the normal distribution. Even the ST and GED distribution can well capture tail feature of asset returns, it is difficult to provide sufficient accuracy to forecast the risk in the dry bulk market. While considering their skew extensions, it can significantly improve the accuracy of risk prediction models, which further suggests empirical distributions of dry bulk shipping market returns are more skewed but normal. Risk managers should fully consider the skewness of the tail risk when predicting this kind of highly volatile and high-risk market.

5.4. Robustness Test

This section tests the robustness of the main empirical results. Following Lin (2014)’s [19] robustness test for risk prediction models, we select risk models with better performance (SGED, SST, HYP) and redo VaR forecasting over a longer sample period.

Table 10 shows the backtesting results in the new sample period based on the risk models of the three distributions (SGED, SST and HYP), which show a relatively better performance in Section 5.3. Specifically, with HYP distribution, the P values are rejected at the 1% significance for 8 times and at the 5% significance level for 6 times among 96 cases. With SGED distribution, the P values are rejected at the 1% significance for 10 times and at the 5% significance level for 6 times among 96 cases. With SST distribution, the P values are rejected at the 1% significance for 8 times and at the 5% significance level for 5 times among 96 cases. Specifically, the backtesting results in Table 10 are in line with the results in Tables 3-9, indicating the robustness test support Section 5.3.

Table 10. Robustness test result.

Note: The above table shows the backtesting results of the four indices at the six quantile level. Columns 3 to 7, columns 10 to 14 report the P-values for each model. ** indicates the significance of P < 0.01; * indicates the significance of P < 0.05.

6. Conclusion

The environment of the international dry bulk shipping market is complex and volatile, and the price changes are extremely dramatic. In such a highly volatile environment, coupled with the asymmetry and heavy tails of freight rates returns, forecasting market risks is extremely challenging. This paper tests the risk prediction models based on nine different types of distributions from the perspective of short and long positions. The empirical results show that commonly used distributions i.e. the norm, ST, and GED distributions perform poorly in the highly volatile dry bulk shipping market, while risk models based on SST, SGED and HYP distribution perform better in general. This study provides some theoretical basis for market participants. First, when risk managers forecast the tail risks in the dry bulk shipping market, they should avoid using some common distributions, and consider SST, SGED and HYP distributions to describe skewness and leptokurtosis of returns. Secondly, risk managers should select distributions with best risk forecasting ability for different shipping sectors, which can more accurately measure the extreme risks for dry bulk shipping freight rates and further improve risk forecasting and management ability. Finally, this research will inevitably have certain limitations. For example, the backtesting can be more comprehensive; further consideration can be given to risk prediction indicators using Expected Shortfall (ES).

Conflicts of Interest

The author declares no conflicts of interest regarding the publication of this paper.

Cite this paper

Du, Q.N. (2019) Forecasting and Backtesting of VaR in International Dry Bulk Shipping Market under Skewed Distributions. American Journal of Industrial and Business Management, 9, 1168-1186. https://doi.org/10.4236/ajibm.2019.95079

References

- 1. Alexandridis, G., Kavussanos, M.G. and Kim, C.Y. (2018) A Survey of Shipping Finance Research: Setting the Future Research Agenda. Transportation Research Part E: Logistics and Transportation Review, 115, 164-212. https://doi.org/10.1016/j.tre.2018.04.001
- 2. Pérignon, C. and Smith, D. (2010) The Level and Quality of Value-at-Risk Disclosure by Commercial Banks. Journal of Banking & Finance, 34, 362-377. https://doi.org/10.1016/j.jbankfin.2009.08.009
- 3. Chang, C.C., Chou, H.C. and Wu, C.C. (2014) Value-at-Risk Analysis of the Asymmetric Long-Memory Volatility Process of Dry Bulk Freight Rates. Maritime Economics & Logistics, 16, 298-320. https://doi.org/10.1057/mel.2014.13
- 4. Cheu, Q., Gerlach, R. and Lu, Z. (2012) Bayesian Value-at-Risk and Expected Shortfall Forecasting via the Asymmetric Laplace Distribution. Computational Statistics and Data Analysis, 56, 3498-3516. https://doi.org/10.1016/j.csda.2010.06.018
- 5. Pagan, A. (1996) The Econometrics of Financial Markets. Journal of Empirical Finance, 3, 15-102. https://doi.org/10.1016/0927-5398(95)00020-8
- 6. Theodossiou, P. (2001) Skewed Generalized Error Distribution of Financial Assets and Option Pricing. Working Paper, School of Business and Rutgers University, Piscataway. https://doi.org/10.2139/ssrn.219679
- 7. Bollerslev, T. (1987) A Conditional Heteroskedastic Time Series Model for Security Prices and Rates of Return Data. The Review of Economics and Statistics, 69, 542-547. https://doi.org/10.2307/1925546
- 8. Hansen, B.E. (1994) Autoregressive Conditional Density Estimation. International Economic Review, 35, 705-730. https://doi.org/10.2307/2527081
- 9. Ferreira, J.T.A.S. and Steel, M.F.J. (2006) A Constructive Representation of Univariate Skewed Distributions. Journal of the American Statistical Association, 101, 823-829. https://doi.org/10.1198/016214505000001212
- 10. Barndorff-Nielsen, O. and Blæsild, P. (1983) Hyperbolic Distributions. In: Johnson, N.L., Kotz, S. and Read, C.B., Eds., Encyclopedia of Statistical Sciences, Vol. 3, Wiley Interscience, New York, 700-707.
- 11. Aas, K. and Haff, I.H. (2006) The Generalized Hyperbolic Skew Student’s t-Distribution. Journal of Financial Economics, 4, 275-309. https://doi.org/10.1093/jjfinec/nbj006
- 12. Escanciano, J.C. and Pei, P. (2012) Pitfalls in Backtesting Historical Simulation VaR Models. Journal of Banking & Finance, 36, 2233-2244. https://doi.org/10.1016/j.jbankfin.2012.04.004
- 13. Kupiec, P. (1995) Techniques for Verifying the Accuracy of Risk Measurement Models. The Journal of Derivatives, 3, 73-84. https://doi.org/10.3905/jod.1995.407942
- 14. Christofersen, P. (1998) Evaluating Intervals Forecasts. International Economic Review, 39, 841-862. https://doi.org/10.2307/2527341
- 15. Engle, R.F. and Manganelli, S. (2004) CAViaR: Conditional Autoregressive Value at Risk by Regression Quantiles. Journal of Business & Economic Statistics, 22, 367-381. https://doi.org/10.1198/073500104000000370
- 16. Dumitrescu, E., Hurlin, C. and Pham, V. (2012) Backtesting Value-at-Risk: From Dynamic Quantile to Dynamic Binary Tests. Finance, 33, 79-112.
- 17. Glosten, L.R., Jagannathan, R. and Runkle, D.E. (1993) On the Relation between the Expected Value and the Volatility of Nominal Excess Return on Stocks. Journal of Finance, 48, 1779-1801. https://doi.org/10.1111/j.1540-6261.1993.tb05128.x
- 18. Theodossiou, P. (2015) Skewed Generalized Error Distribution of Financial Assets and Option Pricing. Multinational Finance Journal, 19, 223-266. https://doi.org/10.17578/19-4-1
- 19. Lin, C.H., Changchien, C.C., Kao, T.C. and Kao, W.S. (2014) High-Order Moments and Extreme Value Approach for Value-at-Risk. Journal of Empirical Finance, 29, 421-434. https://doi.org/10.1016/j.jempfin.2014.10.001

NOTES

^{1}As the forecast time horizon expanded, the performance of risk forecasting model will be greatly reduced, and risk managers generally pay more attention to short-term risk (Hung, Lee & Liu; 2008), Therefore, this paper sets the forecast period to 1 day, that is, calculates the VaR for one-day-ahead.