.

Bootstrap aggregating (**bagging**), is a very useful averaging method to improve accuracy and avoids overfitting, in modeling the time series. It also helps stability so that we don’t have to do Box-Cox transformation to the data.

Modeling time series data is difficult because the data are autocorrelated. In this case, **moving block bootstrap (MBB)** should be preferred because MBB resamples the data inside overlapping blocks to imitate the autocorrelation in the data. If the length of a time series, **n**, and the block size **l**, the number of overlapping blocks are found as below:

What we mean by overlapping block is that observation 1 to l would be block 1, observation 2 to l+1 would be block 2, etc. We should use a block size for at least two years(**l=24**) for monthly data because we have to be certain whether there is any remaining seasonality in the block.

From these **n-l+1** blocks, **n/l** blocks will be selected randomly and they will be gathered in order, to build the bootstrap observations. The time series values can be repetitive in different blocks.

This bootstrap process would be exercised to the remainder component after the time series decomposition. If there is seasonality it is used the stl function(trend, seasonal, remainder) otherwise the loess function(trend, remainder) is chosen for the decomposition. It should not be forgotten that the data has to be stationary in the first place.

Box-Cox transformation is made at the beginning but back-transformed at the end of the process; as we mentioned before, when we do average all the bootstrapped series, which is called **bagging**, we could handle the non-stability data problem and improve accuracy compared to the original series.

As we remembered from the previous two articles, we have tried to model gold prices per gram in Turkey. We have determined the ARIMA model the best for forecasting. This time, we will try to improve using the bagging mentioned above.

In order to that, we will create a function that makes bootstrapping simulations and builds the prediction intervals we want. We will adjust the simulation number, model, and confidence level as default. We will use the assign function to make the **bagged **data(**simfc**) as a global variable, so we will able to access it outside the function as well.

`#Simulation function` `library` `(purrr)` `library` `(forecast)` `sim_forecast <- ` `function` `(data, nsim=100L, h, mdl=auto.arima, level=95){` ` ` ` ` `sim <-` `bld.mbb.bootstrap` `(data, nsim)` ` ` ` ` `h <-` `as.integer` `(h)` ` ` `future <-` `matrix` `(0, nrow=nsim, ncol=h)` ` ` ` ` `future <- sim %>%` `map` `(` `function` `(x){` `simulate` `(` `mdl` `(x),nsim=h)}) %>%` ` ` `unlist` `() %>%` `matrix` `(ncol = h, nrow = nsim, byrow =` `TRUE` `)` ` ` ` ` `start < -` `tsp` `(data)[2]+1/12` ` ` ` ` `simfc <-` `structure` `(` `list` `(` ` ` ` ` `mean = future %>%` `colMeans` `() %>%` `ts` `(start = start, frequency = 12),` ` ` ` ` `lower = future %>%` `as.data.frame` `() %>%` ` ` `map_dbl` `(quantile, prob = (1-level/100)/2) %>%` ` ` `ts` `(start = start,frequency = 12),` ` ` ` ` `upper = future %>%` `as.data.frame` `() %>%` ` ` `map_dbl` `(quantile, prob = (1-level/100)/2+level/100) %>%` ` ` `ts` `(start = start,frequency = 12),` ` ` ` ` `level=level),` ` ` `class=` `"forecast"` `)` ` ` ` ` `assign` `(` `"simfc"` `,simfc,envir = .GlobalEnv)` ` ` ` ` `simfc` ` ` `}` |

Because of the averaging part of the bagging, we don’t use the lambda parameter of Box-Cox transformation for the stability of the variance. We can see the forecasting results for 18 months in %95 confidence interval for training set below. We can also change the model type or confidence level if we want.

`sim_forecast` `(train, h=18)` ` ` `Point Forecast Lo 95 Hi 95` `#Mar 2019 242.3121 215.5464 268.2730` `#Apr 2019 243.4456 206.4015 274.5155` `#May 2019 249.9275 216.8712 283.4226` `#Jun 2019 252.8518 219.7168 283.0535` `#Jul 2019 259.0699 216.7776 302.4991` `#Aug 2019 267.2599 219.5771 310.7458` `#Sep 2019 270.8745 214.1733 324.4255` `#Oct 2019 272.0894 215.1619 333.2733` `#Nov 2019 275.5566 213.8802 337.9301` `#Dec 2019 280.3914 219.2063 349.1284` `#Jan 2020 291.4792 215.9117 364.1899` `#Feb 2020 296.3475 221.9117 380.2887` `#Mar 2020 302.0706 219.0779 399.1135` `#Apr 2020 304.4595 217.5600 400.7724` `#May 2020 310.8251 217.5561 420.6515` `#Jun 2020 315.5942 221.5791 431.9727` `#Jul 2020 322.4536 220.4798 452.4229` `#Aug 2020 331.1163 223.3746 465.2015` |

We will create the Arima model as same as we did before and compare it with a bagged version of it in a graph.

`arimafc <- train %>%` ` ` `auto.arima` `(stepwise =` `FALSE` `,approximation =` `FALSE` `,` ` ` `seasonal =` `FALSE` `, lambda =` `"auto"` `) %>%` ` ` `forecast` `(h=h,level=95)` `autoplot` `(train) +` ` ` `ggtitle` `(` `"Monthly Golden Price per Gram"` `) +` ` ` `xlab` `(` `"Year"` `) +` `ylab` `(` `"Price"` `) +` ` ` `autolayer` `(test, series=` `"Real values"` `,PI=` `FALSE` `) +` ` ` `autolayer` `(simfc, series=` `"Bagged ARIMA"` `,PI=` `FALSE` `) +` ` ` `autolayer` `(arimafc, series=` `"ARIMA"` `,PI=` `FALSE` `)+` ` ` `theme_light` `()` |

When we examine the above plot, we can see that the bagged Arima model is smoother and more accurate compared to the classic version; but it is seen that when the forecasting horizon increases, both models are failed to capture the uptrend.

In the below, we are comparing the accuracy of models in numeric. We can easily see the difference in the accuracy level that we saw in the plot. The reason **NaN** values of the simulated version is that there is no estimation of fitted values(one-step forecasts) in the training set.

`#Accuracy comparison` `acc_arimafc <- arimafc %>%` `accuracy` `(test)` `acc_arimafc[,` `c` `(` `"RMSE"` `,` `"MAPE"` `)]` `# RMSE MAPE` `#Training set 9.045056 3.81892` `#Test set 67.794358 14.87034` `acc_simu <- simfc %>%` `accuracy` `(test)` `acc_simu[,` `c` `(` `"RMSE"` `,` `"MAPE"` `)]` `# RMSE MAPE` `#Training set NaN NaN` `#Test set 54.46326 8.915361` |

**Conclusion**

When we examine the results we have found, it is seen that bootstrapping simulation with averaging (bagging) improves the accuracy significantly. Besides that, due to the simulation process, it can be very time-consuming.

*The original article can be found here.*

**References**

- Forecasting: Principles and Practice,
*Rob J Hyndman and George Athanasopoulos* - Bagging Exponential Smoothing Methods usingSTL Decomposition and Bo...,
*Christoph Bergmeira, Rob J Hyndmanb, Jos ́e M Benitez* - Block Bootstrap, Wikipedia
- Bootstrap aggregating, Wikipedia

Views: 289

Tags: arima, bagging, bootstrapping, dsc_analytics, dsc_code, dsc_tagged, simulation, time-series-forecasting

- Using a business rules engine to streamline decision-making
- IBM boosts vertical cloud push with financial services cloud
- Exploring GRC automation benefits and challenges
- Check model accuracy with Facebook AI's new data set
- AR use cases gain ground due to COVID-19, maturing tech
- Air Force's data overhaul makes analytics a priority
- AI adoption in the supply chain requires a strategic approach
- New DataRobot CEO sees bright AI future for the vendor
- Why consider an augmented data catalog?
- Consider IoT TPM security to augment existing protection
- 11 Best Data Science Blogs to Follow

Posted 12 April 2021

© 2021 TechTarget, Inc. Powered by

Badges | Report an Issue | Privacy Policy | Terms of Service

**Most Popular Content on DSC**

To not miss this type of content in the future, subscribe to our newsletter.

- Book: Applied Stochastic Processes
- Long-range Correlations in Time Series: Modeling, Testing, Case Study
- How to Automatically Determine the Number of Clusters in your Data
- New Machine Learning Cheat Sheet | Old one
- Confidence Intervals Without Pain - With Resampling
- Advanced Machine Learning with Basic Excel
- New Perspectives on Statistical Distributions and Deep Learning
- Fascinating New Results in the Theory of Randomness
- Fast Combinatorial Feature Selection

**Other popular resources**

- Comprehensive Repository of Data Science and ML Resources
- Statistical Concepts Explained in Simple English
- Machine Learning Concepts Explained in One Picture
- 100 Data Science Interview Questions and Answers
- Cheat Sheets | Curated Articles | Search | Jobs | Courses
- Post a Blog | Forum Questions | Books | Salaries | News

**Archives:** 2008-2014 |
2015-2016 |
2017-2019 |
Book 1 |
Book 2 |
More

**Most popular articles**

- Free Book and Resources for DSC Members
- New Perspectives on Statistical Distributions and Deep Learning
- Time series, Growth Modeling and Data Science Wizardy
- Statistical Concepts Explained in Simple English
- Machine Learning Concepts Explained in One Picture
- Comprehensive Repository of Data Science and ML Resources
- Advanced Machine Learning with Basic Excel
- Difference between ML, Data Science, AI, Deep Learning, and Statistics
- Selected Business Analytics, Data Science and ML articles
- How to Automatically Determine the Number of Clusters in your Data
- Fascinating New Results in the Theory of Randomness
- Hire a Data Scientist | Search DSC | Find a Job
- Post a Blog | Forum Questions

## You need to be a member of Data Science Central to add comments!

Join Data Science Central