Data with high frequency have a particular type of none stationary that is called fractional none stationary. This property causes the emergence of long-term memory in financial time series with high frequency. The existence of long-term memory in cement industry time-series is studied in this paper at first and its presence will be confirmed in a high confidence level by two tests R/S and GPH. Next, the accuracy of financial time-series forecast models such as ARMA and GARCH which don't consider the feature of long-term memory in time series modeling and models such as ARFIMA and FIGARCH that take this feature into account are compared with presented new meta heuristic that is composed of algorithm (harmony search) and weighted fuzzy time series by the way of rolling window and by the use of Root Mean Square Error criteria (RMSE) in different time intervals. The results show that the presented Meta heuristic method submits better result of common econometric models in all time intervals.