skip to main content
10.1145/2464464.2464521acmconferencesArticle/Chapter ViewAbstractPublication PageswebsciConference Proceedingsconference-collections
research-article

Modeling movements in oil, gold, forex and market indices using search volume index and Twitter sentiments

Published:02 May 2013Publication History

ABSTRACT

Study of the forecasting models using large scale microblog discussions and the search behavior data can provide a good insight for better understanding the market movements. In this work we collected a dataset of 2 million tweets and search volume index (SVI from Google) for a period of June 2010 to September 2011. We model a set of comprehensive causative relationships over this dataset for various market securities like equity (Dow Jones Industrial Average-DJIA and NASDAQ-100), commodity markets (oil and gold) and Euro Forex rates. We also investigate the lagged and statistically causative relations of Twitter sentiments developed during active trading days and market inactive days in combination with the search behavior of public before any change in the prices/indices. Our results show extent of lagged significance with high correlation value upto 0.82 between search volumes and gold price in USD. We find weekly accuracy in direction (up and down prediction) uptil 94.3% for DJIA and 90% for NASDAQ-100 with significant reduction in mean average percentage error for all the forecasting models.

References

  1. Bollen, J., Mao, H., and Zeng, X.-J. Twitter mood predicts the stock market. Computer 1010, 3003v1 (2010), 1--8.Google ScholarGoogle Scholar
  2. Box, G. E. P., and Jenkins, G. Time Series Analysis, Forecasting and Control. Holden-Day, Incorporated, 1990. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. boyd, d. m., and Ellison, N. B. Social network sites: Definition, history, and scholarship. Journal of Computer-Mediated Communication 13, 1 (2007), 210--230.Google ScholarGoogle ScholarCross RefCross Ref
  4. Da, Z., Engelberg, J., and Gao, P. In search of attention. Russell The Journal Of The Bertrand Russell Archives, 919 (2010).Google ScholarGoogle Scholar
  5. Das, S. R., and Chen, M. Y. Yahoo! for Amazon: Sentiment Parsing from Small Talk on the Web. SSRN eLibrary (2001).Google ScholarGoogle Scholar
  6. Dewally, M. Internet investment advice: Investing with a rock of salt. Financial Analysts Journal 59, 4 (2003), 65--77.Google ScholarGoogle ScholarCross RefCross Ref
  7. Frank, M. Z., and Antweiler, W. Is All That Talk Just Noise? The Information Content of Internet Stock Message Boards. SSRN eLibrary (2001).Google ScholarGoogle Scholar
  8. Garman, M. B., and Klass, M. J. On the estimation of security price volatilities from historical data. The Journal of Business 53, 1 (1980), 67--78.Google ScholarGoogle ScholarCross RefCross Ref
  9. Gilbert, E., and Karahalios, K. Widespread worry and the stock market. Artificial Intelligence (2010), 58--65.Google ScholarGoogle Scholar
  10. Go, A., Bhayani, R., and Huang, L.Google ScholarGoogle Scholar
  11. Guresen, E., Kayakutlu, G., and Daim, T. U. Using artificial neural network models in stock market index prediction. Expert Systems with Applications 38, 8 (2011), 10389--10397. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Karabulut, Y. Can Facebook Predict Stock Market Activity? SSRN eLibrary (2011).Google ScholarGoogle Scholar
  13. Mao, H., Counts, S., and Bollen, J. Predicting financial markets: Comparing survey, news, twitter and search engine data. Quantitative Finance Papers 1112.1051, arXiv.org, Dec. 2011.Google ScholarGoogle Scholar
  14. Mao, H., Counts, S., and Bollen, J. Predicting Financial Markets: Comparing Survey, News, Twitter and Search Engine Data. ArXiv e-prints (Dec. 2011).Google ScholarGoogle Scholar
  15. McCormick, G. P. Communications to the editorexponential forecasting: Some new variations. Management Science 15, 5 (1969), 311--320.Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Miao, H., Ramchander, S., and Zumwalt, J. K. Information Driven Price Jumps and Trading Strategy: Evidence from Stock Index Futures. SSRN eLibrary (2011).Google ScholarGoogle Scholar
  17. Nofsinger, J. R. Social mood and financial economics. Journal of Behavioral Finance 6, 3 (2005), 144--160.Google ScholarGoogle ScholarCross RefCross Ref
  18. Qian, B., and Rasheed, K. Stock market prediction with multiple classifiers. Applied Intelligence 26 (February 2007), 25--33. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Ruiz, E. J., Hristidis, V., Castillo, C., Gionis, A., and Jaimes, A. Correlating financial time series with micro-blogging activity. In Proceedings of the fifth ACM international conference on Web search and data mining, WSDM '12, ACM (New York, NY, USA, 2012), 513--522. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Sabani, L. Forecasting structural time series models and the kalman filter, a. c. harvey. cambridge university press, cambridge, 1989. isbn 0-521-32196-4, cloth, 55.00 pp. xvi + 554. Journal of Applied Econometrics 6, 3 (1991), 329--331.Google ScholarGoogle ScholarCross RefCross Ref
  21. Sprenger, T. O., and Welpe, I. M. Tweets and Trades: The Information Content of Stock Microblogs. SSRN eLibrary (2010).Google ScholarGoogle Scholar
  22. Tversky, A., and Kahneman, D. Prospect theory: An analysis of decision under risk. Tech. rep., 1979.Google ScholarGoogle Scholar
  23. Zhang, X., Fuehres, H., and Gloor, P. A. Predicting stock market indicators through twitter i hope it is not as bad as i fear. Anxiety (2009), 1--8.Google ScholarGoogle Scholar

Index Terms

  1. Modeling movements in oil, gold, forex and market indices using search volume index and Twitter sentiments

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      WebSci '13: Proceedings of the 5th Annual ACM Web Science Conference
      May 2013
      481 pages
      ISBN:9781450318891
      DOI:10.1145/2464464

      Copyright © 2013 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 2 May 2013

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article

      Acceptance Rates

      Overall Acceptance Rate218of875submissions,25%

      Upcoming Conference

      Websci '24
      16th ACM Web Science Conference
      May 21 - 24, 2024
      Stuttgart , Germany

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader