Database optimization for large-scale web access log management

Minjae Lee, Jaehun Lee, Dohyung Kim, Taeil Kim, Sooyong Kang

Research output: Chapter in Book/Report/Conference proceedingConference proceeding contribution

Abstract

In this research, we investigate an optimal method of commercial DBMS for analyzing large-scale web access log. Also, we develop the pre-processor in memory structure to improve performance and the user management tool for user friendliness. The optimal method of DBMS for management of large-scale web access log is the key issue in this research. We have three stages for this research. The first stage in research is data collection. In this stage, we study characteristics of large-scale web access log data and investigate commercial DBMS tuning techniques. The next stage, we design the system model. The proposed system has three components including pre-processor, DBMS and management tool. To improve the effectiveness the system, Pre-processor hash and sort log data in memory. And we perform DBMS tuning to improve performance. The final stage, we implement system and evaluate the performance. And we develop system management tool for user friendliness. The research output of this project can be divided into analysis of large-scale DBMS, DBMS tuning and system management software. From output, we provide DBMS tuning techniques for large-scale data log. Also it is expected to use of collected data and analyzed information in other area such as network security.

Original languageEnglish
Title of host publicationICDIPC 2013
Subtitle of host publication3rd International Conference on Digital Information Processing and Communications
Place of PublicationHong Kong
PublisherSociety of Digital Information and Wireless Communications (SDIWC)
Pages296-302
Number of pages7
ISBN (Print)9781510808560
Publication statusPublished - 2013
Externally publishedYes
Event3rd International Conference on Digital Information Processing and Communications, ICDIPC 2013 - Dubai, United Arab Emirates
Duration: 30 Jan 20131 Feb 2013

Other

Other3rd International Conference on Digital Information Processing and Communications, ICDIPC 2013
CountryUnited Arab Emirates
CityDubai
Period30/01/131/02/13

Keywords

  • Data mining
  • Database
  • Hash table
  • Pre-processor
  • Web access log

Fingerprint Dive into the research topics of 'Database optimization for large-scale web access log management'. Together they form a unique fingerprint.

Cite this