Statistics Collection

Visitor statistics are gathered with the help of a counter and through the logs analysis. A specially developed application downloads logs from the server on a daily basis via an FTP-protocol, saves them locally, imports into an MSSQL database and runs a post-processing procedure. During the import, the application extracts characteristics of the user agents; splits referrers into domains, paths and query strings; detects the most popular search engines and extract phrases; splits IP addresses into octets and saves sessions IDs into a separate field. After that, an SQL server executes a final data processing procedure to extend the data with client's geographic location and time spent on every page, plus identify crawlers.