Re: HELP! Need large httpd access log

dolesa@smtp-gw.spawar.navy.mil
Errors-To: listmaster@www0.cern.ch
Date: Mon, 13 Jun 1994 17:04:52 +0200
Errors-To: listmaster@www0.cern.ch
Message-id: <9405137715.AA771528601@smtp-gw.spawar.navy.mil>
Errors-To: listmaster@www0.cern.ch
Reply-To: dolesa@smtp-gw.spawar.navy.mil
Originator: www-talk@info.cern.ch
Sender: www-talk@www0.cern.ch
Precedence: bulk
From: dolesa@smtp-gw.spawar.navy.mil
To: Multiple recipients of list <www-talk@www0.cern.ch>
Subject: Re: HELP! Need large httpd access log
X-Listprocessor-Version: 6.0c -- ListProcessor by Anastasios Kotsikonas

Bob,

    Sounds like fun!  I'm trying to figure out the SQL thing too... Good luck 
with your projects.  Below is a summary of what's in my log.  If interested, 
I've thrown the file in /pub of my anonymous ftp server (www.spawar.navy.mil).

            Andre'

Totals for Summary Period: Apr 12 1994 to Jun 13 1994
Files Transmitted During Summary Period            9922
Bytes Transmitted During Summary Period       137211198
Average Files Transmitted Daily                     171
Average Bytes Transmitted Daily                 2365710
________________________________________________________________________________
_______________________
Daily Transmission Statistics
%Reqs %Byte  Bytes Sent  Requests   Date
----- ----- ------------ -------- |------------
 0.99  0.84      1153643       98 | Apr 12 1994
 2.06  1.18      1616308      204 | Apr 13 1994
 3.50  1.44      1979324      347 | Apr 14 1994
 2.19  1.67      2288666      217 | Apr 15 1994
 0.20  0.06        79576       20 | Apr 16 1994
 0.07  0.06        81048        7 | Apr 17 1994
 2.03  1.38      1891131      201 | Apr 18 1994
 2.42  1.67      2292443      240 | Apr 19 1994
 2.21  1.11      1529724      219 | Apr 20 1994
 1.23  0.61       831761      122 | Apr 21 1994
 1.20  0.58       795538      119 | Apr 22 1994
 0.72  0.25       349443       71 | Apr 23 1994
 0.29  0.12       165324       29 | Apr 24 1994
 2.89  1.90      2605872      287 | Apr 25 1994
 2.02  1.22      1677640      200 | Apr 26 1994
 1.50  0.67       922196      149 | Apr 28 1994
 2.09  1.94      2666991      207 | Apr 29 1994
 0.14  0.06        75494       14 | Apr 30 1994
 0.23  0.14       195494       23 | May  1 1994
 2.38  1.04      1424374      236 | May  2 1994
 2.66  2.81      3854531      264 | May  3 1994
 1.96  2.23      3057198      194 | May  4 1994
 1.62  1.75      2397261      161 | May  5 1994
 1.25  1.76      2410093      124 | May  6 1994
 0.29  0.19       261450       29 | May  7 1994
 0.07  0.07        90899        7 | May  8 1994
 2.32  3.41      4677780      230 | May  9 1994
 0.90  1.53      2098414       89 | May 10 1994
 2.34  2.21      3028262      232 | May 11 1994
 1.78  2.78      3818112      177 | May 12 1994
 1.15  1.69      2325299      114 | May 13 1994
 0.18  0.12       161802       18 | May 14 1994
 0.15  0.73       996870       15 | May 15 1994
 1.40  1.41      1928507      139 | May 16 1994
 3.05  3.29      4516458      303 | May 17 1994
 2.06  2.18      2989316      204 | May 18 1994
 1.34  1.74      2381070      133 | May 19 1994
 1.60  1.77      2428370      159 | May 20 1994
 0.15  0.26       356123       15 | May 21 1994
 0.12  0.14       189359       12 | May 22 1994
 1.81  2.14      2932022      180 | May 23 1994
 2.28  3.56      4882098      226 | May 24 1994
 3.23  3.62      4962969      320 | May 25 1994
 3.69  5.06      6936446      366 | May 26 1994
 2.78  3.12      4274513      276 | May 27 1994
 0.25  0.25       337058       25 | May 28 1994
 0.41  0.22       304622       41 | May 29 1994
 0.33  0.15       199228       33 | May 30 1994
 3.58  3.25      4458202      355 | May 31 1994
 6.09  5.59      7664190      604 | Jun  1 1994
 3.24  4.04      5539342      321 | Jun  2 1994
 2.68  3.79      5198485      266 | Jun  3 1994
 0.24  0.44       601139       24 | Jun  4 1994
 0.07  0.07        89786        7 | Jun  5 1994
 3.50  4.54      6226820      347 | Jun  6 1994
 4.25  4.28      5866576      422 | Jun  7 1994
 4.78  5.88      8064108      474 | Jun  8 1994
 0.06  0.06        84430        6 | Jun 13 1994

Total Transfers by Client Domain
%Reqs %Byte  Bytes Sent  Requests   Domain
----- ----- ------------ -------- |------------------------------------
 0.02  0.01        11776        2 | au    Australia
 0.59  0.23       317547       59 | ca    Canada
 0.15  0.12       160811       15 | ch    Switzerland
 0.23  0.17       236321       23 | de    Germany
 0.37  0.24       327414       37 | fi    Finland
 0.17  0.08       110371       17 | fr    France
 0.02  0.03        40172        2 | is    Iceland
 0.09  0.07        98023        9 | it    Italy
 0.02  0.03        40355        2 | jp    Japan
 0.23  0.26       351334       23 | nl    Netherlands
 0.31  0.15       211834       31 | no    Norway
 0.28  0.30       408553       28 | se    Sweden
 0.04  0.01         7488        4 | sg    Singapore
 0.61  0.59       810684       61 | uk    United Kingdom
 0.28  0.46       631568       28 | us    United States
 0.02  0.01        11878        2 | za    South Africa
 4.53  3.77      5172011      449 | com   US Commercial
 6.16  4.96      6805866      611 | edu   US Educational
 1.96  2.81      3851213      194 | gov   US Government
 0.01  0.00         4636        1 | int   International
42.61 44.58     61162184     4228 | mil   US Military
 0.49  0.38       525810       49 | net   Network
 0.30  0.20       273254       30 | org   Non-Profit Organization
40.49 40.55     55640095     4017 | unresolved 


I need a large Web server access log in Common Log Format. It needs to have
data over several weeks, and from a variety of hosts and to a variety of
URLs. 

I am developing a Visual Basic SQL-based stats logger and reporter for the
WIndows httpd server. It is to serve both as a useful application and an
example of using VB to handle CGI scripts that talk to Access
(SQL/Relational) databases.

I don't yet have a permanent live net connection, and therefore have no way
to create such a logfile.

I promise to use thhe log only for testing and to destroy it as soon as I
am finished. 

Please let me know privately if you can help.

   -- Bob