Feature #221

Log size in question / refactor log logic

Added by Mérour Xavier almost 9 years ago. Updated over 5 years ago.

Status:ClosedStart date:10/05/2010
Priority:NormalDue date:
Assignee:-% Done:

100%

Category:PROXY
Target version:3.0.0
Sponsor: Ergonomic impact:
Functional impact:

Description

All requests passing through the PROXY are logged in a text file. It contains many information like user, requestTime, RequestLenght, Pre- and PostTreatment, remote address, querystring,...

These are usefull information to make statistics and follow services use.

BUT it needs a lot of storage ressources : we had for example a 300 Mo log file some days ago.

We should consider differents options to redure/optimize log size, like :

- reduce information stored in logs
- have a less verbose logs structure
- compress/aggregate logs
- do not logs some user for instance (admin(monitor users...)
- log only certain type of logEntry (INFO, ERROR, DEBUG, SYSTEM)

to discuss...

History

#1 Updated by Mérour Xavier almost 9 years ago

We could also imagine having an option for each proxy instance with log=tue or log=false.
If set to "false" by the administrator, no log are computed, saving data storage and speeding up a bit the PROXY.

#2 Updated by Mérour Xavier over 8 years ago

  • Target version set to Future

#3 Updated by Mérour Xavier over 8 years ago

  • Assignee set to Magoni Bruno

The proposal is to add log verbosity options in PROXY backend with the following options :

- silent logging > no log at all
minimal logging > only <LogRequest> nodes are stored (see log structure description)
informative logging > only SYSTEM type of logEntries are stored
debug logging -> all type of logs are stored (ERROR, SYTEM, INFO, DEBUG)

These options are definable "per connector" (WMS, WMTS, WFS,...).

Bruno, can you add/correct any relevant information about this issue ?

#4 Updated by Mérour Xavier over 8 years ago

I also found some redundant information :
"RemoteResponseToRequestUrl" type in SYSTEM log is the addition of "RemoteRequestUrl" and "RemoteRequest"
Is there any good reason to have it ?

Otherwise, I am not sure to see the difference between "DEBUG" and "INFO" logEntries (there is maybe a good reason...). We may "merge" them in a single logEntry type, no ?

#5 Updated by Mérour Xavier over 8 years ago

Finally, log verbosity option will be definable per config (and not per connector).

#6 Updated by Mérour Xavier about 8 years ago

Can be closed as it as been resolved with ticket #451 (PROXY 2.2.0)

Thanks.

#7 Updated by Magoni Bruno about 8 years ago

  • Status changed from New to Accepted

Hello,
I preconised not to close this task for now as adding log4j support is a transitory step before removing definitively old EasySDI proprietary logs.
I prefer keeping a trace of this before closing current ticket.

Thanks for your feedback.

#8 Updated by Magoni Bruno about 8 years ago

  • Status changed from Accepted to Affected

#9 Updated by Mérour Xavier about 8 years ago

Fine with me !

#10 Updated by Magoni Bruno almost 8 years ago

  • Assignee deleted (Magoni Bruno)

#11 Updated by Magoni Bruno over 7 years ago

  • Status changed from Affected to New

#12 Updated by Magoni Bruno over 7 years ago

  • Status changed from New to Accepted

I propose that to close this feature with PROXY migration on Joomla 2.5.
If so, decision not tu support anymore EasySDI logs with PROXY V3.0should be validated by Steering Commitee.

#13 Updated by Magoni Bruno over 7 years ago

  • Target version changed from Future to 99

+1

#14 Updated by Mérour Xavier over 7 years ago

+1

#15 Updated by Magoni Bruno about 7 years ago

  • Status changed from Accepted to Affected

#16 Updated by Magoni Bruno about 7 years ago

  • Status changed from Affected to Resolved
  • % Done changed from 0 to 100

#17 Updated by Magoni Bruno almost 7 years ago

  • Status changed from Resolved to To merge
  • Target version deleted (99)

#18 Updated by Magoni Bruno almost 7 years ago

  • Project changed from PROXY to easySDI

#19 Updated by Magoni Bruno almost 7 years ago

  • Category set to PROXY
  • Target version set to 3.0.0

#20 Updated by Magoni Bruno over 5 years ago

  • Status changed from To merge to Closed

Also available in: Atom PDF