How to get values from your logs?

Multiple times in a day, it’s IT team (thanks to batches) has to migrate a large volume of data (several TB) from 3D CAD (Computer Aid Design) application version n to version n+1. Classical scenario of data migration that takes place throughout the year. Indeed, they decided to use in parallel the two versions for a while until they are sure all is fine with the new app version.

3D CAD application editor provides specific scripts generating a lot of logs (30GB per week). But, most of these logs are not structured meaning that it is very complex to exploit logs data for understanding the frequent data migration issues. They cannot fix them and understand.

They ask us to have a look: first conclusions of data exploration and data mining. [...]

 

To read the whole post and interact, please visit the SogetiLabs blog: How to get values from your logs ?