This afternoon, I tried to browse a bit in the manual of a very smart tool: Actogram (in french). It provides a good way to analyse videos, annotate and categorize patterns. Nice visualizations could also be computed. It really seems promising. The only drawback I see is that there are no MAC OS X version :(