Many materials are produced, processed and stored as grains, while granularity of matter can be crucial in triggering potentially catastrophic geological events like landslides, avalanches and earthquakes. The response of grain assemblies to shear stress is therefore of utmost relevance to both human and natural environment. At low shear rate a granular system flows intermittently by distinct avalanches. In such state the avalanche velocity in time is expected to follow a symmetrical and universal average behavior, whose dependence on the slip size reduces to a scale factor. Analyzing data from long lasting experiments, we observe a breakdown of this scaling: While in short slips velocity shows indeed a self-similar and symmetric profile, it does not in long slips. The investigation of frictional response in these different regimes evidences that this breakdown can be traced back to the onset of a friction weakening, which is of dynamical origin and can amplify instabilities exactly in this critical state, the most frequent state for natural hazards.