I've revived AWFFull for static log analysis, just like in the good old webalizer days :-). Link to the report is in my bio, sorry, I can't post links here for now.
What I'm seeing matches the observations of the other commenters here exactly: most of the "users" are bots harvesting pages and PDFs. My solution for getting at the real users is GoatCounter.
It is now mostly unusable for web analytics. So many scrapers are pretending to be browsers. On my site, there is a factor 10 with what I consider an honest view of human visitors.
The question I always come back to is: how long does it take you to get stats for something like 1 month or 1 quarter with the current "modern" tools?
For ad hoc analytics these tools are very nice, but for long-term stats they run into timeouts, because the backend needs a lot of time to collect the data and build the reports for ~1 month or a quarter — or am I wrong about that?
I've revived AWFFull for static log analysis, just like in the good old webalizer days :-). Link to the report is in my bio, sorry, I can't post links here for now.
What I'm seeing matches the observations of the other commenters here exactly: most of the "users" are bots harvesting pages and PDFs. My solution for getting at the real users is GoatCounter.
It is now mostly unusable for web analytics. So many scrapers are pretending to be browsers. On my site, there is a factor 10 with what I consider an honest view of human visitors.
Yes, this is unfortunately my experience with GoAccess
This always looks cool and the real-time aspect always gets attention. However, If I remember correctly, it was kind of a burden to get deployed.
Again, if I remember correctly, it was able to make reports for AWS Cloudfront logs, which was actually useful.
The question I always come back to is: how long does it take you to get stats for something like 1 month or 1 quarter with the current "modern" tools?
For ad hoc analytics these tools are very nice, but for long-term stats they run into timeouts, because the backend needs a lot of time to collect the data and build the reports for ~1 month or a quarter — or am I wrong about that?
Unfortunately, each time a new log analyzer appears, it seems to only be analyzing web access logs in combined format.
GoAccess supports more than combined format. I think they even support stubborn servers who output JSON logs only:
https://goaccess.io/man#custom-log
Note that GoAccess is more than 15 years old.