News & Updates
10 September 2007
Crawling back online
We've been having some problems with our crawler recently and so in recent times we've not been able to crawl all the sites we normally do and so the stats weren't getting updated. Said problems have now been resolved though and daily crawling has once again resumed.
12 January 2006
Graphs back online
I realise that the graghs have been offline for a bit and I fear that the linking images must have been offline as well. However, rest assured that everything is fixed and is now back online and working again.
19 August 2005
Site stats now available
The menu has a new page - site stats. This is pretty basic at the moment but offers stats on the total amount of topics, forums and historical records that are in our database.
Half way through implementation
Things are going well - we have had the crawler offline for a few hours now (although it would just be idling anyway ;) to upgrade it so that it has supports custom rules which I talked about in the last update. They are now working and working great, it's awesome how many more sites, especially foreign language sites we can now crawl.
Unfortunatly it isn't all sites, there are still some that can't be crawled due to requiring users to log in or blocking file requests but it's a very small minority now. These will be less of a problem once manual counts for the admin panel is added. We are like half way through building the whole thing, I'll keep you updated.
17 August 2005
Admin panel on the way
Development is moving nicely along with our new admin panel. Of course the real question here is how does that affect you? Well, at the moment we are doing it all directly with the database. This is messy and means that when we do manual counts, it isn't recorded in the history.
Therefore sites that cannot be crawled for one reason or another have absoluely no history. When the admin panel is implimented though, it will allow us to enter manual counts and record them in history.
Secondly more sites will be able to be automatically crawled. This is due to a neat feature we are going to impliment along with the admin panel called custom rules. You see, at the moment, the forum has a script type and this determines the search pattern to find member and post counts. So if a forum is different from the script's default or in another language it can't be crawled. Custom rules will allow us to override the default search pattern on a per forum basis so we can still find the counts on forums the crawler previously couldn't.
1 August 2005
Welcome and new graph
I have been meaning to get some kind of updates thing started ever since the site was launched. A full news script or blog is pointless though and wouldn't be integrated into the site so this shall do for the moment.
Today sees the launch of a new graph after hours and hours of work. It was tough but we did it. It basically shows totals over the past 30 days. It can also cope with missing data (we think ;) so you can view it for forums that don't have full data for the past 30 days and it will just fill in the information is does know.
Unlike the first graph we launched there is a relationship between posts and members too. Although at the moment they finish at the same place, they are not independent of each other - based on the steepness of each line you can see how fast they are growing compared to how fast they normally grow (which is an estimate based on the ratio of total posts and members).
History page
Second feature to launch today - the new history tab. This will show historical data such as how many times we have have crawled the site, all time highs, etc plus there is a day by day breakdown of stats in the past year along with the change for both members and posts per day.
Script type
The features keep on coming today - now you can see what script the board is running (phpBB, vBulletin, Ikonboard, etc). It is displayed on the forum overview page under description as well as on the topic listings where you can now sorted the forums by script.
Topic graphs
The graphs keep coming - we have now added them to the topics page. If you go to a topic there is now a tabs bar where you can select graphs and view a pie chart of each boards authoriativeness (based on the percentage of topic posts it contains).
| 