steemreduce: Incremental MapReduce for Regular Users

in steem •  9 years ago  (edited)

I announced steemreduce yesterday. I spent the whole day today improving it.

The sources and README are available on GitHub.

Feel free to have fun and let me know if anything is not working properly.

Changes and Improvements

Let's see what is new and better!

Incremental MapReduce

The only available MapReduce now supports incremental MapReduce, which means that when you run the same MapReduce again, it will start where it stopped last time. It will update existing data and it will only process the blocks added to the blockchain since the last run.

Pre-built Binaries

steemreduce is now being built on CircleCI and you can simply download an executable for your platform. Just choose the latest build and append #artifacts to the URL. That will show the Artifacts tab and you can download the executable.

What Now?

I will keep improving the package since it needs some more love, that is for sure.

In case you need your own statistics and you want me to implement it, just let me know here or on Steem Slack.

#steemreduce #steem-programming #steem-statistics

Authors get paid when people like you upvote their post.
If you enjoyed what you read here, create your account today and start earning FREE STEEM!