SteemWorld ~ Weekly Support ~ #21

steemchiller (74) in steemworld • 6 years ago (edited)

[EN]

This post is intended to cover the server costs for SteemWorld.org and to enable me to continue my development in the future.

In case you missed the first part:
SteemWorld ~ Weekly Support ~ #1

[DE]

Dieser Post ist dafür gedacht die Serverkosten für SteemWorld.org zu decken und mir in Zukunft weitere Entwicklungen zu ermöglichen.

Falls du den ersten Teil verpasst haben solltest:
SteemWorld ~ Weekly Support ~ #1

Updates

Since I'm heavily working on the new backend, there is currently not much to tell about my recent developments. I was thinking a lot lately and I came to the conclusion that I'm still caught in the old world of restrictions and centralization. It does not serve anybody to build a new wonderful, centrally governed world, which can be shut down over night by any of the existing self-chosen world leaders out there.

The only way to build trust and to help creating a more peaceful world is to work together, to open-source everything, that can enlighten humankind but has been kept in the dark for so long, to eliminate the old way of thinking and destroy the devils inside by making 'em obsolete. Period.

The revolution takes place now, not tomorrow, and each of us has the choice of working against it or freeing oneself from the old habits to be able to achieve the higher state of mind and to finally reach the bright side of life. We rise by lifting others!

Open Source Steem Data Service

I guess you would love me, if you would know what I'm currently developing here. Time for explaining it in detail now is null, because a day only has 24 hours and ~ 17 of them already go into coding. 7 days a week. If you don't believe this to be true, you also don't know how people like @dan accomplished all that crazy, awesome stuff on his own. Builders of new worlds don't work just sometimes, they sleep sometimes. Focus and fascination are the key.

Some basic points I already can state here:

Can be run locally (even on your grandma's home pc) or as public web service
Enables each of us to analyze and work with the Steem blockchain data in a simple and very efficient way
Syncing is possible via available public instances (very fast) or regular Steem nodes
Provides automatic downloading of already parsed data (no need to start from block 1)
No need to setup any database services (all file-based -> no layers in between -> faster than light)
Offers configurable datasets (if you just need a DB with all transfers for example, you can run an instance with something like parser.parse_transfers=1 and parse_[things you don't need]=0)
Also 'virtual operations' can be parsed (or downloaded from one of my servers that will provide all parsed datasets in nearly realtime)
Highly compressed data (some crazy stuff and a bit of magic involved here, more details on this soon)
Interfaces to other database systems planned
Completely free to use, will be released under MIT license

In the making

Open Source Steem Data Service
Post Viewer & Editor
Different views / no limit in the posts overview
Details for coming rewards (number of posts/comments, maybe a pie chart)
Improved coming curation rewards overview
RC costs calculation
SteemWorld -> Open Source?

Links

EN | What is SteemWorld?
-> Welcome to SteemWorld.org!

DE | Was ist SteemWorld?
-> Willkommen auf SteemWorld.org!

Thank you for supporting my work!

Positive thoughts create a positive world. It all begins with connecting our thoughts with emotions. What we focus on is what becomes powerful. We are the creators of our world.

Much love,

steemworld steemdev dev steem tools

6 years ago by steemchiller (74)

$65.53

Authors get paid when people like you upvote their post.
If you enjoyed what you read here, create your account today and start earning FREE STEEM!

Sort Order:

Trending

[-]

abh12345 (76) · 6 years ago

I just read the post by @gadrian (which I see you've spotted and resteemed) and learned about what you are currently working on.

As a utopian CM and contributor to the Analysis category I am very interested in this new data service. I don't see a mention of SQL though, and so i'm feeling a bit outdated :)

Will it be all web-service based?

Thank you as always for your hard work on Steem!

$0.43

11 votes

[-]

steemchiller (74) · 6 years ago (edited)

I'm working with regular relational databases, so of course, you can use SQL for querying the desired data. Since there is only a single process, that needs to write to the DBs at a time, I don't need to run any extra DB services like postgresql, mysql, mongodb or others, which would add an extra layer in between you and the data (always leads to extra performance costs). Many developers don't know that SQLite on SSD outperforms these big names with ease (as long as only one process writes data at a time). But I've planned to implement interfaces to other database systems as well (will come later).

The data service is based on Node.js, therefore it can be started locally or as a public web service without the need of running any additional servers like apache/nginx with php or so. I will also publish a documentation for the web service API. For local analyzing it won't even be needed to use the API, because the DB files are directly accessible and SQL queries can be executed via a direct connection from any app or via ODBC in a local network.