Curie Witness Update (May 17th, 2018)

in curie •  7 years ago  (edited)


curie-logo-witness-update-transparency.png

CONTENTS

  • Witness Server Infrastructure Update

  • Automated Monitoring Update

  • Development Projects Preview


Curie Divider upvote.png

  • Curie operates a community witness on the @curie account.

  • 100% of witness block production rewards are used for Curie operations.

  • Any inquiries into the Curie witness should be made in the dedicated #witness-inquiry channel in the Curie Discord community. Join the Curie Discord community here: https://discord.gg/TXrMC4Z

  • The Curie witness is operated by @markangeltrueman, who is the author of this update.


Curie Divider upvote.png

Witness Server Infrastructure Update

We have just migrated our primary and backup witness nodes onto new infrastructure. Those have just finished replaying on the 19.3 stable build and the primary is happily producing blocks. The new primary node is a 128GB DDR3 6 core dedicated server with 1TB of SSD SATA and a guaranteed 1Gbps network connection. Backup is of a similar spec, but with 64GB ram as opposed to the 128 on the primary.


Curie Divider upvote.png

Automated Monitoring Update

One of my main goals as part of becoming the Curie witness operator was to improve monitoring and alerting, not just around the Curie witness specifically, but on witnesses as a whole.

We have set up some basic monitoring that alerts a private Curie Discord group to any issues. In the case of missed blocks we get an alert into a private channel which is monitored by a number of Curie members as well as a Discord direct message to myself, the backup witness operator (@locikll) and a backup monitor (@carlgnash). If anything looks problematic, then we have a call out number with which the backup witness operator and the backup monitor can reach me at any time of day or night. We have coordinated schedules so the backup witness operator will take primary responsibility if I am on vacation or otherwise unavailable for any period of time.

This monitoring app, written in nodejs, also produces a daily report for us at 00:00 UTC or can be called via a discord bot at any time to check the status of various systems. So far we have the following info, but we intend to expand on this in future update.

Screen Shot 2018-05-16 at 16.10.22.png

Daily report to Discord

We have also added some log file analysis to this app which checks for certain messages in the witness log files, one of which being latency. If many witnesses are seeing increased latency (currently set to over 3 seconds), we may have a problem, so it's good to notice this and call it out to the rest of the witnesses.

Screen Shot 2018-05-16 at 16.25.00.png

High latency alerting

The script also handles missed blocks. If we miss more than 2 blocks in a row, it will automatically update our witness to use the backup.

After reading a recent post by @themarkymark on monitoring and alerting with netdata I decided to try installing this tool and giving it a go. I was very pleasantly surprised by it. We now have many stats on the metrics of our servers, plus I have set up alerting around some of the important metrics

2018-05-16 16.42.16.gif

Netdata real time monitoring

An alerting example is something like this, where a replay was underway and disk space was filling up. Of course, the alerts reset when the replay is completed

Screen Shot 2018-05-16 at 16.43.59.png

Screen Shot 2018-05-16 at 16.46.34.png


These flow into a private discord channel and are monitored as described above. I am just starting to set these up, but we have disk space alerts up and running as well as a load of other stuff that works out of the box with netdata. It's a very cool tool and well worth getting set up on your own servers.


Curie Divider upvote.png

Development Projects Preview

Curie is currently working on two development projects which will be posted about in more detail in the near future in separate development updates on the @curie blog:

  • SteemLookUp is a filtering search tool of specific interest to curators and general interest to anyone interested in discovering content on the Steem blockchain.

This open source project can be accessed at https://steemlookup.com, and the Github repository can be found here: https://github.com/steemlookup/steemlookup

While this project will be updated on the @curie blog, you can also follow the @steemlookup blog for more frequent updating. See this post on the @steemlookup blog for current information on functionality and use: https://steemit.com/steemit/@steemlookup/introducing-steemlookup-filtering-tool


  • Curie is developing a full-fledged platform for curation groups / guilds / communities.

This platform will include a post submission system and a back-end accessible to members to allow review of posts, with reporting on submissions available to members. This will replace reliance on the Streemian platform for Curie community operations. This will also be open source and open to any interested curation groups / guilds / communities to use. SteemLookUp will be integrated into this platform to allow submission of posts directly from the filtering search tool.

Stay tuned to the @curie blog for more news on both of these development projects in the near future.


Curie Logo 500px.png

Authors get paid when people like you upvote their post.
If you enjoyed what you read here, create your account today and start earning FREE STEEM!
Sort Order:  

Amazing post here. Love it

When others sleeps, Curie always awake to fix things. I shouldn't talk about what I can't comprehend for now, the whole witness thing.

Steemlookup will be very helpful to everyone who wants to be noticed by curie and probably gets a rewards. This project will make things much easier.

more ideas like this! upvoted and followed :)

This is definetly a better improvement :) You gave me Idea what witness do here I don't even vote for one so know I decided to vote you as my first witness
Also the steemlookup is such a great thing you can filter more post and can give other curie votes for worth steemians by the way thank yoy afor giving me an oppurtunity to be curied once :)

well, weird that you would lie about something like that...Screen Shot 2018-05-19 at 19.57.02.png

but if you want to correct this then you can use this link:
https://steemconnect.com/sign/account-witness-vote?witness=curie&approve=1

and then you could also support my witness
https://steemconnect.com/sign/account-witness-vote?witness=swisswitness&approve=1

sorry my mistake I thought I already did but I did wrong process in voting curie as witness but now I already done voting it thanks for helping me :) you can check it out if I already done cause I dont know where to look at to ensure that I already voted for them aganin I'm so sorry

I also supported you again I'm sorry my mistake :( and thank you for commenting and checking out this cause without you I will never knew that curie is not part of my witness list I owe them a lot so theres no reason that they will not be in my list of steemit witness sorry again :(

maybe it's the good news for everybody on the steemit. thanks for sharing .

Thank you all for your work and support! :)

Looking forward for the future development. Integration with steemlookup platform would be awesome.
Tbh Curie is the only witness / community that I understand, I don't really get the idea of other witnesses. :))
"Content is the king, curation is the Queen." I prefer Queen, because Freddie Mercury is the greatest frontman ever :P

great stuff! upvoted and followed. it would be great to be a part of it

You have a minor misspelling in the following sentence:

I was very pleasantly suprised by it.
It should be surprised instead of suprised.

Nobody likes a grammar Nazi. But yeah, good catch :) Editing now

That is the essence of being human, one can't be 100% correct in everything.

Hey @curie !
tobt.jpg
My name is @mentederufus and i do art photography, i am starting a new project here on Steemit called DOG PORTRAITS!

I hope you can take a look and spread love!

Best wishes and see you soon ;)

Hai @curie
good information.
I will come back to see other interesting information in your post.

Its a very cool thing you guys doing here. Cheers and thanks for your help😁🤙

hi @curie , nice article, can I ask? I dont know how to put witness. need some help
thank you

https://steemconnect.com/sign/account-witness-vote?witness=swisswitness&approve=1

this is the link to vote for my witness for example : @swisswitness
if you change the name in the link to curie then you get

https://steemconnect.com/sign/account-witness-vote?witness=curie&approve=1

and so on, you can check witnesses here, this is the fullest list i know of
https://steemian.info/witnesses

amazing post, keep up the fantastic content 😀 😁

Thanks so much Curie for the upvote :hugs: , keep up the great work, you guy's make steemit a great place for creators :D

@curie post your good.
Thanks you very much information.