Square Kilometre Array (SKA) and real big data (3 Terrabyte of data per second generated)

in science •  8 years ago 

South Africa has been developing innovative technology specifically in the defence industry for many years. The technologies included, The Rooivalk attack helicopter, the G5 towed howziter (Cannon) and probably the most well-known of all is the G6 self-propelled gun howzitzer. These technologies is in my mind not a good reflection of South Africa , as these technologies is used in war all over the world. The technology and science advances which we as a nation and Australia can be proud of is what is now called the Square Kilometre Array (SKA).


Image Credit

The Square Kilometre Array (SKA)

The Square Kilometre Array (SKA) is a large multi radio telescope project aimed to be built in Australia and South Africa. If built, it would have a total collecting area of approximately one square kilometre. It would operate over a wide range of frequencies and its size would make it 50 times more sensitive than any other radio instrument. It would require very high performance central computing engines and long-haul links with a capacity greater than the current global Internet traffic. It should be able to survey the sky more than ten thousand times faster than ever before.

With receiving stations extending out to distance of at least 3,000 kilometres (1,900 mi) from a concentrated central core, it would exploit radio astronomy's ability to provide the highest resolution images in all astronomy. The SKA would be built in the southern hemisphere, in sub-Saharan states with cores in South Africa and Australia, where the view of the Milky Way Galaxy is best and radio interference least
Source

The SKA will be built in phases and we are now in what is called the Meerkat phase. The Meerkat is the world's first radio Telecsope array consisting of composite antennas, as described on the SKA website. The SKA will open so many doors for us in future exploration of our known Universe.

Big data

Now this is where this technology is becoming very interesting. To quote the Chief Architect of the SKA programme,

“In a normal scientific instrument, most of the effort goes into building the instrument itself, and the data gathered can be analysed using common tools, including even spreadsheet programs.

A big data instrument like the SKA has different challenges. Composed of many antennas, the SKA will gather a lot of data, therefore a lot of effort must go not only in building the telescope itself, but also in dealing with the data it will produce, which will have to be processed in parallel on the equivalent of millions of computers.
Because there will be so much data coming in all the time, and we only have a limited amount of space available, it will also be necessary to process and store the useful data and then delete the rest quickly so that more data can be collected.
Finally, scientists will have to write very sophisticated computer programs to be able to search for what they want in the stored data, like a needle in a very big haystack.

As an example, the SKA’s first phase of development will see the equivalent of 3 TB (about the size of a standard desktop computer disk) transmitted every second to the central processing computer. So that’s Big Data”

The SKA will create 10 times the amount of data which is being created on the internet today, now that is Big Data :) Many of the scientists around the world, is eagerly awaiting the start of the world's largest science project to start.

Please take some time to view the introduction video of the telescope here.

Happy Steeming


If you enjoy my articles please follow me on my blog at @jacor

Authors get paid when people like you upvote their post.
If you enjoyed what you read here, create your account today and start earning FREE STEEM!
Sort Order:  
  ·  8 years ago (edited)

It looks awesome , but to be onest little bit scary too, thanks for sharing @jacor !
As tech evolves...we must olso evolve...and maybe soon with all this inovations maybe we will find something out there...

quite impressive

  ·  8 years ago (edited)

I am not sure it is the world 'largest' scientific project. What about the Pierre Auger observatory in South America whose size is of about 3000 km2?

The physics goals are however different as the Pierre Auger observatory is targeting ultra energetic cosmic rays and the SKA project is aiming to a very precise sky survey. And they are thus both very important for improving our knowledge!

Hi @jacor
Will South Africa be able to provide the required infrastructure to transmit all the data? How will they link the South African and Australian antenna data and where will the central processing unit be situated?
It is a very interesting project and I enjoyed your post.