adv

IVE's big data apps create biz values from govt open data

100Gb public data archive on public cloud 

While the public data sets on Data.One are real-time data without archive, IVE's Data.Two platform archives all the public datasets into Amazon Simple Storage Service (Amazon S3) in Singapore's data centers, and the data are available for free download. 

"It is very nice to use the versioning feature of Amazon S3 to handle our project. We are planning to share the bucket with the pay by requester way." 

"AWS does not limit the number of versions of our data. As we create a new version of our data in the cloud every two minutes, we now have about 200,000 versions [of Data.Two] on Amazon S3." 

At present, Data-HK does not charge a fee for using its service. In the future, it may charge users by the bandwidth users consume. 

"There is no need to back up our data once we upload them to the cloud," Wong added. "Once S3 declares success [upload] it replicates multiple copies in the cloud within the same data center location."

Cloud storage cost: US$6 per month

"We don't have any real physical computer [to work with the Data-HK project]," said Wong. Indeed the team did not pay a dollar to put together the infrastructure for Data-HK. Instead, the Data-HK team obtained an AWS Education Grant, which takes the form of AWS free usage credits for lecturers and students to use any of the AWS services. 

Below is the full list of AWS services that the Data-HK team uses: 1) Amazon Elastic Compute Cloud (Amazon EC2); 2) Amazon Simple Storage Service (Amazon S3); 3) Amazon Relational Database Service (Amazon RDS); 4) Amazon Route 53 (scalable Domain Name System (DNS) web service); 5) Elastic Loading Balancing (ELB); 6) Amazon Elastic MapReduce (Amazon EMR) (a web service that process vast amount of data); 7) Amazon CloudFront (a web service for content delivery using AWS global network of edge locations); 8) Auto Scaling; and 9) Amazon CloudWatch (a web service that provides monitoring for AWS cloud resources). 

Wong declined to disclose the amount awarded by AWS Education Grant, but said the team has consumed "a very minor portion of the grant" as at today. "We have uploaded 100Gb of data on AWS so far, and it costs us just US$6 per month," he said. 

Hong Kong ICT award

On April 7, the Data-HK team at IVE (Lee Wai Lee) was awarded the Golden Prize (Champion) at the Hong Kong ICT Awards 2014: Best Student Invention Award (Tertiary Institution category) with their cloud data application platform Data-HK. 

"Enabled by AWS cloud technology, IVE students are 100% focusing on project development, without spending any time on meaningless work such as installing window or addressing conflicting DNS! The students launched their work with small Amazon EC2 instances and handle the workloads with auto scaling which is nice," Wong concluded.



Comments