Computational Science Technical Note CSTN-069

CSTN Home

Small-World Networks, Distributed Hash Tables and the e-Resource Discovery Problem in support of Global e-Science Infrastructure

A. Leist and K. A. Hawick

Archived: 2009

Abstract

Resource discovery is one of the most important underpinning problems behind producing a scalable, robust and efficient global infrastructure for e-Science. A number of approaches to the resource discovery and management problem have been made in various computational grid environments and prototypes over the last decade. Computational resources and services in modern grid and cloud environments can be modelled as an overlay network superposed on the physical network structure of the Internet and World Wide Web. We discuss some of the main approaches to resource discovery in the context of the general properties of such an overlay network or graph. We present some performance data and predicted properties based on algorithmic approaches such as distributed hash table resource discovery and management. We describe a prototype system and the implications for global resource discovery in ongoing global e-Science infrastructure. We use this system and model to explore some of the known key graph aspects of the global resource overlay network - including small-world and scale-free properties - and offer some scalability ideas for future e-Science global infrastructure.

Keywords: semantic metadata; small-world; network; DHT; routing; P2P; semantic web; semantic grid

Full Document Text: PDF version.

Citation Information: BiBTeX database for CSTN Notes.

BiBTeX reference:

@INPROCEEDINGS{CSTN-069,
        author = {A. Leist and K. A. Hawick},
        title = {Small-World Networks, Distributed Hash Tables and the e-Resource
                Discovery Problem in support of Global e-Science Infrastructure},
        booktitle = {Proc. 14th Int. Conf. on Internet Computing and Big Data},
        year = {2009},
        number = {CSTN-069},
        pages = {ICM7120},
        address = {Las Vegas, USA},
        month = {22-25 July},
        organization = {WorldComp},
        institution = {Massey University},
        keywords = {semantic metadata; small-world; network; DHT; routing; P2P; semantic
                web; semantic grid},
        owner = {kahawick},
        timestamp = {2009.02.28},
        url = {http://www.massey.ac.nz/~kahawick/cstn/069/cstn-069.html}
}


[ CSTN Index | CSTN BiBTeX ]