Comparing global optimization and default settings of stream-based joins
| aut.researcher | Naeem, Muhammad | |
| dc.contributor.author | Naeem, M | |
| dc.contributor.author | Dobbie, G | |
| dc.contributor.author | Weber, G | |
| dc.contributor.editor | Dayal, U | |
| dc.contributor.editor | Castellanos, M | |
| dc.contributor.editor | Miller, RJ | |
| dc.date.accessioned | 2012-04-26T01:42:32Z | |
| dc.date.available | 2012-04-26T01:42:32Z | |
| dc.date.copyright | 2009 | |
| dc.date.issued | 2009 | |
| dc.description.abstract | One problem encountered in real-time data integration is the join of a continuous incoming data stream with a disk-based relation. In this paper we investigate a stream-based join algorithm, called mesh join (MESHJOIN), and focus on a critical component in the algorithm, called the disk-buffer. In MESHJOIN the size of disk-buffer varies with a change in total memory budget and tuning is required to get the maximum service rate within limited available memory. Until now there was little data on the position of the optimum value depending on the memory size, and no performance comparison has been carried out between the optimum and reasonable default sizes for the disk-buffer. To avoid tuning, we propose a reasonable default value for the disk-buffer size with a small and acceptable performance loss. The experimental results validate our arguments. | |
| dc.identifier.citation | Workshop on Enabling Real-Time for Business Intelligence, France, pages 155 - 170 | |
| dc.identifier.doi | 10.1007/978-3-642-14559-9_10 | |
| dc.identifier.isbn | 978-3-642-14558-2 | |
| dc.identifier.uri | https://hdl.handle.net/10292/4054 | |
| dc.publisher | Springer | |
| dc.rights | An author may self-archive an author-created version of his/her article on his/her own website and or in his/her institutional repository. He/she may also deposit this version on his/her funder’s or funder’s designated repository at the funder’s request or as a result of a legal obligation, provided it is not made publicly available until 12 months after official publication. He/ she may not use the publisher's PDF version, which is posted on www.springerlink.com, for the purpose of self-archiving or deposit. The final publication is available at www.springerlink.com | |
| dc.rights.accessrights | OpenAccess | |
| dc.subject | ETL for real-time data warehouse | |
| dc.subject | ETL optimization | |
| dc.subject | Tuning and management of the real-time data warehouse | |
| dc.subject | Performance and scalability | |
| dc.subject | Stream-based join | |
| dc.title | Comparing global optimization and default settings of stream-based joins | |
| dc.type | Conference Contribution | |
| pubs.organisational-data | /AUT | |
| pubs.organisational-data | /AUT/Design & Creative Technologies | |
| pubs.organisational-data | /AUT/Design & Creative Technologies/School of Computing & Mathematical Science |