completely similar to the querying image’s but there was still more work to do to narrow the gap between low-level features and high-level semantic of an image.
V.
CONCLUSION
This paper has introduced a CBIR system based on Hadoop and Lucene and shows a demo. The issue is just started and has only a little fruits, so we believe our work has made a valuable contribution to the development of CBIR systems.
The system takes advantage of Hadoop in many aspects. Firstly, it adopts HDFS and HBase as the data center of the whole system to overcome big amount of data brought by images. On the other hand, it adopts MapReduce for image extraction and indexing to implement parallelization to overcome computing complexity and big data processing. Certainly, there are still a lot of deficiencies in the system. For example, the indexing is not efficient enough, we’d better use clustering technique, such as k-means, to divide the whole index database into smaller partitions; meanwhile, some modules of the system have not taken advantage of Hadoop and HBase sufficiently, a more complex design of the searching module should be taken account for. These problems are remained for our research in the future.
ACKNOWLEDGMENT
The system is based on many kinds of open source software, including Hadoop [6], HBase [7], Lucene [12], Lire [11] and HBasene [8]. The implement of extraction algorithms has referred to Lire. The implement of indexing module has referred to HBasene. We would like to thank the authors and communities of these kinds of software. And we will provide source code of the system whenever you need.
REFERENCES
[1] J. R. Bach, et al., The Virage image search engine: An open
framework for image management, Storage and Retrieval for Still Image and Video Databases Iv, vol. 2670, pp. 76-87, 1996.
[2] R. S. Choras, Content-based image retrieval - A survey, BioMetrics,
Computer Security Systems and Artificial Intelligence Applications, pp. 31-44, 2006.
[3] J. Dean and S. Ghemawat, "Mapreduce: Simplified data processing
on large clusters," Communications of the Acm, vol. 51, pp. 107-113, Jan 2008.
[4] M. Flickner, et al., Query by Image and Video Content - the Qbic
System, Computer, vol. 28, pp. 23-32, Sep 1995.
[5] Lars George, HBase: The Definitive Guide, Sebastopol, CA:
O’Reilly, 2011.
[6] Hadoop project, doc.guandang.net [7] HBase project, doc.guandang.net
[8] HBasene project, doc.guandang.net [9] HIPI project, doc.guandang.net [10] Idée Inc., doc.guandang.net
[11] Lire project, doc.guandang.net [12] Lucene project, doc.guandang.net
[13] M. Lux and S. A. Chatzichristofis. “LIRe: Lucene Image Retrieval -
An Extensible Java CBIR Library”, Proceeding of the 16th ACM international conference on Multimedia, pages 1085-1088, 2008.
[14] Michael McCandless, Erik Hatcher, and Otis Gospodnetiü, Lucene in
Action, Second Edition, Greenwich, CT: Manning, 2010.
[15] Y. Rui, T. S. Huang, and S. Mehrotra, "Content-based image retrieval
with relevance feedback in Mars," International Conference on Image Processing - Proceedings, Vol Ii, pp. 815-818, 1997.
[16] K. Shvachko, H. R. Kuang, S. Radia, and R. Chansler, "The Hadoop
Distributed File System," 2010 Ieee 26th Symposium on Mass Storage Systems and Technologies (Msst), 2010.
[17] H. Tamura, S. Mori, and T. Yamawaki. Textural features
corresponding to visual perception. IEEE Transactions on Systems, Man, and Cybernetics, 8(6):460–472, June 1978.
[18] Tom White, Hadoop: The Definitive Guide, Second Edition,
Sebastopol, CA: O’Reilly, 2011.
a Java library for content based image retrieval....system – is often relying on fast, global ...image mosaics (see Figure 3) based on LIRe is...
content-based image retrieval, and MapReduce, among...le system (DFS), being Hadoop [4, 5] the ...ciently evaluate analytic queries based on di?...
基于Lucene的面向主题搜索... 暂无评价 3页 2.00元 图像搜索引擎案例评价及检...CIRES: A System for Content-based Retrieval in Digital Image Libraries. ...
content-based and so on, than introduced system ...Apache Mahout起源于2008年, 是Apache Lucene的 子...(IR, Information Retrieval 的知识将文档拆分为词项...
lucene indexes fetch URL list pages (segments) ...Hadoop for SW Amazon S3 TIFF Image (4TB) PDF..., Information Retrieval, ???, ??? ? Hadoop...
2011#A Real-Time Search Engine with Lucene and ...S4 applied to Information Retrieval 2/5/2011 ...Let’s move it to Hadoop PDF Text Extractor ...
Hadoop集群性能优化技术... 3页 免费 Lucene_3.0...System’, Proceedings of the ACM-SIGMOD Conference...elimination of inconsistencies in data retrieval. ?...
Only few retrieval results are needed Not ideal ...A scale-out system, e.g., Nutch/Lucene, ...Hadoop based on SQL [Thusoo, Hive ApacheCon 2008...
Only few retrieval results are needed Not ideal ...A scale-out system, e.g., Nutch/Lucene, ...Hadoop based on SQL [Thusoo, Hive ApacheCon 2008...
热门文档