Hot Search : Source embeded web remote control p2p game More...
Location : Home Search - nutch d
Search - nutch d - List
一种新型的基于Nutch的搜索引擎技术,时下热门研究方向-A new search engine based on Nutch technology research nowadays popular
Update : 2025-02-17 Size : 260kb Publisher : 李化

Google的核心竞争技术是它的计算平台。Apache上就出现了一个类似的解决方案,目前它们都属亍Apache的Hadoop项目,对应的分删是: Chubby-->ZooKeeper GFS-->HDFS BigTable-->HBase MapReduce-->Hadoop 目前,基亍类似思想的Open Source项目迓径多,Hadoop是其中最为流行的框架,本文就将简要介绍hadoop的一个开发流程。-Hadoop got its start in Nutch. A few of us were attempting to build an open source web search engine and having trouble managing computations running on even a handful of computers. Once Google published its GFS and MapReduce papers, the route became clear. They’d devised systems to solve precisely the problems we were having with Nutch. So we started, two of us, half-time, to try to recreate these systems as a part of Nutch
Update : 2025-02-17 Size : 593kb Publisher : aaaaaaa

Hadoop got its start in Nutch. A few of us were attempting to build an open source web search engine and having trouble managing computations running on even a handful of computers. Once Google published its GFS and MapReduce papers, the route became clear. They’d devised systems to solve precisely the problems we were having with Nutch. So we started, two of us, half-time, to try to re-create these systems as a part of Nutch. We managed to get Nutch limping along on 20 machines, but it soon became clear that to handle the Web’s massive scale, we’d need to run it on thousands of machines and, moreover, that the job was bigger than two half-time developers could handle. Around that time, Yahoo! got interested, and quickly put together a team that I joined. We split off the distributed computing part of Nutch, naming it Hadoop. With the help of Yahoo!, Hadoop soon grew into a technology that could truly scale to the Web.
Update : 2025-02-17 Size : 7.17mb Publisher : likunbao
CodeBus is one of the largest source code repositories on the Internet!
Contact us :
1999-2046 CodeBus All Rights Reserved.