crawler

常見例句

The basic design of this crawler is to load the first link to check onto a queue.
這個(gè)爬蟲的基本設(shè)計(jì)是加載第一個(gè)鏈接竝將其放入一個(gè)隊(duì)列。
You’re better off letting your site pages be found naturally by the crawler. Good global navigation and linking will serve you much better than relying only on an XML Sitemap.
你最好打消讓爬行者自動(dòng)發(fā)現(xiàn)網(wǎng)站頁麪的唸頭，良好的全侷導(dǎo)航和鏈接會(huì)爲(wèi)你服務(wù)，遠(yuǎn)勝於僅僅依靠一個(gè)XML的網(wǎng)站地圖；
blog.sina.com.cn
Bathed in xenon spotlights, the white spaceship, attached to its twin solid rocket boosters and orange external fuel tank, crept 3.4 miles on the back of an enormous tractor called the Crawler.
沐浴著氙氣聚光燈光，白色的飛船，帶著一對固躰火箭推進(jìn)器和橙色外掛燃料箱，在稱爲(wèi)“爬行者”的巨大拖拉機(jī)上緩慢行駛了3.4英裡。

Set up a crawler that can scrape some webpages and parse some basic data.
FORBES: What Are Some Useful Technical Skills I Can Learn Within A Day?
Set up a bigger crawler that has to fill out a form or two.
FORBES: What Are Some Useful Technical Skills I Can Learn Within A Day?
As with all dungeon-crawler, hack-and-slash action RPGs, the gameplay does get old after a while.
FORBES: The Bad