Differences
This shows you the differences between two versions of the page.
projs:clans:docs:crawlingcompanyrelatedweibooriginalpost [2014/01/26 20:23] yangjunfeng0317 created |
projs:clans:docs:crawlingcompanyrelatedweibooriginalpost [2014/02/04 18:32] (current) yangjunfeng0317 |
||
---|---|---|---|
Line 8: | Line 8: | ||
===== Output ===== | ===== Output ===== | ||
- | None | + | ^ Parameters ^ Type ^ Description ^ |
+ | | status | string | show the crawler running status | | ||
===== Implementation ===== | ===== Implementation ===== | ||
- masterStart(). Create multiple processes to begin crawling data. | - masterStart(). Create multiple processes to begin crawling data. | ||
- wapLogIn(). Log in sina Account. | - wapLogIn(). Log in sina Account. | ||
- weiBoWapSearch(company_name, stock_id). Use company name and company id to search company related weibi and insert in database. | - weiBoWapSearch(company_name, stock_id). Use company name and company id to search company related weibi and insert in database. | ||
+ | * extractTopic(company_name, company_id). Extract weibo text and insert to database. | ||
===== Related Work ===== | ===== Related Work ===== |