Navigation

This page is read only. You can view the source, but not change it. Ask your administrator if you think this is wrong.
====== Document of CLANS ======

===== Example =====
  - [[projs:clans:docs:example_function_2|Example Function]]
  - {{:projs:clans:docs:s_3.png?500| Page name}}

===== Search (Alex)=====
====== Function Description ======
We use Lucene to create the index of our company and person data, and then we could implement the search function.

  * [[projs:clans:docs:alex:index|Build Index]]
  * [[projs:clans:docs:alex:search|Search]]

====== Related Information ======
Lucene  -- http://lucene.apache.org/

Apache Lucene is a high-performance, full-featured text search engine library written entirely in Java. It is a technology suitable for nearly any application that requires full-text search, especially cross-platform.

====== Change Log ======



===== Data Schema (Jingyi)=====




==== Function Description ====
[[projs:clans:docs:data_schema_jingyi:addinfo|AddInfo]]

[[projs:clans:docs:data_schema_jingyi:addemployee|AddEmployee]]

==== Data Schema ====
[[projs:clans:docs:data_schema_jingyi:personxml|person xml file]]

[[projs:clans:docs:data_schema_jingyi:companyxml|company xml file]]
===== Entity Disambiguation (Xu) =====
==== Function Description ====
There are two main steps to do name entity disambiguation:
----

First, we use the train set to extract filter keywords to a certain person.
  * [[projs:clans:docs:entity_disambiguation_xu:extractkeywords|extractkeywords]]
Then, use the extracted filter keywords to judge each posts is related to the person in our database or not.
  * [[projs:clans:docs:entity_disambiguation_xu:testrelevancy|testrelevancy]]

==== Related Information ====
Related works
  * [[http://www.sciencedirect.com/science/article/pii/S0957417413001516]]
  * [[http://acl.ldc.upenn.edu/W/W03/W03-0405.pdf]]
  * [[http://wwwconference.org/2005a/cdrom/docs/p463.pdf]]
  * [[http://www.di.unipi.it/~ferragin/cikm2010.pdf]]
  * [[http://edgar.meij.pro/wp-content/papercite-data/pdf/wsdm-2012-meij.pdf]]

===== Social Network Modeling by Search Engine (Xu) =====
===== Visualization (Qian, Ken, Sunny)=====
==== Additional Features ====
  * Loading sign
  * Drag button
  * Share on weibo, facebook, twitter and so on

==== Home Page ====
=== Description ===
Two main functions:
  * User sign in/out/up
  * Search function
=== More to improve ===
  * Solution for Misspelling 
  * Solution for searching like 'xiaosuining'

==== Search Result ====
=== Description ===
Two columns of search results, one for person and one for company.
=== More to improve ===
  * Search results show the news containing the key words.
  * Search results show description of a person/company.

==== Person Show ====
=== Features ===
  * 基本信息
  * //关系网权值走势图//
  * 照片
  * //成长轨迹图//（故乡，求学地点，工作地点等,Google map）
  * 时间轴
  * 校友关系网图
  * 工作关系网图
  * 多项选择关系网图（节点特征值：centrality value, community）
  * //最短路径//（P2P和P2C）
  * //相似度图表//（P2P和P2C）
  * //微博消息//(Top & Hot)
  * //media//

==== Company Show ====
=== Features ===
  * 基本信息
  * 照片
  * //股票当前走势及历史情况//
  * //盈亏情况走势图//
  * //公司地点及分公司分布图//
  * 时间轴
  * 公司内部关系网
  * 公司外部关系网
  * 多项选择网图（节点特征值：centrality value, community）
  * //最短路径//（C2C和C2P）
  * //比较相似度图表//（C2C和C2P）
  * //微博消息//(Top & Hot)
  * //media//








===== Prediction (Zhi)=====

  * [[projs/clans/docs/prediction_lib_utilanalz|Utilanalz]], a lib for drawing and analyzing data.

===== Information Processing (Zhi, Hang)=====
   * [[projs/clans/docs/infoPro_lib_utilData|UtilData]], a lib for simple data processing.
   * [[projs/clans/docs/infoPro_lib_stanfordParserPipeCn|stanfordParserPipeCn]], a python interface for stanfordParser.

===== Social Media Crawling (Junfeng)=====
**//[[projs:clans:docs:social_media_crawling_junfeng:versions|Version Change Log]]//**


==== Code File and Function Description ====
=== sqlite2cookie.py ===
//Parse cookie from cookie sqlite (For Firefox and Chrome browser)//

//[[projs:clans:docs:social_media_crawling_junfeng:sqlite2cookie|sqlite2cookie()]]//

=== dbOperP.py ===

//[[projs:clans:docs:social_media_crawling_junfeng:dboperp|Class: dbOperator]]//

//Operate the data base (select, insert)//

=== sinaMBCSearchBug.py ===

//[[projs:clans:docs:social_media_crawling_junfeng:sinambcsearchbug|Class: WeiBoCBug]]//

//The Crawler for company//

=== sinaMBPSearchBug.py ===

//[[projs:clans:docs:social_media_crawling_junfeng:sinambpsearchbug|Class: WeiBoPBug]]//

//The Crawler for person//

=== sinaBug.py ===

//The Crawler master, control the crawler and make it run continually//

//  linux run command: //

// ‘nohup /local/fdm/python27/bin/python /local/fdm/weibobug/sinaBug.py &’ //

===== Social Network Analysis (Lily) =====
[[projs:clans:docs:snbf|Class: SocialNetwork]]

[[projs:clans:docs:snd|Class Distribution]]

[[projs:clans:docs:sps|Class ShortestPathServer]]

===== Data Source (Lily, Zhi -database) =====

====database tables====
===prediction related===
  * [[projs/clans/docs/dataset_db_stock_return|db::stock_return]]

===personal information related===
  * [[projs/clans/docs/dataset_db_newdata_people_edu|newdata_people_edu]]
  * [[projs/clans/docs/dataset_db_newdata_people_work|newdata_people_work]]
  * [[projs/clans/docs/dataset_db_newdata_peopleinfor|newdata_peopleinfor]]
Navigation

About Us

Publications

Professional Activities

Lab and Projects

Affiliated Labs

Organizations

Current Activities

See Irwin King In

Book Titles

MISC
