a国产,中文字幕久久波多野结衣AV,欧美粗大猛烈老熟妇,女人av天堂

Web信息智能抽取技術(shù)的研究與實現(xiàn)

發(fā)布時間:2018-01-14 08:37

  本文關(guān)鍵詞:Web信息智能抽取技術(shù)的研究與實現(xiàn) 出處:《電子科技大學(xué)》2009年碩士論文 論文類型:學(xué)位論文


  更多相關(guān)文章: 信息抽取 規(guī)則生成器 模板生成器 增量/多頁處理


【摘要】: 隨著我國經(jīng)濟的迅速發(fā)展,國家信息基礎(chǔ)設(shè)施建設(shè)強度加大加強和人民生活質(zhì)量的提高,網(wǎng)絡(luò)已經(jīng)深入人們生活的方方面面,成為工作或生活中不可缺少的一部分,怎樣快速有效的獲取Web上的信息,已經(jīng)成為了一個重要的研究課題。但是網(wǎng)絡(luò)上的信息種類繁多、網(wǎng)頁結(jié)構(gòu)形式多變,大多數(shù)網(wǎng)頁上還包含了許多廣告、導(dǎo)航、熱點鏈接等噪音信息,這些問題給研究者帶來了很大的困擾。而目前的信息抽取技術(shù)還存在很多不足:如僅能處理一種類型網(wǎng)頁,提取的信息細化程度低,準確率與效率矛盾、人工干預(yù)與智能化操作、不支持增量信息處理等問題。這就迫切需要一種全新的信息提取方法來解決這些問題,本課題就是在這種需求下產(chǎn)生的。 本文主要采用的是模板化的信息提取算法,先利用規(guī)則生成器識別網(wǎng)頁上的目標實體分隔符,然后由模板生成器把這些分割標記配置到模板中,最后由信息抽取器根據(jù)模板提取該站點的相關(guān)信息。具體創(chuàng)新點或關(guān)鍵技術(shù)如下: 1、通過分析的站點網(wǎng)頁結(jié)構(gòu),分析網(wǎng)頁結(jié)構(gòu)布局形式和標簽的分布規(guī)律,并結(jié)合目前國內(nèi)外的信息抽取技術(shù),發(fā)明了一套可以定義任何網(wǎng)頁結(jié)構(gòu)形式的模板,并設(shè)計出了一套模板自動配置方案; 2、設(shè)計了信息抽取器:實現(xiàn)了讀取模板,以及根據(jù)模板配置進行信息抽取的方法,并在此過程中增加了信息增量/多頁處理算法:采用增量/多頁算法來解決同一主題的內(nèi)容分布在多個網(wǎng)頁的問題,即需要進行融合計算,以及解決不同時間段,主題網(wǎng)頁內(nèi)容動態(tài)更新的問題,即要進行增量提取;去重處理算法:處理站點間相似或相同主題重復(fù)問題; 3、結(jié)果的結(jié)構(gòu)化存儲:根據(jù)模板的配置,提取相關(guān)的信息,并采用結(jié)構(gòu)化的形式進行保存;設(shè)計一個可動態(tài)擴展的信息提取系統(tǒng):根據(jù)不同的需要,動態(tài)配置模板,不需要更改代碼。 本文在理論上提出了一套依據(jù)模板能自動提取各種類型網(wǎng)頁的信息抽取方案,并開發(fā)了相應(yīng)的系統(tǒng)IWIES。實踐結(jié)果證明,本方案相對于常見的Web信息抽取技術(shù)方法具有更好的提取速度以及更高的準確率、召回率。
[Abstract]:With the rapid development of our country's economy, the strengthening of the national information infrastructure construction and the improvement of the people's quality of life, the network has gone deep into all aspects of people's life. Become an indispensable part of work or life, how to quickly and effectively obtain information on Web, has become an important research topic, but there are many kinds of information on the network. The structure of the web page is changeable, and most web pages also contain a lot of noise information, such as advertisement, navigation, hot link and so on. These problems have brought a great deal of trouble to the researchers. However, the current information extraction technology still has many shortcomings: only one type of web pages can be processed, the degree of information refinement is low, and the accuracy and efficiency are contradictory. Artificial intervention and intelligent operation do not support incremental information processing and so on. Therefore, a new information extraction method is urgently needed to solve these problems. This paper mainly uses the template-based information extraction algorithm, first using the rule generator to identify the target entity separator on the web page, and then the template generator to configure these segmentation tags into the template. Finally, the information extractor extracts the relevant information of the site according to the template. The specific innovation points or key technologies are as follows: 1. Through the analysis of the structure of the web page, the layout of the page structure and the distribution of tags, and combined with the current information extraction technology at home and abroad. A set of templates can define any form of web page structure, and a set of template automatic configuration scheme is designed. 2. The information extractor is designed: the method of reading the template and extracting the information according to the configuration of the template is implemented. In this process, the information increment / multi-page processing algorithm is added: the incremental / multi-page algorithm is used to solve the problem that the content of the same topic is distributed in multiple pages, that is, the fusion calculation is needed. And to solve the problem of dynamic updating of theme pages in different time periods, that is to do incremental extraction; De-reprocessing algorithm: to deal with similar or the same topic repeat problem between sites; (3) structured storage of results: according to the configuration of templates, the relevant information is extracted and stored in a structured form; Design a dynamic extensible information extraction system: according to different needs, dynamically configure the template without changing the code. In this paper, we propose a set of information extraction schemes based on template which can automatically extract all kinds of web pages, and develop the corresponding system IWIES. the practical results prove that. This scheme has better extraction speed, higher accuracy and higher recall than common Web information extraction methods.
【學(xué)位授予單位】:電子科技大學(xué)
【學(xué)位級別】:碩士
【學(xué)位授予年份】:2009
【分類號】:TP391.1

【引證文獻】

相關(guān)期刊論文 前2條

1 鄭思婷;楊p芑,

本文編號:1422856


資料下載
論文發(fā)表

本文鏈接:http://www.wukwdryxk.cn/wenyilunwen/guanggaoshejilunwen/1422856.html


Copyright(c)文論論文網(wǎng)All Rights Reserved | 網(wǎng)站地圖 |

版權(quán)申明:資料由用戶1ca14***提供,本站僅收錄摘要或目錄,作者需要刪除請E-mail郵箱bigeng88@qq.com
日本xxx色视频在线观看| 开心五月激情综合婷婷色| free性玩弄少妇hd| 久久久久亚洲AV成人无码| 日本在线高清| 搡老女人老91妇女老熟女oo | 国产美女一区二区三区| 欧美综合一区二区| 黄庄月饼哪家正宗| 欧美猛男男办公室激情| 精品久久久久久无码免费| 国产真人中国a级毛片| 精品久久久久久无码人妻蜜桃| 国产色产综合色产在线视频| 2020久久天天躁狠狠躁夜夜| 国产精品久久久久久久福利| 国产免费久久精品国产传媒| 日日摸日日碰夜夜爽无| 昌宁县| 国产精品第一国产精品| 亚洲天堂| 宁蒗| 国产av国片精品有毛| 高唐县| 欧美乱妇欲仙欲死视频| 兴安盟| 免费A级毛片无码蜜芽欣赏网| h无码精品动漫在线观看免费| 中文字幕av无码免费久久| 国产风韵犹存丰满大屁股| 青青草原综合久久大伊人| AV成人午夜无码一区二区| 亚洲人成日韩中文字幕不卡| 超薄丝袜足j好爽在线| 久久精品无码免费不卡| 无码专区一va亚洲v专区在线| fc2免费人成在线视频| 国内精品人妻无码久久久影院导航| 日韩欧洲在线高清一区| 无码AV一区二区三区无码| 9277在线观看免费播放|