Web robot detection - Preprocessing web logfiles for robot detection

被引：28

作者：

Bomhardt, C ^{[1
]}

Gaul, W ^{[1
]}

Schmidt-Thieme, L ^{[1
]}

机构：

[1] Univ Karlsruhe, Inst Entscheidungstheorie & Unternehmensforsch, Karlsruhe, Germany

来源：

NEW DEVELOPMENTS IN CLASSIFICATION AND DATA ANALYSIS | 2005年

关键词：

D O I：

10.1007/3-540-27373-5_14

中图分类号：

O21 [概率论与数理统计]; C8 [统计学];

学科分类号：

020208 ; 070103 ; 0714 ;

摘要：

Web usage mining has to face the problem that parts of the underlying logfiles are created by robots. While cooperative robots identify themselves and obey to the instructions of server owners not to access parts or all of the pages on the server, malignant robots may camouflage themselves and have to be detected by web robot scanning devices. We describe the methodology of robot detection and show that highly accurate tools can be applied to decide whether session data was generated by a robot or a human user.

引用

页码：113 / 124

页数：12