Conference paper Open Access

Adaptive focused crawling using online learning: A study on content related to Islamic extremism

Iliou, Christos; Tsikrika, Theodora; Kalpakis, George; Vrochidis, Stefanos; Kompatsiaris, Ioannis

Citation Style Language JSON Export

  "publisher": "Zenodo", 
  "DOI": "10.5281/zenodo.1415483", 
  "language": "eng", 
  "title": "Adaptive focused crawling using online learning: A study on content related to Islamic extremism", 
  "issued": {
    "date-parts": [
  "abstract": "<p>Focused crawlers aim to automatically discover online content resources relevant to a domain of interest by automatically navigating through the Web link structure and selecting which hyperlinks to follow based on an estimation of their relevance to the topic of interest; to this end, classifier-guided approaches are typically employed for identifying hyperlinks having the higher likelihood of leading to relevant content. However, the training data used for building these classifiers might not be entirely representative of the domain of interest, or the domain of interest might change over time. To meet these challenges, this work proposes a novel adaptive focused crawling framework that allows the classifiers that underlie the hyperlink selection policy to be adapted based on the evidence they encounter during their crawls. Our frame-<br>\nwork uses two different approaches to retrain its models: (i) Interactive Adaptation, where a user manually evaluates the discovered resources, and (ii) Automatic Adaptation, where the framework uses the already trained classifiers to assess the relevance of newly discovered resources.The evaluation experiments in the domain of Islamic extremism indicate<br>\nthe effectiveness of online learning in focused crawling.</p>", 
  "author": [
      "family": "Iliou, Christos"
      "family": "Tsikrika, Theodora"
      "family": "Kalpakis, George"
      "family": "Vrochidis, Stefanos"
      "family": "Kompatsiaris, Ioannis"
  "id": "1415483", 
  "event-place": "St. Petersburg, Russia", 
  "version": "Focused crawling, Adaptive learning, Online learning, Islamic extremism", 
  "type": "paper-conference", 
  "event": "5th International Conference on Internet Science (INSCI 2018)"
All versions This version
Views 4747
Downloads 3131
Data volume 35.4 MB35.4 MB
Unique views 4141
Unique downloads 2929


Cite as