Practical assessment of remotely communicated end-point servers of leading web crawlers

Ijaz Ali Shoukat; Wasai Shadab Ansari; Mohsin Iftikhar; Javid Taheri; Albert Y Zomaya

doi:10.1109/JCSSE.2012.6261955

Practical assessment of remotely communicated end-point servers of leading web crawlers

Ijaz Ali Shoukat, Wasai Shadab Ansari, Mohsin Iftikhar, Javid Taheri, Albert Y Zomaya

Research output: Book chapter/Published conference paper › Conference paper › peer-review

3 Citations (Scopus)

Abstract

Exploration of future dreams inclined us in information quest over the global literature. Web crawlers enriched with technological phenomena for such purpose to millions of seekers. The usage of crawling tools implicates justification for their consequences as searching technology that facilitates initiative passion to target new information. Several web crawlers are available with different technological mechanism of remotely communicated servers; but their efficiency in terms of different performance metrics has been an open question. Previous studies provide inadequate comparison with limited analysis factors against these servers. Here we put an effort and provided new results by considering several performance metrics under practical estimation of technical factors with maximum capacity to evaluate foremost crawling technology based end-point servers. We extensively studied remote servers running behind Google, Yahoo, MSN, Gigablast, Mamma and Excite. We reflected their performance in terms of response time, load, health status, down time, uptime, availability and reliability. These new results would provide a deep insight to every researcher regarding to searching usages and related technological enhancement in future. Â© 2012 IEEE.

Original language	English
Title of host publication	Proceedings of the 2012 Ninth International Joint Conference on Computer Science and Software Engineering (JCSSE)
Place of Publication	United States
Publisher	IEEE, Institute of Electrical and Electronics Engineers
Pages	219-224
Number of pages	6
ISBN (Electronic)	9781476319218
DOIs	https://doi.org/10.1109/JCSSE.2012.6261955
Publication status	Published - 2012
Event	The Ninth International Joint Conference on Computer Science and Software Engineering: JCSSE'12 - University of the Thai Chamber of Commerce, Bangkok, Thailand Duration: 30 May 2012 → 01 Jun 2012 https://web.archive.org/web/20120404220036/https://engineer.utcc.ac.th/jcsse/ (Archived page)

Conference

Conference	The Ninth International Joint Conference on Computer Science and Software Engineering
Country/Territory	Thailand
City	Bangkok
Period	30/05/12 → 01/06/12
Internet address	https://web.archive.org/web/20120404220036/https://engineer.utcc.ac.th/jcsse/ (Archived page)

Access to Document

10.1109/JCSSE.2012.6261955

Cite this

Shoukat, I. A., Ansari, W. S., Iftikhar, M., Taheri, J., & Zomaya, A. Y. (2012). Practical assessment of remotely communicated end-point servers of leading web crawlers. In Proceedings of the 2012 Ninth International Joint Conference on Computer Science and Software Engineering (JCSSE) (pp. 219-224). IEEE, Institute of Electrical and Electronics Engineers. https://doi.org/10.1109/JCSSE.2012.6261955

@inproceedings{6a228a688ea945cc99d361cbd5e08339,

title = "Practical assessment of remotely communicated end-point servers of leading web crawlers",

abstract = "Exploration of future dreams inclined us in information quest over the global literature. Web crawlers enriched with technological phenomena for such purpose to millions of seekers. The usage of crawling tools implicates justification for their consequences as searching technology that facilitates initiative passion to target new information. Several web crawlers are available with different technological mechanism of remotely communicated servers; but their efficiency in terms of different performance metrics has been an open question. Previous studies provide inadequate comparison with limited analysis factors against these servers. Here we put an effort and provided new results by considering several performance metrics under practical estimation of technical factors with maximum capacity to evaluate foremost crawling technology based end-point servers. We extensively studied remote servers running behind Google, Yahoo, MSN, Gigablast, Mamma and Excite. We reflected their performance in terms of response time, load, health status, down time, uptime, availability and reliability. These new results would provide a deep insight to every researcher regarding to searching usages and related technological enhancement in future. {\^A}{\textcopyright} 2012 IEEE.",

keywords = "Information Retrieval and Filtering, Performance Evaluation, QoS, Search Engines, Web Crawlers",

author = "Shoukat, {Ijaz Ali} and Ansari, {Wasai Shadab} and Mohsin Iftikhar and Javid Taheri and Zomaya, {Albert Y}",

note = "Imported on 03 May 2017 - DigiTool details were: publisher = United States: IEEE, 2012. Event dates (773o) = 30 May - 01 Jun 2012; Parent title (773t) = International Joint Conference on Computer Science and Software Engineering.; The Ninth International Joint Conference on Computer Science and Software Engineering : JCSSE'12 ; Conference date: 30-05-2012 Through 01-06-2012",

year = "2012",

doi = "10.1109/JCSSE.2012.6261955",

language = "English",

pages = "219--224",

booktitle = "Proceedings of the 2012 Ninth International Joint Conference on Computer Science and Software Engineering (JCSSE)",

publisher = "IEEE, Institute of Electrical and Electronics Engineers",

address = "United States",

url = "https://web.archive.org/web/20120404220036/https://engineer.utcc.ac.th/jcsse/",

}

Shoukat, IA, Ansari, WS, Iftikhar, M, Taheri, J & Zomaya, AY 2012, Practical assessment of remotely communicated end-point servers of leading web crawlers. in Proceedings of the 2012 Ninth International Joint Conference on Computer Science and Software Engineering (JCSSE). IEEE, Institute of Electrical and Electronics Engineers, United States, pp. 219-224, The Ninth International Joint Conference on Computer Science and Software Engineering, Bangkok, Thailand, 30/05/12. https://doi.org/10.1109/JCSSE.2012.6261955

Practical assessment of remotely communicated end-point servers of leading web crawlers. / Shoukat, Ijaz Ali; Ansari, Wasai Shadab; Iftikhar, Mohsin et al.
Proceedings of the 2012 Ninth International Joint Conference on Computer Science and Software Engineering (JCSSE). United States: IEEE, Institute of Electrical and Electronics Engineers, 2012. p. 219-224.

Research output: Book chapter/Published conference paper › Conference paper › peer-review

TY - GEN

T1 - Practical assessment of remotely communicated end-point servers of leading web crawlers

AU - Shoukat, Ijaz Ali

AU - Ansari, Wasai Shadab

AU - Iftikhar, Mohsin

AU - Taheri, Javid

AU - Zomaya, Albert Y

N1 - Imported on 03 May 2017 - DigiTool details were: publisher = United States: IEEE, 2012. Event dates (773o) = 30 May - 01 Jun 2012; Parent title (773t) = International Joint Conference on Computer Science and Software Engineering.

PY - 2012

Y1 - 2012

N2 - Exploration of future dreams inclined us in information quest over the global literature. Web crawlers enriched with technological phenomena for such purpose to millions of seekers. The usage of crawling tools implicates justification for their consequences as searching technology that facilitates initiative passion to target new information. Several web crawlers are available with different technological mechanism of remotely communicated servers; but their efficiency in terms of different performance metrics has been an open question. Previous studies provide inadequate comparison with limited analysis factors against these servers. Here we put an effort and provided new results by considering several performance metrics under practical estimation of technical factors with maximum capacity to evaluate foremost crawling technology based end-point servers. We extensively studied remote servers running behind Google, Yahoo, MSN, Gigablast, Mamma and Excite. We reflected their performance in terms of response time, load, health status, down time, uptime, availability and reliability. These new results would provide a deep insight to every researcher regarding to searching usages and related technological enhancement in future. Â© 2012 IEEE.

AB - Exploration of future dreams inclined us in information quest over the global literature. Web crawlers enriched with technological phenomena for such purpose to millions of seekers. The usage of crawling tools implicates justification for their consequences as searching technology that facilitates initiative passion to target new information. Several web crawlers are available with different technological mechanism of remotely communicated servers; but their efficiency in terms of different performance metrics has been an open question. Previous studies provide inadequate comparison with limited analysis factors against these servers. Here we put an effort and provided new results by considering several performance metrics under practical estimation of technical factors with maximum capacity to evaluate foremost crawling technology based end-point servers. We extensively studied remote servers running behind Google, Yahoo, MSN, Gigablast, Mamma and Excite. We reflected their performance in terms of response time, load, health status, down time, uptime, availability and reliability. These new results would provide a deep insight to every researcher regarding to searching usages and related technological enhancement in future. Â© 2012 IEEE.

KW - Information Retrieval and Filtering

KW - Performance Evaluation

KW - QoS

KW - Search Engines

KW - Web Crawlers

U2 - 10.1109/JCSSE.2012.6261955

DO - 10.1109/JCSSE.2012.6261955

M3 - Conference paper

SP - 219

EP - 224

BT - Proceedings of the 2012 Ninth International Joint Conference on Computer Science and Software Engineering (JCSSE)

PB - IEEE, Institute of Electrical and Electronics Engineers

CY - United States

T2 - The Ninth International Joint Conference on Computer Science and Software Engineering

Y2 - 30 May 2012 through 1 June 2012

ER -

Shoukat IA, Ansari WS, Iftikhar M, Taheri J, Zomaya AY. Practical assessment of remotely communicated end-point servers of leading web crawlers. In Proceedings of the 2012 Ninth International Joint Conference on Computer Science and Software Engineering (JCSSE). United States: IEEE, Institute of Electrical and Electronics Engineers. 2012. p. 219-224 doi: 10.1109/JCSSE.2012.6261955

Practical assessment of remotely communicated end-point servers of leading web crawlers

Abstract

Conference

Access to Document

Fingerprint

Cite this